2021-02-24T15:04:26.099 INFO:root:teuthology version: 1.1.0-9a6b849c 2021-02-24T15:04:26.102 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_sage@teuthology --verbose --archive /home/teuthworker/archive/sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi/5909684 --name sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi --description rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} -- /home/teuthworker/archive/sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi/5909684/orig.config.yaml 2021-02-24T15:04:26.152 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-02-24T15:04:26.221 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi/5909684 branch: wip-sage-testing-2021-02-23-1850 description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} email: null first_in_suite: false job_id: '5909684' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: '8.2' overrides: admin_socket: branch: wip-sage-testing-2021-02-23-1850 ceph: conf: global: debug ms: 1 debug objecter: 20 debug rados: 20 mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 mon warn on pool no app: false paxos min: 10 paxos service trim min: 5 paxos trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_FULL\) - \(SLOW_OPS\) - \(MON_DOWN\) - \(PG_ - \(POOL_APP_NOT_ENABLED\) - \(SMALLER_PGP_NUM\) - slow request log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: c089f21ba7ed78502aadcbf90668ca79817e877e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: c089f21ba7ed78502aadcbf90668ca79817e877e selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-sage-testing-2021-02-23-1850 sha1: c089f21ba7ed78502aadcbf90668ca79817e877e owner: scheduled_sage@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 sha1: c089f21ba7ed78502aadcbf90668ca79817e877e sleep_before_teardown: 0 suite: rados suite_branch: wip-sage-testing-2021-02-23-1850 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c089f21ba7ed78502aadcbf90668ca79817e877e/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: c089f21ba7ed78502aadcbf90668ca79817e877e targets: smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEM/Sqo+UCIF7nHOx9Hgh49wGGqc1LjpaWLs4EOcEs8dcGeRSeLZhJekOYFTYKTPwbSmX9/I4hvstLCcBnCl90Cq5/w5Z2Yfl3CvRPNMF+U5x3eM6pKHveRtvpH+YHGMa/h4GdXc1imp8mDwNoGMjQC4SvpPsZhJL2P8Hsp7FAYctQM9/nRUFXaI6xyaKy968hOFY8tGLwJ1wAYU3BNKr+p/xmAuuVoQ77bdIyhJZpvGiTlYzPEKp88eEJOaarmh6qZqmdGxI2XVBb/dAJQHBRP0bCioDxXzGy7wSKHDVxBoLUBKid2/cWHhfIOWS5L1tnuZgmNwbsDAVIoAsaXCnXFcbNJSdIy9IULXC8xCdn1wuyCgWVn19m0UOAO83nbNDJW9psSZkIoNe8rkhYJTMq/qoIQGojhPRggGfM7tlUmw+cC4ewPdUkWcdtPb9CCckJDj+XswP3q4SNoI5hyamYSGjUXhuOOH+Pe44bjJwFJeh6tkOzZ9HqdTmkJ8KLDfM= smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwrkOlC1/JSf2lNPmzbcgZhETp/MU4goaU5jB9vCxhDx1trFgmaSGrmygc0cKm1jmLekDIzfJQHoPWYy5oeJI7Pi19Q5wLr+PEs/QRFs+SFnAMYAAJLAZhxqrOI48iTL7kxaFIAsOCVhfx0M43srqL9VqrF43pNgP82v97qnSUOidu+QJ0/bO9gzyCf/AC+3922T2Ws5A55M2PUNXKyrrJhRlb2ZTyfATp8wvKnCxEkmAJoD+reCIPlLlBIs4TUHzQ4I0+pFoVE9PVrJLDmwtSFf9LaQV3/D0umrz/2cC+f5y6dEOMJ39J+OVL4mZPaj8dF951s4kOaL+Mh1GBLNq2ATQgPlm52kueanuilo1/YF38WMCBAEGvUqHVdoh2qKkGwPJ8RBhB5WQfmDFnYWpwZ/7JfLfqZykRFhse7kZeWZtHhU+V002eStBT51YEWrDVJaMGdImxNAjdG0nCsln39/8TIIw7r7gCNOWaDuYp8lIIYXGj8hYcodJYTs1fKLs= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 thrash_delay: 1 thrash_many: true - workunit: clients: client.0: - rados/test.sh teuthology_branch: master timestamp: 2021-02-24_02:51:12 tube: smithi user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.25973 2021-02-24T15:04:26.222 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c089f21ba7ed78502aadcbf90668ca79817e877e/qa; will attempt to use it 2021-02-24T15:04:26.223 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c089f21ba7ed78502aadcbf90668ca79817e877e/qa/tasks 2021-02-24T15:04:26.224 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-02-24T15:04:26.226 INFO:teuthology.task.internal:Checking packages... 2021-02-24T15:04:26.252 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'c089f21ba7ed78502aadcbf90668ca79817e877e' 2021-02-24T15:04:26.252 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-02-24T15:04:26.253 INFO:teuthology.packaging:ref: None 2021-02-24T15:04:26.253 INFO:teuthology.packaging:tag: None 2021-02-24T15:04:26.253 INFO:teuthology.packaging:branch: wip-sage-testing-2021-02-23-1850 2021-02-24T15:04:26.253 INFO:teuthology.packaging:sha1: c089f21ba7ed78502aadcbf90668ca79817e877e 2021-02-24T15:04:26.254 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-sage-testing-2021-02-23-1850 2021-02-24T15:04:26.425 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-1076.gc089f21b 2021-02-24T15:04:26.426 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-02-24T15:04:26.434 INFO:teuthology.task.internal:no buildpackages task found 2021-02-24T15:04:26.435 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-02-24T15:04:26.475 INFO:teuthology.task.internal:Saving configuration 2021-02-24T15:04:26.493 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-02-24T15:04:26.520 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-24T15:04:26.540 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-24 14:59:12.700546', 'description': '/home/teuthworker/archive/sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi/5909684', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBCN5LvdJA36I3nvw3K+fM4NV3VccVLh04mELrj5HJIT7Tw5l9DJKJ2y08lec4EbZwmlNwBHa2Iglqr4NypoyGA=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi152.front.sepia.ceph.com'} 2021-02-24T15:04:26.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-24 14:59:12.700527', 'description': '/home/teuthworker/archive/sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi/5909684', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlcvE1yQLSJeehkoG+JFoNuineO4k96q4iItIPiYY4S/lbmaUOS1sVRSrql96WhSw/OEHybGd8LVXU5b2mEyHU=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi181.front.sepia.ceph.com'} 2021-02-24T15:04:26.560 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-02-24T15:04:26.570 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2021-02-24T15:04:26.570 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2021-02-24T15:04:26.571 INFO:teuthology.run_tasks:Running task console_log... 2021-02-24T15:04:26.643 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f65874b62f0>, signals=[15]) 2021-02-24T15:04:26.645 INFO:teuthology.run_tasks:Running task internal.connect... 2021-02-24T15:04:26.654 INFO:teuthology.task.internal:Opening connections... 2021-02-24T15:04:26.655 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2021-02-24T15:04:26.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-24T15:04:26.730 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2021-02-24T15:04:26.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-24T15:04:26.802 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-02-24T15:04:26.814 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2021-02-24T15:04:26.840 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2021-02-24T15:04:26.841 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2021-02-24T15:04:26.896 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Linux" 2021-02-24T15:04:26.896 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8 (Core)" 2021-02-24T15:04:26.897 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2021-02-24T15:04:26.897 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2021-02-24T15:04:26.898 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2021-02-24T15:04:26.898 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2021-02-24T15:04:26.898 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-02-24T15:04:26.899 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2021-02-24T15:04:26.899 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-02-24T15:04:26.900 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.centos.org/" 2021-02-24T15:04:26.900 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-24T15:04:26.901 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:04:26.901 INFO:teuthology.orchestra.run.smithi152.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-02-24T15:04:26.902 INFO:teuthology.orchestra.run.smithi152.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-02-24T15:04:26.902 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-24T15:04:26.902 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-02-24T15:04:26.903 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:04:26.904 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2021-02-24T15:04:26.920 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2021-02-24T15:04:26.935 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2021-02-24T15:04:26.935 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2021-02-24T15:04:26.989 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Linux" 2021-02-24T15:04:26.990 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8 (Core)" 2021-02-24T15:04:26.990 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2021-02-24T15:04:26.990 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2021-02-24T15:04:26.990 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2021-02-24T15:04:26.991 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2021-02-24T15:04:26.991 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-02-24T15:04:26.991 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2021-02-24T15:04:26.991 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-02-24T15:04:26.992 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.centos.org/" 2021-02-24T15:04:26.992 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-24T15:04:26.992 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:04:26.992 INFO:teuthology.orchestra.run.smithi181.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-02-24T15:04:26.992 INFO:teuthology.orchestra.run.smithi181.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-02-24T15:04:26.993 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-24T15:04:26.993 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-02-24T15:04:26.993 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:04:26.993 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2021-02-24T15:04:27.010 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-02-24T15:04:27.025 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-02-24T15:04:27.039 INFO:teuthology.task.internal:Checking for old test directory... 2021-02-24T15:04:27.039 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2021-02-24T15:04:27.042 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2021-02-24T15:04:27.056 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-02-24T15:04:27.092 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-02-24T15:04:27.093 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2021-02-24T15:04:27.096 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2021-02-24T15:04:27.119 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-02-24T15:04:27.166 INFO:teuthology.run_tasks:Running task kernel... 2021-02-24T15:04:27.186 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}} 2021-02-24T15:04:27.187 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-02-24T15:04:27.187 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2021-02-24T15:04:27.201 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-193.28.1.el8_2.x86_64 2021-02-24T15:04:27.202 INFO:teuthology.task.kernel:Running kernel on smithi152: 4.18.0-193.28.1.el8_2.x86_64 2021-02-24T15:04:27.208 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2021-02-24T15:04:30.259 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - AppStream 28 MB/s | 6.3 MB 00:00 2021-02-24T15:04:31.320 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - Base 26 MB/s | 2.3 MB 00:00 2021-02-24T15:04:31.763 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - Extras 140 kB/s | 9.0 kB 00:00 2021-02-24T15:04:32.238 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 21 MB/s | 8.9 MB 00:00 2021-02-24T15:04:34.075 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-02-24T15:04:35.163 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-02-24T15:04:35.163 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2021-02-24T15:04:35.344 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:04:35.353 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:04:35.354 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:04:35.354 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:04:35.354 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:04:35.354 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 4.3 M 2021-02-24T15:04:35.355 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2021-02-24T15:04:35.355 INFO:teuthology.orchestra.run.smithi152.stdout: linux-firmware noarch 20200619-101.git3890db36.el8_3 CentOS-Base 101 M 2021-02-24T15:04:35.355 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2021-02-24T15:04:35.355 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 30 M 2021-02-24T15:04:35.355 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 26 M 2021-02-24T15:04:35.356 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:04:35.356 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:04:35.356 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:04:35.356 INFO:teuthology.orchestra.run.smithi152.stdout:Install 3 Packages 2021-02-24T15:04:35.356 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 1 Package 2021-02-24T15:04:35.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:04:35.357 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 162 M 2021-02-24T15:04:35.357 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:04:35.530 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): kernel-4.18.0-240.10.1.el8_3.x86_64.rpm 25 MB/s | 4.3 MB 00:00 2021-02-24T15:04:36.439 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): kernel-core-4.18.0-240.10.1.el8_3.x86_64 28 MB/s | 30 MB 00:01 2021-02-24T15:04:36.749 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): kernel-modules-4.18.0-240.10.1.el8_3.x86 18 MB/s | 26 MB 00:01 2021-02-24T15:04:38.115 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): linux-firmware-20200619-101.git3890db36. 39 MB/s | 101 MB 00:02 2021-02-24T15:04:38.118 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:04:38.119 INFO:teuthology.orchestra.run.smithi152.stdout:Total 59 MB/s | 162 MB 00:02 2021-02-24T15:04:38.212 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:04:38.527 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:04:38.527 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:04:40.262 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:04:40.264 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:04:50.303 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:04:52.085 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : linux-firmware-20200619-101.git3890db36.el8_3.noarch 1/5 2021-02-24T15:04:52.651 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-24T15:04:55.355 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-24T15:04:55.684 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-24T15:04:58.570 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-24T15:04:58.769 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-4.18.0-240.10.1.el8_3.x86_64 4/5 2021-02-24T15:04:59.028 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-24T15:05:18.600 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 5/5 2021-02-24T15:05:18.919 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-24T15:05:18.919 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-4.18.0-240.10.1.el8_3.x86_64 1/5 2021-02-24T15:05:18.919 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-24T15:05:18.920 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-24T15:05:18.920 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : linux-firmware-20200619-101.git3890db36.el8_3.noarch 4/5 2021-02-24T15:05:19.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-24T15:05:19.308 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:05:19.308 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2021-02-24T15:05:19.308 INFO:teuthology.orchestra.run.smithi152.stdout: linux-firmware-20200619-101.git3890db36.el8_3.noarch 2021-02-24T15:05:19.309 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:05:19.309 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:05:19.309 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:05:19.309 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:05:19.310 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:05:19.310 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:05:19.310 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:05:19.459 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel --last | head -n 1 2021-02-24T15:05:19.563 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Wed 24 Feb 2021 03:04:58 PM UTC 2021-02-24T15:05:19.565 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:05:19.565 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-193.28.1.el8_2.x86_64 Expected: 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:05:19.566 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2021-02-24T15:05:19.583 INFO:teuthology.orchestra.run.smithi181.stdout:4.18.0-193.28.1.el8_2.x86_64 2021-02-24T15:05:19.583 INFO:teuthology.task.kernel:Running kernel on smithi181: 4.18.0-193.28.1.el8_2.x86_64 2021-02-24T15:05:19.583 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2021-02-24T15:05:22.541 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-8 - AppStream 37 MB/s | 6.3 MB 00:00 2021-02-24T15:05:23.602 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-8 - Base 27 MB/s | 2.3 MB 00:00 2021-02-24T15:05:24.050 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-8 - Extras 139 kB/s | 9.0 kB 00:00 2021-02-24T15:05:24.520 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 21 MB/s | 8.9 MB 00:00 2021-02-24T15:05:26.376 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 4.9 MB/s | 24 kB 00:00 2021-02-24T15:05:27.422 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-02-24T15:05:27.423 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2021-02-24T15:05:27.610 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:05:27.614 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:05:27.614 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:05:27.615 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:05:27.615 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:05:27.615 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 4.3 M 2021-02-24T15:05:27.615 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2021-02-24T15:05:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: linux-firmware noarch 20200619-101.git3890db36.el8_3 CentOS-Base 101 M 2021-02-24T15:05:27.616 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2021-02-24T15:05:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 30 M 2021-02-24T15:05:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 26 M 2021-02-24T15:05:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:05:27.617 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:05:27.617 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:05:27.617 INFO:teuthology.orchestra.run.smithi181.stdout:Install 3 Packages 2021-02-24T15:05:27.617 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 1 Package 2021-02-24T15:05:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:05:27.618 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 162 M 2021-02-24T15:05:27.618 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:05:27.970 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): kernel-4.18.0-240.10.1.el8_3.x86_64.rpm 12 MB/s | 4.3 MB 00:00 2021-02-24T15:05:28.299 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): kernel-core-4.18.0-240.10.1.el8_3.x86_64 45 MB/s | 30 MB 00:00 2021-02-24T15:05:28.649 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): kernel-modules-4.18.0-240.10.1.el8_3.x86 25 MB/s | 26 MB 00:01 2021-02-24T15:05:30.256 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): linux-firmware-20200619-101.git3890db36. 44 MB/s | 101 MB 00:02 2021-02-24T15:05:30.259 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:05:30.259 INFO:teuthology.orchestra.run.smithi181.stdout:Total 61 MB/s | 162 MB 00:02 2021-02-24T15:05:30.363 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:05:30.662 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:05:30.662 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:05:32.333 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:05:32.334 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:05:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:05:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : linux-firmware-20200619-101.git3890db36.el8_3.noarch 1/5 2021-02-24T15:05:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-24T15:05:47.288 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-24T15:05:47.645 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-24T15:05:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-24T15:05:50.692 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-4.18.0-240.10.1.el8_3.x86_64 4/5 2021-02-24T15:05:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-24T15:06:10.503 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 5/5 2021-02-24T15:06:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-24T15:06:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-4.18.0-240.10.1.el8_3.x86_64 1/5 2021-02-24T15:06:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-24T15:06:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-24T15:06:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : linux-firmware-20200619-101.git3890db36.el8_3.noarch 4/5 2021-02-24T15:06:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-24T15:06:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:06:11.309 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2021-02-24T15:06:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: linux-firmware-20200619-101.git3890db36.el8_3.noarch 2021-02-24T15:06:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:06:11.310 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:06:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:06:11.311 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:06:11.459 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel --last | head -n 1 2021-02-24T15:06:11.565 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Wed 24 Feb 2021 03:05:50 PM UTC 2021-02-24T15:06:11.567 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:11.567 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-193.28.1.el8_2.x86_64 Expected: 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:11.567 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-02-24T15:06:11.568 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-24T15:06:11.568 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-24T15:06:11.568 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-02-24T15:06:11.568 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2021-02-24T15:06:11.569 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel --last | head -n 1 2021-02-24T15:06:11.666 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Wed 24 Feb 2021 03:04:58 PM UTC 2021-02-24T15:06:11.667 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:11.668 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2021-02-24T15:06:11.700 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2021-02-24T15:06:11.701 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2021-02-24T15:06:11.701 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.02 2021-02-24T15:06:11.701 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 81.el8 2021-02-24T15:06:11.701 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2021-02-24T15:06:11.702 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Fri 13 Nov 2020 03:02:55 PM UTC 2021-02-24T15:06:11.702 INFO:teuthology.orchestra.run.smithi152.stdout:Group : System Environment/Base 2021-02-24T15:06:11.702 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 9192705 2021-02-24T15:06:11.702 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2021-02-24T15:06:11.702 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-02-24T15:06:11.703 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-02-24T15:06:11.703 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-02-24T15:06:11.703 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : kbuilder.bsys.centos.org 2021-02-24T15:06:11.703 INFO:teuthology.orchestra.run.smithi152.stdout:Relocations : (not relocatable) 2021-02-24T15:06:11.704 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : CentOS BuildSystem 2021-02-24T15:06:11.704 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2021-02-24T15:06:11.704 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2021-02-24T15:06:11.704 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2021-02-24T15:06:11.704 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2021-02-24T15:06:11.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:06:11.705 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-02-24T15:06:11.705 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2021-02-24T15:06:11.705 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2021-02-24T15:06:11.706 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2021-02-24T15:06:11.706 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:06:11.706 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2021-02-24T15:06:11.707 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-02-24T15:06:11.708 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:11.708 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-02-24T15:06:12.514 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2021-02-24T15:06:15.252 INFO:teuthology.orchestra.run.smithi152.stderr:done 2021-02-24T15:06:15.254 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2021-02-24T15:06:15.269 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.9neZPEjy3r 2021-02-24T15:06:15.270 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9neZPEjy3r 2021-02-24T15:06:15.340 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.9neZPEjy3r 2021-02-24T15:06:15.483 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.9neZPEjy3r is 4KB 2021-02-24T15:06:15.532 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.9neZPEjy3r 2021-02-24T15:06:15.546 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2021-02-24T15:06:15.628 INFO:teuthology.orchestra.run.smithi152.stdout:2951a06464bf41f6a3bf91594147ecff-0-rescue.conf 2021-02-24T15:06:15.628 INFO:teuthology.orchestra.run.smithi152.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-193.28.1.el8_2.x86_64.conf 2021-02-24T15:06:15.629 INFO:teuthology.orchestra.run.smithi152.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-193.el8.x86_64.conf 2021-02-24T15:06:15.629 INFO:teuthology.orchestra.run.smithi152.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-240.10.1.el8_3.x86_64.conf 2021-02-24T15:06:15.630 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default 2951a06464bf41f6a3bf91594147ecff-4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:15.797 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2021-02-24T15:06:15.799 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-02-24T15:06:15.800 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2021-02-24T15:06:15.800 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel --last | head -n 1 2021-02-24T15:06:15.895 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Wed 24 Feb 2021 03:05:50 PM UTC 2021-02-24T15:06:15.897 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:15.897 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2021-02-24T15:06:15.929 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2021-02-24T15:06:15.929 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2021-02-24T15:06:15.930 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.02 2021-02-24T15:06:15.930 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 81.el8 2021-02-24T15:06:15.930 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2021-02-24T15:06:15.931 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Fri 13 Nov 2020 03:02:55 PM UTC 2021-02-24T15:06:15.931 INFO:teuthology.orchestra.run.smithi181.stdout:Group : System Environment/Base 2021-02-24T15:06:15.931 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 9192705 2021-02-24T15:06:15.931 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2021-02-24T15:06:15.931 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-02-24T15:06:15.932 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-02-24T15:06:15.932 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-02-24T15:06:15.932 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : kbuilder.bsys.centos.org 2021-02-24T15:06:15.932 INFO:teuthology.orchestra.run.smithi181.stdout:Relocations : (not relocatable) 2021-02-24T15:06:15.932 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : CentOS BuildSystem 2021-02-24T15:06:15.933 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2021-02-24T15:06:15.933 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2021-02-24T15:06:15.933 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2021-02-24T15:06:15.933 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2021-02-24T15:06:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:06:15.934 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-02-24T15:06:15.934 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2021-02-24T15:06:15.934 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2021-02-24T15:06:15.934 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2021-02-24T15:06:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:06:15.935 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2021-02-24T15:06:15.936 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-02-24T15:06:15.936 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:15.936 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-02-24T15:06:17.147 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2021-02-24T15:06:19.534 INFO:teuthology.orchestra.run.smithi181.stderr:done 2021-02-24T15:06:19.537 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2021-02-24T15:06:19.559 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.33Q8dCbgZJ 2021-02-24T15:06:19.560 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.33Q8dCbgZJ 2021-02-24T15:06:19.630 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.33Q8dCbgZJ 2021-02-24T15:06:19.790 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.33Q8dCbgZJ is 4KB 2021-02-24T15:06:19.838 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.33Q8dCbgZJ 2021-02-24T15:06:19.852 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2021-02-24T15:06:19.915 INFO:teuthology.orchestra.run.smithi181.stdout:2951a06464bf41f6a3bf91594147ecff-0-rescue.conf 2021-02-24T15:06:19.915 INFO:teuthology.orchestra.run.smithi181.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-193.28.1.el8_2.x86_64.conf 2021-02-24T15:06:19.916 INFO:teuthology.orchestra.run.smithi181.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-193.el8.x86_64.conf 2021-02-24T15:06:19.916 INFO:teuthology.orchestra.run.smithi181.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-240.10.1.el8_3.x86_64.conf 2021-02-24T15:06:19.917 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default 2951a06464bf41f6a3bf91594147ecff-4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:06:20.048 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2021-02-24T15:06:50.078 INFO:teuthology.misc:Re-opening connections... 2021-02-24T15:06:50.079 INFO:teuthology.misc:trying to connect to ubuntu@smithi152.front.sepia.ceph.com 2021-02-24T15:06:50.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:06:50.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-24T15:07:08.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2021-02-24T15:07:08.616 INFO:teuthology.misc:trying to connect to ubuntu@smithi181.front.sepia.ceph.com 2021-02-24T15:07:08.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:07:08.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-24T15:08:08.620 DEBUG:teuthology.orchestra.remote:timed out 2021-02-24T15:08:08.622 DEBUG:teuthology.misc:waited 78.54306268692017 2021-02-24T15:08:09.623 INFO:teuthology.misc:trying to connect to ubuntu@smithi152.front.sepia.ceph.com 2021-02-24T15:08:09.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:08:09.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-24T15:08:09.918 DEBUG:teuthology.orchestra.run.smithi152:> true 2021-02-24T15:08:10.318 DEBUG:teuthology.misc:waited 80.23873114585876 2021-02-24T15:08:11.319 INFO:teuthology.misc:trying to connect to ubuntu@smithi181.front.sepia.ceph.com 2021-02-24T15:08:11.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:08:11.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-24T15:08:11.659 DEBUG:teuthology.orchestra.run.smithi181:> true 2021-02-24T15:08:11.978 DEBUG:teuthology.misc:waited 81.89854645729065 2021-02-24T15:08:12.979 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-02-24T15:08:12.979 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-240.10.1.el8_3.x86_64"... 2021-02-24T15:08:12.980 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2021-02-24T15:08:13.000 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:08:13.001 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.10.1.el8_3.x86_64 vs 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:08:13.001 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-24T15:08:13.001 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-02-24T15:08:13.002 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-02-24T15:08:13.002 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-240.10.1.el8_3.x86_64"... 2021-02-24T15:08:13.002 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2021-02-24T15:08:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:08:13.019 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.10.1.el8_3.x86_64 vs 4.18.0-240.10.1.el8_3.x86_64 2021-02-24T15:08:13.020 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-24T15:08:13.020 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-02-24T15:08:14.021 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-02-24T15:08:14.022 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-24T15:08:14.114 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2021-02-24T15:08:14.127 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-02-24T15:08:14.128 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-24T15:08:14.203 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2021-02-24T15:08:14.218 INFO:teuthology.run_tasks:Running task internal.base... 2021-02-24T15:08:14.228 INFO:teuthology.task.internal:Creating test directory... 2021-02-24T15:08:14.229 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-24T15:08:14.232 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-24T15:08:14.247 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-02-24T15:08:14.291 INFO:teuthology.run_tasks:Running task internal.archive... 2021-02-24T15:08:14.308 INFO:teuthology.task.internal:Creating archive directory... 2021-02-24T15:08:14.309 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-24T15:08:14.311 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-24T15:08:14.343 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-02-24T15:08:14.354 INFO:teuthology.task.internal:Enabling coredump saving... 2021-02-24T15:08:14.355 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-24T15:08:14.367 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-24T15:08:14.399 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-24T15:08:14.406 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-24T15:08:14.410 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-24T15:08:14.417 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-24T15:08:14.419 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-02-24T15:08:14.429 INFO:teuthology.task.internal:Configuring sudo... 2021-02-24T15:08:14.429 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-24T15:08:14.453 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-24T15:08:14.485 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-02-24T15:08:14.496 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-02-24T15:08:14.497 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-24T15:08:14.518 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-24T15:08:14.541 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-24T15:08:14.607 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-24T15:08:14.664 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-24T15:08:14.738 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-24T15:08:14.784 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:08:14.785 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-24T15:08:14.848 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-24T15:08:14.885 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-24T15:08:14.943 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-24T15:08:15.019 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-24T15:08:15.067 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:08:15.067 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-24T15:08:15.132 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2021-02-24T15:08:15.135 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2021-02-24T15:08:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-24T15:08:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-24T15:08:15.706 INFO:teuthology.run_tasks:Running task internal.timer... 2021-02-24T15:08:15.719 INFO:teuthology.task.internal:Starting timer... 2021-02-24T15:08:15.719 INFO:teuthology.run_tasks:Running task pcp... 2021-02-24T15:08:15.752 INFO:teuthology.run_tasks:Running task selinux... 2021-02-24T15:08:15.765 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-02-24T15:08:15.766 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2021-02-24T15:08:15.856 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: [ OK ] 2021-02-24T15:08:15.857 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2021-02-24T15:08:15.915 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: [ OK ] 2021-02-24T15:08:15.917 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-02-24T15:08:15.917 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2021-02-24T15:08:15.946 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2021-02-24T15:08:15.947 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2021-02-24T15:08:15.971 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2021-02-24T15:08:15.972 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2021-02-24T15:08:15.973 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-24T15:08:16.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-24T15:08:16.012 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-24T15:08:16.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-24T15:08:16.038 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-02-24T15:08:16.039 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2021-02-24T15:08:16.077 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2021-02-24T15:08:16.107 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-02-24T15:08:16.135 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-02-24T15:08:16.137 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-02-24T15:08:16.161 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-02-24T15:08:16.163 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-02-24T15:08:16.555 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-02-24T15:08:17.473 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-02-24T15:08:20.103 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-02-24T15:08:20.123 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:20 +0000 (0:00:00.069) 0:00:00.069 **** 2021-02-24T15:08:20.137 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:20 +0000 (0:00:00.013) 0:00:00.083 **** 2021-02-24T15:08:21.645 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi152.front.sepia.ceph.com] 2021-02-24T15:08:21.729 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:21 +0000 (0:00:01.592) 0:00:01.675 **** 2021-02-24T15:08:21.743 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] 2021-02-24T15:08:21.818 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:21 +0000 (0:00:00.088) 0:00:01.764 **** 2021-02-24T15:08:22.050 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-02-24T15:08:22.052 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-24T15:08:22.087 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:22 +0000 (0:00:00.268) 0:00:02.033 **** 2021-02-24T15:08:22.123 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:22 +0000 (0:00:00.036) 0:00:02.069 **** 2021-02-24T15:08:22.500 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-02-24T15:08:22.501 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-24T15:08:22.550 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:22 +0000 (0:00:00.426) 0:00:02.496 **** 2021-02-24T15:08:22.558 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-24T15:08:22.600 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:22 +0000 (0:00:00.050) 0:00:02.546 **** 2021-02-24T15:08:22.601 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:22.609 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-02-24T15:08:22.611 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:22.656 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:22 +0000 (0:00:00.056) 0:00:02.602 **** 2021-02-24T15:08:22.665 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:22.705 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:22 +0000 (0:00:00.048) 0:00:02.651 **** 2021-02-24T15:08:23.010 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi181.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:08:23.051 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:23 +0000 (0:00:00.346) 0:00:02.997 **** 2021-02-24T15:08:23.059 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:08:23.111 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:23 +0000 (0:00:00.059) 0:00:03.057 **** 2021-02-24T15:08:23.940 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179303.0674815-215896790676161/source", "state": "file", "uid": 0} 2021-02-24T15:08:23.976 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:23 +0000 (0:00:00.865) 0:00:03.922 **** 2021-02-24T15:08:23.984 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179303.1267521-226192556470578/source", "state": "file", "uid": 0} 2021-02-24T15:08:24.025 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:24 +0000 (0:00:00.047) 0:00:03.970 **** 2021-02-24T15:08:24.386 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-02-24T15:08:24.388 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-02-24T15:08:24.389 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-24T15:08:24.424 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-02-24T15:08:24.427 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-24T15:08:24.539 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2021-02-24T15:08:24.540 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2021-02-24T15:08:24.549 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-02-24T15:08:24.700 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:24 +0000 (0:00:00.675) 0:00:04.646 **** 2021-02-24T15:08:24.733 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:24 +0000 (0:00:00.032) 0:00:04.678 **** 2021-02-24T15:08:25.350 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi152.front.sepia.ceph.com] 2021-02-24T15:08:25.400 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] 2021-02-24T15:08:25.444 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-02-24T15:08:25.447 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:25 +0000 (0:00:00.712) 0:00:05.391 **** 2021-02-24T15:08:25.515 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:25 +0000 (0:00:00.070) 0:00:05.461 **** 2021-02-24T15:08:25.918 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-02-24T15:08:25.920 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.145867", "end": "2021-02-24 15:08:25.894048", "rc": 0, "start": "2021-02-24 15:08:25.748181", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-24T15:08:25.954 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:25 +0000 (0:00:00.439) 0:00:05.900 **** 2021-02-24T15:08:25.963 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.160774", "end": "2021-02-24 15:08:25.902586", "rc": 0, "start": "2021-02-24 15:08:25.741812", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-24T15:08:25.999 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:25 +0000 (0:00:00.044) 0:00:05.945 **** 2021-02-24T15:08:26.152 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-24T15:08:26.154 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011639", "end": "2021-02-24 15:08:26.128453", "failed_when_result": false, "rc": 0, "start": "2021-02-24 15:08:26.116814", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2021-02-24T15:08:26.192 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.190) 0:00:06.136 **** 2021-02-24T15:08:26.208 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008229", "end": "2021-02-24 15:08:26.176033", "failed_when_result": false, "rc": 0, "start": "2021-02-24 15:08:26.167804", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2021-02-24T15:08:26.247 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.057) 0:00:06.194 **** 2021-02-24T15:08:26.253 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-24T15:08:26.255 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.303 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.055) 0:00:06.249 **** 2021-02-24T15:08:26.309 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.358 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.055) 0:00:06.304 **** 2021-02-24T15:08:26.364 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-02-24T15:08:26.365 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.400 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.042) 0:00:06.346 **** 2021-02-24T15:08:26.407 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.442 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.041) 0:00:06.388 **** 2021-02-24T15:08:26.449 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-24T15:08:26.450 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.484 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.042) 0:00:06.430 **** 2021-02-24T15:08:26.491 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.528 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.044) 0:00:06.474 **** 2021-02-24T15:08:26.535 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-24T15:08:26.536 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.578 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.047) 0:00:06.521 **** 2021-02-24T15:08:26.582 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.620 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.044) 0:00:06.566 **** 2021-02-24T15:08:26.626 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-02-24T15:08:26.628 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.662 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.042) 0:00:06.608 **** 2021-02-24T15:08:26.670 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:08:26.706 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.044) 0:00:06.652 **** 2021-02-24T15:08:26.855 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:08:26.897 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.191) 0:00:06.843 **** 2021-02-24T15:08:26.915 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:08:26.951 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:26 +0000 (0:00:00.053) 0:00:06.897 **** 2021-02-24T15:08:27.137 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-24T15:08:27.139 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-24T15:08:27.192 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-24T15:08:27.333 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-24T15:08:27.387 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-24T15:08:27.389 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:27.525 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-24T15:08:27.592 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-24T15:08:27.727 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-24T15:08:27.785 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-24T15:08:27.923 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-24T15:08:27.976 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-24T15:08:28.112 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-24T15:08:28.114 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:28.177 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-24T15:08:28.303 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-24T15:08:28.305 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:28.370 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-24T15:08:28.491 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-24T15:08:28.558 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-24T15:08:28.694 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-24T15:08:28.757 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-24T15:08:28.883 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-24T15:08:28.947 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-24T15:08:29.072 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-24T15:08:29.142 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-24T15:08:29.257 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-24T15:08:29.332 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-24T15:08:29.451 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-24T15:08:29.525 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-24T15:08:29.642 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-24T15:08:29.716 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-24T15:08:29.832 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-24T15:08:29.907 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-24T15:08:30.023 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-24T15:08:30.096 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-24T15:08:30.211 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-24T15:08:30.285 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-24T15:08:30.401 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-24T15:08:30.487 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-24T15:08:30.595 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-24T15:08:30.681 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-24T15:08:30.788 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-24T15:08:30.873 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-24T15:08:30.980 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-24T15:08:31.065 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-24T15:08:31.172 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-24T15:08:31.258 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-24T15:08:31.385 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-24T15:08:31.461 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-24T15:08:31.577 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-24T15:08:31.651 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-24T15:08:31.778 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-24T15:08:31.841 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-24T15:08:31.957 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-24T15:08:32.042 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-24T15:08:32.147 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-24T15:08:32.231 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-24T15:08:32.348 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-24T15:08:32.421 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-24T15:08:32.539 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-24T15:08:32.614 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-24T15:08:32.733 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-24T15:08:32.808 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-24T15:08:32.914 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-24T15:08:33.010 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-24T15:08:33.115 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-24T15:08:33.200 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-24T15:08:33.317 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-24T15:08:33.391 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-24T15:08:33.507 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-24T15:08:33.571 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-24T15:08:33.697 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-24T15:08:33.761 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-24T15:08:33.886 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-24T15:08:33.888 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:33.951 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-24T15:08:33.953 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:34.078 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-24T15:08:34.080 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:34.153 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-24T15:08:34.269 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-24T15:08:34.343 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-24T15:08:34.458 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-24T15:08:34.532 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-24T15:08:34.658 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-24T15:08:34.721 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-24T15:08:34.847 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-24T15:08:34.910 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-24T15:08:35.035 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-24T15:08:35.109 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-24T15:08:35.224 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-24T15:08:35.298 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-24T15:08:35.424 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-24T15:08:35.487 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-24T15:08:35.612 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-24T15:08:35.676 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-24T15:08:35.812 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-24T15:08:35.866 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-24T15:08:36.002 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-24T15:08:36.055 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-24T15:08:36.193 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-24T15:08:36.246 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-24T15:08:36.382 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-24T15:08:36.435 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-24T15:08:36.580 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-24T15:08:36.623 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-24T15:08:36.769 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-24T15:08:36.822 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-24T15:08:36.958 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-24T15:08:37.010 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-24T15:08:37.147 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-24T15:08:37.204 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-24T15:08:37.339 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-24T15:08:37.403 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-24T15:08:37.528 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-24T15:08:37.592 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-24T15:08:37.728 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-24T15:08:37.791 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-24T15:08:37.918 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-24T15:08:37.981 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-24T15:08:38.105 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-24T15:08:38.169 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-24T15:08:38.305 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-24T15:08:38.359 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-24T15:08:38.495 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-24T15:08:38.547 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-24T15:08:38.685 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-24T15:08:38.741 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-24T15:08:38.878 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-24T15:08:38.933 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-24T15:08:39.081 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-24T15:08:39.123 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-24T15:08:39.282 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-24T15:08:39.303 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-24T15:08:39.471 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-24T15:08:39.493 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-24T15:08:39.663 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-24T15:08:39.685 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-24T15:08:39.853 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-24T15:08:39.875 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-24T15:08:40.043 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-24T15:08:40.066 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-24T15:08:40.235 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-24T15:08:40.256 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-24T15:08:40.426 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-24T15:08:40.447 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-24T15:08:40.625 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-24T15:08:40.638 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-24T15:08:40.816 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-24T15:08:40.828 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-24T15:08:41.016 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-24T15:08:41.027 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-24T15:08:41.206 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-24T15:08:41.224 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-24T15:08:41.411 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-24T15:08:41.412 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-24T15:08:41.600 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-24T15:08:41.612 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-24T15:08:41.789 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-24T15:08:41.790 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-24T15:08:41.980 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-24T15:08:41.992 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-24T15:08:42.172 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-24T15:08:42.184 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-24T15:08:42.373 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-24T15:08:42.373 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-24T15:08:42.552 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-24T15:08:42.563 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-24T15:08:42.742 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-24T15:08:42.755 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-24T15:08:42.757 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:42.933 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-24T15:08:42.944 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-24T15:08:42.946 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:43.123 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-24T15:08:43.145 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-24T15:08:43.313 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-24T15:08:43.335 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-24T15:08:43.513 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-24T15:08:43.525 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-24T15:08:43.706 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-24T15:08:43.718 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-24T15:08:43.898 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-24T15:08:43.910 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-24T15:08:44.100 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-24T15:08:44.101 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-24T15:08:44.291 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-24T15:08:44.292 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-24T15:08:44.484 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-24T15:08:44.485 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-24T15:08:44.676 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-24T15:08:44.677 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-24T15:08:44.868 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-24T15:08:44.879 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-24T15:08:45.066 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-24T15:08:45.067 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-24T15:08:45.268 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-24T15:08:45.270 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-24T15:08:45.271 INFO:teuthology.task.ansible.out: 2021-02-24T15:08:45.460 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-24T15:08:45.473 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-24T15:08:45.660 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-24T15:08:45.671 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-24T15:08:45.849 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-24T15:08:45.860 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-24T15:08:46.050 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-24T15:08:46.052 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-24T15:08:46.243 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-24T15:08:46.255 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-24T15:08:46.444 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-24T15:08:46.445 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-24T15:08:46.635 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-24T15:08:46.637 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-24T15:08:46.830 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-24T15:08:46.843 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-24T15:08:47.032 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-24T15:08:47.035 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-24T15:08:47.222 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-24T15:08:47.233 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-24T15:08:47.422 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-24T15:08:47.423 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-24T15:08:47.612 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-24T15:08:47.614 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-24T15:08:47.802 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-24T15:08:47.814 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-24T15:08:48.003 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-24T15:08:48.004 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-24T15:08:48.192 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-24T15:08:48.193 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-24T15:08:48.391 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-24T15:08:48.392 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-24T15:08:48.582 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-24T15:08:48.583 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-24T15:08:48.772 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-24T15:08:48.784 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-24T15:08:48.966 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-24T15:08:48.966 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-24T15:08:49.157 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-24T15:08:49.169 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-24T15:08:49.351 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-24T15:08:49.363 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-24T15:08:49.551 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-24T15:08:49.552 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-24T15:08:49.741 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-24T15:08:49.743 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-24T15:08:49.930 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-24T15:08:49.941 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-24T15:08:50.128 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-24T15:08:50.129 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-24T15:08:50.316 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-24T15:08:50.317 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-24T15:08:50.515 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-24T15:08:50.516 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-24T15:08:50.705 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-24T15:08:50.707 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-24T15:08:50.895 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-24T15:08:50.898 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-24T15:08:51.089 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-24T15:08:51.090 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-24T15:08:51.290 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-24T15:08:51.291 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-24T15:08:51.491 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-24T15:08:51.503 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-24T15:08:51.683 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-24T15:08:51.706 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-24T15:08:51.885 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-24T15:08:51.896 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-24T15:08:52.075 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-24T15:08:52.087 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-24T15:08:52.268 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-24T15:08:52.281 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-24T15:08:52.473 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-24T15:08:52.485 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-24T15:08:52.664 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-24T15:08:52.676 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-24T15:08:52.855 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-24T15:08:52.879 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-24T15:08:53.047 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-24T15:08:53.069 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-24T15:08:54.501 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-24T15:08:54.523 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-24T15:08:55.796 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-24T15:08:55.817 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-24T15:08:57.042 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-24T15:08:57.117 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-24T15:08:58.288 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-02-24T15:08:58.420 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:58 +0000 (0:00:31.469) 0:00:38.366 **** 2021-02-24T15:08:58.447 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-24T15:08:58.485 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:58 +0000 (0:00:00.063) 0:00:38.430 **** 2021-02-24T15:08:58.490 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-24T15:08:58.492 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-02-24T15:08:58.563 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-24T15:08:58.565 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-02-24T15:08:58.566 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-02-24T15:08:58.568 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2021-02-24T15:08:58.570 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1Wi 2021-02-24T15:08:58.571 INFO:teuthology.task.ansible.out:RenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vum 2021-02-24T15:08:58.573 INFO:teuthology.task.ansible.out:rao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/ 2021-02-24T15:08:58.573 INFO:teuthology.task.ansible.out:KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69 2021-02-24T15:08:58.575 INFO:teuthology.task.ansible.out:mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d8 2021-02-24T15:08:58.577 INFO:teuthology.task.ansible.out:41a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveirada 2021-02-24T15:08:58.578 INFO:teuthology.task.ansible.out:n@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOe 2021-02-24T15:08:58.580 INFO:teuthology.task.ansible.out:nVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9 2021-02-24T15:08:58.582 INFO:teuthology.task.ansible.out:gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e 2021-02-24T15:08:58.583 INFO:teuthology.task.ansible.out:3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": 2021-02-24T15:08:58.584 INFO:teuthology.task.ansible.out:"dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NI 2021-02-24T15:08:58.586 INFO:teuthology.task.ansible.out:Nj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-24T15:08:58.618 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:58 +0000 (0:00:00.134) 0:00:38.564 **** 2021-02-24T15:08:58.654 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:58 +0000 (0:00:00.035) 0:00:38.600 **** 2021-02-24T15:08:58.660 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-24T15:08:58.698 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:58 +0000 (0:00:00.044) 0:00:38.644 **** 2021-02-24T15:08:58.748 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-24T15:08:58.750 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-02-24T15:08:58.752 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-02-24T15:08:58.753 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2021-02-24T15:08:58.755 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1Wi 2021-02-24T15:08:58.756 INFO:teuthology.task.ansible.out:RenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vum 2021-02-24T15:08:58.758 INFO:teuthology.task.ansible.out:rao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69 2021-02-24T15:08:58.760 INFO:teuthology.task.ansible.out:mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 2021-02-24T15:08:58.761 INFO:teuthology.task.ansible.out:5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dc 2021-02-24T15:08:58.763 INFO:teuthology.task.ansible.out:f7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost 2021-02-24T15:08:58.764 INFO:teuthology.task.ansible.out: dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344 2021-02-24T15:08:58.766 INFO:teuthology.task.ansible.out:c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": 2021-02-24T15:08:58.766 INFO:teuthology.task.ansible.out:"mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb 2021-02-24T15:08:58.768 INFO:teuthology.task.ansible.out:8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xu 2021-02-24T15:08:58.771 INFO:teuthology.task.ansible.out:xuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f 2021-02-24T15:08:58.772 INFO:teuthology.task.ansible.out:05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-24T15:08:58.808 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:58 +0000 (0:00:00.110) 0:00:38.754 **** 2021-02-24T15:08:59.467 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-02-24T15:08:59.469 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-24T15:08:59.505 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:59 +0000 (0:00:00.696) 0:00:39.451 **** 2021-02-24T15:08:59.514 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-24T15:08:59.556 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:08:59 +0000 (0:00:00.050) 0:00:39.502 **** 2021-02-24T15:08:59.795 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-24T15:08:59.796 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-24T15:08:59.848 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-24T15:09:00.008 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-24T15:09:00.052 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-24T15:09:00.231 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-24T15:09:00.274 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-24T15:09:00.452 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-02-24T15:09:00.454 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-24T15:09:00.494 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-02-24T15:09:00.496 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-24T15:09:00.661 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-24T15:09:00.703 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-24T15:09:00.872 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-02-24T15:09:00.874 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-24T15:09:00.915 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-02-24T15:09:00.916 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-24T15:09:01.072 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-24T15:09:01.114 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-24T15:09:01.283 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-24T15:09:01.325 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-24T15:09:01.505 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-24T15:09:01.507 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:01.538 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-24T15:09:01.549 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:01.729 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-02-24T15:09:01.731 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-24T15:09:01.761 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-02-24T15:09:01.763 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-24T15:09:01.942 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-02-24T15:09:01.944 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:01.954 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:01.965 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-02-24T15:09:01.967 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-02-24T15:09:01.976 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:01.987 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:02.164 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-24T15:09:02.196 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-24T15:09:02.374 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-02-24T15:09:02.376 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-24T15:09:02.427 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-02-24T15:09:02.429 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-24T15:09:02.584 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-24T15:09:02.637 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-24T15:09:02.796 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-24T15:09:02.841 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-24T15:09:03.014 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-24T15:09:03.056 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-24T15:09:03.222 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-24T15:09:03.265 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-24T15:09:03.432 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-24T15:09:03.475 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-24T15:09:03.653 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-02-24T15:09:03.655 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-24T15:09:03.691 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-02-24T15:09:03.692 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-24T15:09:03.870 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-02-24T15:09:03.871 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-24T15:09:03.912 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-02-24T15:09:03.913 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-24T15:09:04.079 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-24T15:09:04.121 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-24T15:09:04.288 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-24T15:09:04.330 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-24T15:09:04.497 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-02-24T15:09:04.499 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-24T15:09:04.551 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-02-24T15:09:04.553 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-24T15:09:04.708 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-24T15:09:04.762 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-24T15:09:04.918 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-24T15:09:04.970 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-24T15:09:05.126 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-24T15:09:05.189 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-24T15:09:05.345 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-24T15:09:05.398 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-24T15:09:05.547 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-24T15:09:05.610 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-24T15:09:05.767 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-02-24T15:09:05.770 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-24T15:09:05.820 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-02-24T15:09:05.822 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-24T15:09:05.978 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-24T15:09:06.034 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-24T15:09:06.190 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-24T15:09:06.233 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-24T15:09:06.401 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-24T15:09:06.444 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-24T15:09:06.621 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-24T15:09:06.654 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-24T15:09:06.842 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-24T15:09:06.863 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-24T15:09:07.050 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-24T15:09:07.072 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-24T15:09:07.258 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-24T15:09:07.290 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-24T15:09:07.478 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-24T15:09:07.489 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-24T15:09:07.687 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-24T15:09:07.709 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-24T15:09:07.895 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-02-24T15:09:07.898 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-24T15:09:07.918 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-02-24T15:09:07.921 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-24T15:09:08.116 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-02-24T15:09:08.118 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-24T15:09:08.128 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-02-24T15:09:08.130 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-24T15:09:08.336 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-24T15:09:08.338 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-24T15:09:08.545 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-24T15:09:08.546 INFO:teuthology.task.ansible.out: 2021-02-24T15:09:08.547 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-24T15:09:08.756 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-24T15:09:08.758 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-24T15:09:08.975 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-02-24T15:09:08.977 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySW 2021-02-24T15:09:08.979 INFO:teuthology.task.ansible.out:i/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-24T15:09:09.184 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-02-24T15:09:09.186 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-02-24T15:09:09.187 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMS 2021-02-24T15:09:09.189 INFO:teuthology.task.ansible.out:woj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf 2021-02-24T15:09:09.191 INFO:teuthology.task.ansible.out:53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-24T15:09:09.393 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-24T15:09:09.405 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-24T15:09:09.604 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-24T15:09:09.615 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-24T15:09:09.823 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-24T15:09:09.825 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-24T15:09:10.034 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-24T15:09:10.035 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-24T15:09:10.241 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-24T15:09:10.248 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-24T15:09:10.459 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-02-24T15:09:10.461 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0b 2021-02-24T15:09:10.463 INFO:teuthology.task.ansible.out:sfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-24T15:09:10.669 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-24T15:09:10.671 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-24T15:09:10.881 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "presen 2021-02-24T15:09:10.882 INFO:teuthology.task.ansible.out:t", "user": "myoungwon", "validate_certs": true} 2021-02-24T15:09:11.100 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-02-24T15:09:11.102 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": 2021-02-24T15:09:11.103 INFO:teuthology.task.ansible.out: null, "state": "present", "user": "gabrioux", "validate_certs": true} 2021-02-24T15:09:11.311 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-24T15:09:11.323 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-24T15:09:11.528 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-24T15:09:11.530 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-24T15:09:11.749 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-02-24T15:09:11.752 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylM 2021-02-24T15:09:11.753 INFO:teuthology.task.ansible.out:R5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerH 2021-02-24T15:09:11.755 INFO:teuthology.task.ansible.out:COTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-24T15:09:11.960 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-24T15:09:11.961 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-24T15:09:12.168 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-24T15:09:12.169 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-24T15:09:12.377 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-24T15:09:12.388 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-24T15:09:12.587 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-24T15:09:12.599 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-24T15:09:12.796 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-24T15:09:12.808 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-24T15:09:13.007 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-24T15:09:13.018 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-24T15:09:13.226 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-24T15:09:13.237 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-24T15:09:13.435 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-24T15:09:13.446 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-24T15:09:13.645 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-24T15:09:13.657 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-24T15:09:13.855 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-24T15:09:13.867 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-24T15:09:14.067 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-24T15:09:14.079 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-24T15:09:14.278 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-24T15:09:14.290 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-24T15:09:14.489 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-24T15:09:14.501 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-24T15:09:14.711 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-24T15:09:14.713 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-24T15:09:14.920 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-24T15:09:14.922 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-24T15:09:14.924 INFO:teuthology.task.ansible.out: 2021-02-24T15:09:15.134 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-24T15:09:15.136 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-24T15:09:15.345 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-24T15:09:15.347 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-24T15:09:15.560 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-24T15:09:15.571 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-24T15:09:15.780 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-24T15:09:15.781 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-24T15:09:15.982 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-24T15:09:15.984 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-24T15:09:16.192 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-02-24T15:09:16.194 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-24T15:09:16.204 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-02-24T15:09:16.206 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-24T15:09:16.403 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-24T15:09:16.425 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-24T15:09:16.614 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-24T15:09:16.637 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-24T15:09:16.816 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-24T15:09:16.848 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-24T15:09:17.028 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-24T15:09:17.063 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-24T15:09:17.243 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-02-24T15:09:17.245 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-24T15:09:17.276 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-02-24T15:09:17.279 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-24T15:09:17.473 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-02-24T15:09:17.475 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-24T15:09:17.494 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-02-24T15:09:17.496 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-24T15:09:17.685 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-24T15:09:17.718 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-24T15:09:17.890 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-24T15:09:17.947 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-24T15:09:18.116 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-24T15:09:18.159 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-24T15:09:18.327 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-24T15:09:18.370 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-24T15:09:18.537 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-24T15:09:18.601 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-24T15:09:18.771 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-24T15:09:18.805 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-24T15:09:18.992 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-24T15:09:19.025 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-24T15:09:19.213 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-02-24T15:09:19.215 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-24T15:09:19.235 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-02-24T15:09:19.237 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-24T15:09:19.413 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-24T15:09:19.445 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-24T15:09:19.632 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-24T15:09:19.654 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-24T15:09:19.845 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-24T15:09:19.866 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-24T15:09:20.074 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-24T15:09:20.085 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-24T15:09:20.284 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-24T15:09:20.296 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-24T15:09:20.495 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-24T15:09:20.506 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-24T15:09:20.704 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-02-24T15:09:20.706 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+k 2021-02-24T15:09:20.708 INFO:teuthology.task.ansible.out:nEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-24T15:09:20.908 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-24T15:09:20.919 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-24T15:09:21.120 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-24T15:09:21.143 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-24T15:09:21.345 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-24T15:09:21.356 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-24T15:09:21.567 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-24T15:09:21.568 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-24T15:09:21.780 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-24T15:09:21.782 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-24T15:09:21.992 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-24T15:09:21.994 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-24T15:09:22.203 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-24T15:09:22.205 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-24T15:09:22.417 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-24T15:09:22.429 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-24T15:09:22.630 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-24T15:09:22.641 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-24T15:09:22.829 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-24T15:09:22.840 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-24T15:09:23.038 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-24T15:09:23.059 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-24T15:09:23.257 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-24T15:09:23.269 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-24T15:09:23.467 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-24T15:09:23.478 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-24T15:09:23.678 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-24T15:09:23.690 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-24T15:09:23.893 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-24T15:09:23.916 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-24T15:09:24.107 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-24T15:09:24.129 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-24T15:09:24.316 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-24T15:09:24.337 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-24T15:09:24.527 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-24T15:09:24.549 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-24T15:09:24.737 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-02-24T15:09:24.739 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-24T15:09:24.759 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-02-24T15:09:24.760 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-24T15:09:24.959 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-24T15:09:24.970 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-24T15:09:25.168 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-24T15:09:25.180 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-24T15:09:25.369 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-24T15:09:25.390 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-24T15:09:25.590 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-24T15:09:25.601 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-24T15:09:25.800 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-24T15:09:25.811 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-24T15:09:26.011 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-24T15:09:26.022 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-24T15:09:26.220 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-24T15:09:26.234 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-24T15:09:26.436 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-24T15:09:26.447 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-24T15:09:26.646 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-24T15:09:26.657 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-24T15:09:26.855 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-24T15:09:26.887 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-24T15:09:27.075 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-24T15:09:27.097 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-24T15:09:27.286 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-24T15:09:27.308 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-24T15:09:27.499 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-24T15:09:27.521 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-24T15:09:27.732 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-24T15:09:27.743 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-24T15:09:27.944 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-24T15:09:27.956 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-24T15:09:28.157 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-24T15:09:28.179 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-24T15:09:28.393 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-24T15:09:28.405 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-24T15:09:28.605 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-24T15:09:28.676 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-24T15:09:28.762 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:28 +0000 (0:00:29.206) 0:01:08.708 **** 2021-02-24T15:09:28.802 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:28 +0000 (0:00:00.039) 0:01:08.748 **** 2021-02-24T15:09:28.826 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-24T15:09:28.828 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.848 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.850 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.860 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.861 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.872 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.874 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.884 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.886 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-02-24T15:09:28.888 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.898 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.909 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.911 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.922 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:28.933 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.125 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-24T15:09:29.137 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.150 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.162 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-24T15:09:29.164 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.174 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.365 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-24T15:09:29.387 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-24T15:09:29.579 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-24T15:09:29.592 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-24T15:09:29.593 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.609 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.620 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.622 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.632 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.634 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.654 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.656 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.666 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.668 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.680 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.681 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a 2021-02-24T15:09:29.683 INFO:teuthology.task.ansible.out:92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.693 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.695 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.705 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.707 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.708 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": fals 2021-02-24T15:09:29.710 INFO:teuthology.task.ansible.out:e, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.721 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.722 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.734 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.736 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.747 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.750 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.761 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.766 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.772 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.785 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.787 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.800 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.800 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.802 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.804 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.814 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.816 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.826 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.827 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.829 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.831 INFO:teuthology.task.ansible.out: skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.842 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.844 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.854 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.855 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.865 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.867 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.868 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.879 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.880 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.890 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.892 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.902 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.904 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.914 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.915 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.925 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.927 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.938 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.940 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.942 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.953 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.955 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.964 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.966 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.975 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.978 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.988 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.989 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:29.992 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov2 2021-02-24T15:09:29.993 INFO:teuthology.task.ansible.out:01XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.004 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.005 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.007 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.018 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.019 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.030 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.032 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.042 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.043 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.045 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.056 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.056 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.057 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.057 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.068 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.070 INFO:teuthology.task.ansible.out: skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.081 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.083 INFO:teuthology.task.ansible.out: 2021-02-24T15:09:30.086 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.088 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.098 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.100 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.110 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.112 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.122 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.124 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.134 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.136 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.146 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.148 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.159 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.161 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.171 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.173 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.174 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.185 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.186 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.187 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.189 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.200 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.202 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.215 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.218 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.229 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.231 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.242 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.243 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.243 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.244 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.255 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.257 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.258 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.269 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.270 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.281 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.283 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.294 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.296 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.305 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.307 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.320 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.322 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.333 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.336 INFO:teuthology.task.ansible.out: skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.347 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.349 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.360 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.362 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.373 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.375 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.386 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.388 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.398 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.400 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.409 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.411 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.423 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.425 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.435 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.436 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.447 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.449 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.459 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.459 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.461 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.471 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.474 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.483 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.485 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.495 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.496 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.506 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.508 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.518 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.520 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.530 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.532 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.542 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.545 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.553 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.555 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.566 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.577 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.579 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.579 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.580 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.581 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.603 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.605 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.638 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:30 +0000 (0:00:01.835) 0:01:10.584 **** 2021-02-24T15:09:30.645 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.696 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:30 +0000 (0:00:00.058) 0:01:10.642 **** 2021-02-24T15:09:30.701 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-02-24T15:09:30.703 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.737 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:30 +0000 (0:00:00.041) 0:01:10.683 **** 2021-02-24T15:09:30.746 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:30.780 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:30 +0000 (0:00:00.043) 0:01:10.726 **** 2021-02-24T15:09:30.967 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-24T15:09:30.969 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-24T15:09:31.031 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-24T15:09:31.169 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-24T15:09:31.211 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-24T15:09:31.348 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-24T15:09:31.401 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-24T15:09:31.538 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-24T15:09:31.591 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-24T15:09:31.734 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-24T15:09:31.776 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-24T15:09:31.913 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-24T15:09:31.956 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-24T15:09:32.103 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-24T15:09:32.149 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-24T15:09:32.297 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-24T15:09:32.339 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-24T15:09:32.476 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-24T15:09:32.530 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-24T15:09:32.667 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-24T15:09:32.726 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-24T15:09:32.867 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-24T15:09:32.900 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-24T15:09:33.057 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-24T15:09:33.101 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-24T15:09:33.274 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-24T15:09:33.286 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-24T15:09:33.466 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-24T15:09:33.478 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-24T15:09:33.662 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-24T15:09:33.674 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-24T15:09:33.857 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-24T15:09:33.858 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-24T15:09:34.047 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-24T15:09:34.049 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-24T15:09:34.227 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-24T15:09:34.239 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-24T15:09:34.418 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-24T15:09:34.419 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-24T15:09:34.608 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-24T15:09:34.610 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-24T15:09:34.797 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-24T15:09:34.799 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-24T15:09:34.984 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-24T15:09:34.986 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-24T15:09:35.163 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-24T15:09:35.165 INFO:teuthology.task.ansible.out: 2021-02-24T15:09:35.177 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-24T15:09:35.356 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-24T15:09:35.358 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-24T15:09:35.546 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-24T15:09:35.552 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-24T15:09:35.738 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-24T15:09:35.739 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-24T15:09:35.930 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-24T15:09:35.932 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-24T15:09:36.113 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-24T15:09:36.126 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-24T15:09:36.306 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-24T15:09:36.308 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-24T15:09:36.485 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-24T15:09:36.496 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-24T15:09:36.685 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-24T15:09:36.686 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-24T15:09:36.876 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-24T15:09:36.879 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-24T15:09:37.068 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-24T15:09:37.070 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-24T15:09:37.264 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-24T15:09:37.265 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-24T15:09:37.445 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-24T15:09:37.456 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-24T15:09:37.634 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-24T15:09:37.646 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-24T15:09:37.819 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-24T15:09:37.840 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-24T15:09:39.023 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "dorinda", "name": "dorinda", "remove": false, "state": "absent"} 2021-02-24T15:09:39.118 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "dorinda", "name": "dorinda", "remove": false, "state": "absent"} 2021-02-24T15:09:40.289 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-24T15:09:40.371 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-24T15:09:40.492 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-24T15:09:40.579 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-24T15:09:40.697 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-24T15:09:40.771 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-24T15:09:40.888 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-24T15:09:40.953 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-24T15:09:41.092 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-24T15:09:41.157 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-24T15:09:41.274 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-24T15:09:41.348 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-24T15:09:41.467 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-24T15:09:41.541 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-24T15:09:41.659 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-24T15:09:41.732 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-24T15:09:41.984 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} ok: [smithi152.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-24T15:09:42.093 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-24T15:09:42.130 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-24T15:09:42.295 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-24T15:09:42.324 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-24T15:09:42.384 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:42 +0000 (0:00:11.603) 0:01:22.330 **** 2021-02-24T15:09:42.420 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:42 +0000 (0:00:00.036) 0:01:22.366 **** 2021-02-24T15:09:42.914 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-24T15:09:42.916 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179382.416113-166770059023395/source", "state": "file", "uid": 0} 2021-02-24T15:09:42.953 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:42 +0000 (0:00:00.532) 0:01:22.899 **** 2021-02-24T15:09:42.971 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179382.448621-203447374271145/source", "state": "file", "uid": 0} 2021-02-24T15:09:43.008 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.054) 0:01:22.954 **** 2021-02-24T15:09:43.014 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-24T15:09:43.016 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => { "msg": "Host smithi152.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-02-24T15:09:43.063 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.055) 0:01:23.009 **** 2021-02-24T15:09:43.070 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => { "msg": "Host smithi181.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-02-24T15:09:43.106 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.043) 0:01:23.052 **** 2021-02-24T15:09:43.115 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-24T15:09:43.116 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-02-24T15:09:43.150 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.044) 0:01:23.096 **** 2021-02-24T15:09:43.157 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-02-24T15:09:43.195 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.044) 0:01:23.141 **** 2021-02-24T15:09:43.202 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-24T15:09:43.204 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:43.238 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.043) 0:01:23.184 **** 2021-02-24T15:09:43.246 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:43.282 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.043) 0:01:23.228 **** 2021-02-24T15:09:43.765 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-24T15:09:43.766 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.327077", "end": "2021-02-24 15:09:43.741574", "rc": 0, "start": "2021-02-24 15:09:43.414497", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-24T15:09:43.817 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.534) 0:01:23.763 **** 2021-02-24T15:09:43.829 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.334114", "end": "2021-02-24 15:09:43.788142", "rc": 0, "start": "2021-02-24 15:09:43.454028", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-24T15:09:43.884 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.066) 0:01:23.830 **** 2021-02-24T15:09:43.890 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-24T15:09:43.892 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:43.943 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.059) 0:01:23.889 **** 2021-02-24T15:09:43.952 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:43.995 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:43 +0000 (0:00:00.051) 0:01:23.941 **** 2021-02-24T15:09:44.002 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-24T15:09:44.004 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.043 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.048) 0:01:23.989 **** 2021-02-24T15:09:44.049 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.107 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.064) 0:01:24.053 **** 2021-02-24T15:09:44.117 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-24T15:09:44.120 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.154 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.046) 0:01:24.100 **** 2021-02-24T15:09:44.166 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.211 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.056) 0:01:24.157 **** 2021-02-24T15:09:44.222 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-24T15:09:44.225 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.263 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.052) 0:01:24.209 **** 2021-02-24T15:09:44.270 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.308 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.044) 0:01:24.254 **** 2021-02-24T15:09:44.315 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-24T15:09:44.316 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.355 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.046) 0:01:24.301 **** 2021-02-24T15:09:44.362 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.399 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.044) 0:01:24.345 **** 2021-02-24T15:09:44.406 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-02-24T15:09:44.408 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.442 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.042) 0:01:24.388 **** 2021-02-24T15:09:44.448 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.489 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.046) 0:01:24.435 **** 2021-02-24T15:09:44.496 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-24T15:09:44.497 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:44.534 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.044) 0:01:24.480 **** 2021-02-24T15:09:44.535 INFO:teuthology.task.ansible.out: 2021-02-24T15:09:44.545 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:44.547 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:44.581 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.046) 0:01:24.527 **** 2021-02-24T15:09:44.587 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-24T15:09:44.589 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.624 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.043) 0:01:24.570 **** 2021-02-24T15:09:44.631 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.666 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.042) 0:01:24.612 **** 2021-02-24T15:09:44.672 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-24T15:09:44.674 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.715 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.048) 0:01:24.661 **** 2021-02-24T15:09:44.722 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.762 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.047) 0:01:24.708 **** 2021-02-24T15:09:44.769 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-24T15:09:44.771 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:44.805 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.043) 0:01:24.751 **** 2021-02-24T15:09:44.812 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:44.849 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.043) 0:01:24.795 **** 2021-02-24T15:09:44.855 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-24T15:09:44.858 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.892 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.042) 0:01:24.838 **** 2021-02-24T15:09:44.898 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:44.933 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.041) 0:01:24.879 **** 2021-02-24T15:09:44.939 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-24T15:09:44.941 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:44.981 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:44 +0000 (0:00:00.047) 0:01:24.927 **** 2021-02-24T15:09:44.988 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:45.029 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.047) 0:01:24.975 **** 2021-02-24T15:09:45.036 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-24T15:09:45.038 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.072 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.042) 0:01:25.017 **** 2021-02-24T15:09:45.080 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.116 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.044) 0:01:25.062 **** 2021-02-24T15:09:45.122 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-24T15:09:45.124 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.161 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.044) 0:01:25.107 **** 2021-02-24T15:09:45.169 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.208 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.047) 0:01:25.154 **** 2021-02-24T15:09:45.216 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-24T15:09:45.217 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.253 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.045) 0:01:25.199 **** 2021-02-24T15:09:45.261 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.297 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.044) 0:01:25.243 **** 2021-02-24T15:09:45.306 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-24T15:09:45.308 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.345 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.047) 0:01:25.291 **** 2021-02-24T15:09:45.352 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.388 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.043) 0:01:25.334 **** 2021-02-24T15:09:45.398 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:45.442 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.053) 0:01:25.388 **** 2021-02-24T15:09:45.452 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:45.489 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.046) 0:01:25.435 **** 2021-02-24T15:09:45.496 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-24T15:09:45.497 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.536 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.046) 0:01:25.482 **** 2021-02-24T15:09:45.542 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.579 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.043) 0:01:25.525 **** 2021-02-24T15:09:45.586 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-24T15:09:45.588 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.625 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.045) 0:01:25.571 **** 2021-02-24T15:09:45.631 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.666 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.040) 0:01:25.612 **** 2021-02-24T15:09:45.671 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-24T15:09:45.673 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.707 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.041) 0:01:25.653 **** 2021-02-24T15:09:45.714 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.756 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.048) 0:01:25.702 **** 2021-02-24T15:09:45.761 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-24T15:09:45.763 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.797 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.041) 0:01:25.743 **** 2021-02-24T15:09:45.803 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.838 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.041) 0:01:25.784 **** 2021-02-24T15:09:45.844 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-24T15:09:45.845 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.880 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.041) 0:01:25.826 **** 2021-02-24T15:09:45.885 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.925 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.045) 0:01:25.871 **** 2021-02-24T15:09:45.933 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-24T15:09:45.935 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:45.970 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:45 +0000 (0:00:00.044) 0:01:25.916 **** 2021-02-24T15:09:45.976 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:46.012 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:46 +0000 (0:00:00.042) 0:01:25.958 **** 2021-02-24T15:09:46.018 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-24T15:09:46.020 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:46.054 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:46 +0000 (0:00:00.041) 0:01:26.000 **** 2021-02-24T15:09:46.060 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-24T15:09:46.094 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:46 +0000 (0:00:00.040) 0:01:26.040 **** 2021-02-24T15:09:46.100 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-24T15:09:46.102 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:46.140 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:46 +0000 (0:00:00.045) 0:01:26.086 **** 2021-02-24T15:09:46.148 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:46.187 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:46 +0000 (0:00:00.046) 0:01:26.133 **** 2021-02-24T15:09:46.193 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-02-24T15:09:46.194 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:46.228 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:46 +0000 (0:00:00.041) 0:01:26.174 **** 2021-02-24T15:09:46.234 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:46.275 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:46 +0000 (0:00:00.046) 0:01:26.221 **** 2021-02-24T15:09:46.450 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-02-24T15:09:46.452 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:09:46.487 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:46 +0000 (0:00:00.212) 0:01:26.433 **** 2021-02-24T15:09:46.505 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:09:46.542 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:46 +0000 (0:00:00.055) 0:01:26.488 **** 2021-02-24T15:09:47.268 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-24T15:09:47.269 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-02-24T15:09:47.271 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-02-24T15:09:47.712 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-02-24T15:09:47.715 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-02-24T15:09:47.752 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:47 +0000 (0:00:01.209) 0:01:27.697 **** 2021-02-24T15:09:47.786 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:47 +0000 (0:00:00.034) 0:01:27.732 **** 2021-02-24T15:09:48.222 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-24T15:09:48.224 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-02-24T15:09:48.256 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-02-24T15:09:48.654 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-02-24T15:09:48.692 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:48 +0000 (0:00:00.905) 0:01:28.638 **** 2021-02-24T15:09:48.709 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-02-24T15:09:48.761 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:48 +0000 (0:00:00.069) 0:01:28.707 **** 2021-02-24T15:09:48.769 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-24T15:09:48.771 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:48.809 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:48 +0000 (0:00:00.047) 0:01:28.755 **** 2021-02-24T15:09:48.816 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:48.853 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:48 +0000 (0:00:00.044) 0:01:28.799 **** 2021-02-24T15:09:48.860 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:48.894 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:48 +0000 (0:00:00.040) 0:01:28.840 **** 2021-02-24T15:09:48.900 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:48.937 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:48 +0000 (0:00:00.043) 0:01:28.883 **** 2021-02-24T15:09:48.944 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-02-24T15:09:48.945 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:48.982 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:48 +0000 (0:00:00.044) 0:01:28.928 **** 2021-02-24T15:09:48.988 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.022 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.040) 0:01:28.968 **** 2021-02-24T15:09:49.028 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-02-24T15:09:49.030 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.065 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.042) 0:01:29.011 **** 2021-02-24T15:09:49.071 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.107 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.042) 0:01:29.053 **** 2021-02-24T15:09:49.113 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-24T15:09:49.115 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.158 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.050) 0:01:29.104 **** 2021-02-24T15:09:49.168 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.170 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.171 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.208 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.049) 0:01:29.153 **** 2021-02-24T15:09:49.214 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.248 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.041) 0:01:29.194 **** 2021-02-24T15:09:49.257 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.292 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.044) 0:01:29.238 **** 2021-02-24T15:09:49.298 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-24T15:09:49.300 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.334 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.041) 0:01:29.280 **** 2021-02-24T15:09:49.341 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.375 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.041) 0:01:29.321 **** 2021-02-24T15:09:49.383 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-24T15:09:49.385 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.424 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.048) 0:01:29.370 **** 2021-02-24T15:09:49.430 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.467 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.042) 0:01:29.413 **** 2021-02-24T15:09:49.475 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-24T15:09:49.477 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.510 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.043) 0:01:29.456 **** 2021-02-24T15:09:49.517 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.552 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.041) 0:01:29.498 **** 2021-02-24T15:09:49.558 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-24T15:09:49.560 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.594 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.042) 0:01:29.540 **** 2021-02-24T15:09:49.601 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:49.645 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:49 +0000 (0:00:00.050) 0:01:29.591 **** 2021-02-24T15:09:50.520 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-24T15:09:50.522 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.737030", "end": "2021-02-24 15:09:50.500341", "rc": 0, "start": "2021-02-24 15:09:49.763311", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.680199", "end": "2021-02-24 15:09:50.500328", "rc": 0, "start": "2021-02-24 15:09:49.820129", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:09:50.573 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:50 +0000 (0:00:00.928) 0:01:30.519 **** 2021-02-24T15:09:50.607 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:50 +0000 (0:00:00.033) 0:01:30.553 **** 2021-02-24T15:09:57.690 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: krb5-workstation", "Installed: libkadm5-1.18.2-5.el8.x86_64", "Installed: krb5-workstation-1.18.2-5.el8.x86_64", "Installed: krb5-libs-1.18.2-5.el8.x86_64", "Removed: krb5-workstation-1.17-18.el8.x86_64", "Removed: libkadm5-1.17-18.el8.x86_64", "Removed: krb5-libs-1.17-18.el8.x86_64"]} 2021-02-24T15:09:57.724 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:57 +0000 (0:00:07.117) 0:01:37.670 **** 2021-02-24T15:09:57.751 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:57.784 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:57 +0000 (0:00:00.059) 0:01:37.730 **** 2021-02-24T15:09:57.810 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-24T15:09:57.811 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:57.850 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:57 +0000 (0:00:00.065) 0:01:37.796 **** 2021-02-24T15:09:57.876 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-24T15:09:57.878 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:57.912 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:57 +0000 (0:00:00.061) 0:01:37.858 **** 2021-02-24T15:09:57.940 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:57.976 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:57 +0000 (0:00:00.064) 0:01:37.922 **** 2021-02-24T15:09:58.159 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-24T15:09:58.161 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: krb5-workstation", "Installed: libkadm5-1.18.2-5.el8.x86_64", "Installed: krb5-workstation-1.18.2-5.el8.x86_64", "Installed: krb5-libs-1.18.2-5.el8.x86_64", "Removed: krb5-workstation-1.17-18.el8.x86_64", "Removed: libkadm5-1.17-18.el8.x86_64", "Removed: krb5-libs-1.17-18.el8.x86_64"]} 2021-02-24T15:09:58.195 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:58 +0000 (0:00:00.218) 0:01:38.141 **** 2021-02-24T15:09:58.222 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-02-24T15:09:58.224 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:58.256 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:58 +0000 (0:00:00.061) 0:01:38.202 **** 2021-02-24T15:09:58.285 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-24T15:09:58.287 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:58.321 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:58 +0000 (0:00:00.064) 0:01:38.267 **** 2021-02-24T15:09:58.348 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-24T15:09:58.349 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:58.384 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:58 +0000 (0:00:00.063) 0:01:38.330 **** 2021-02-24T15:09:58.411 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-24T15:09:58.413 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:09:58.447 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:58 +0000 (0:00:00.063) 0:01:38.393 **** 2021-02-24T15:09:58.454 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-02-24T15:09:58.456 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-02-24T15:09:58.493 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:58 +0000 (0:00:00.045) 0:01:38.439 **** 2021-02-24T15:09:58.925 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-02-24T15:09:58.962 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:09:58 +0000 (0:00:00.468) 0:01:38.908 **** 2021-02-24T15:10:01.552 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-02-24T15:10:01.553 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2021-02-24T15:10:01.588 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:01 +0000 (0:00:02.625) 0:01:41.533 **** 2021-02-24T15:10:02.176 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-24T15:10:02.180 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-02-24T15:10:02.188 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2021-02-24T15:10:02.228 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:02 +0000 (0:00:00.640) 0:01:42.174 **** 2021-02-24T15:10:02.632 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-24T15:10:02.634 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-02-24T15:10:02.842 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-02-24T15:10:03.060 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-02-24T15:10:03.097 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:03 +0000 (0:00:00.868) 0:01:43.043 **** 2021-02-24T15:10:03.279 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-02-24T15:10:03.290 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-24T15:10:03.292 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:10:03.325 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:03 +0000 (0:00:00.228) 0:01:43.271 **** 2021-02-24T15:10:03.701 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-24T15:10:03.703 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-02-24T15:10:03.741 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:03 +0000 (0:00:00.415) 0:01:43.687 **** 2021-02-24T15:10:03.843 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-24T15:10:03.845 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179403.3543513-188981606511560/source", "state": "file", "uid": 0} 2021-02-24T15:10:03.933 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-24T15:10:03.935 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:10:03.971 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:03 +0000 (0:00:00.230) 0:01:43.917 **** 2021-02-24T15:10:04.260 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-24T15:10:04.261 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-02-24T15:10:04.496 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179403.9991586-252182263049156/source", "state": "file", "uid": 0} 2021-02-24T15:10:04.685 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-02-24T15:10:04.726 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:04 +0000 (0:00:00.754) 0:01:44.672 **** 2021-02-24T15:10:04.753 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-24T15:10:04.755 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:10:04.790 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:04 +0000 (0:00:00.063) 0:01:44.736 **** 2021-02-24T15:10:04.819 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-24T15:10:04.821 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-02-24T15:10:04.858 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:04 +0000 (0:00:00.068) 0:01:44.804 **** 2021-02-24T15:10:04.928 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-24T15:10:04.930 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-02-24T15:10:05.054 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-24T15:10:05.055 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-02-24T15:10:05.087 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:05 +0000 (0:00:00.228) 0:01:45.033 **** 2021-02-24T15:10:05.134 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-24T15:10:05.136 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:05.146 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:05.156 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:05.167 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:05.205 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:05 +0000 (0:00:00.117) 0:01:45.151 **** 2021-02-24T15:10:05.347 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-24T15:10:05.349 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-02-24T15:10:05.384 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:05 +0000 (0:00:00.179) 0:01:45.330 **** 2021-02-24T15:10:05.423 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-24T15:10:05.424 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:10:05.466 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:05 +0000 (0:00:00.082) 0:01:45.412 **** 2021-02-24T15:10:05.504 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-24T15:10:05.506 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-02-24T15:10:05.537 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:05 +0000 (0:00:00.070) 0:01:45.483 **** 2021-02-24T15:10:05.742 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-24T15:10:05.743 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-02-24T15:10:05.776 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:05 +0000 (0:00:00.238) 0:01:45.722 **** 2021-02-24T15:10:05.813 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-24T15:10:05.815 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:05.824 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:05.835 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:05.846 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:05.881 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:05 +0000 (0:00:00.105) 0:01:45.828 **** 2021-02-24T15:10:06.211 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-24T15:10:06.213 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2021-02-24T15:10:06.247 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:06 +0000 (0:00:00.365) 0:01:46.193 **** 2021-02-24T15:10:06.275 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-24T15:10:06.276 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:10:06.311 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:06 +0000 (0:00:00.063) 0:01:46.257 **** 2021-02-24T15:10:06.764 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-24T15:10:06.766 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-02-24T15:10:06.798 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:06 +0000 (0:00:00.487) 0:01:46.745 **** 2021-02-24T15:10:06.920 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-24T15:10:06.922 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2021-02-24T15:10:06.956 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:06 +0000 (0:00:00.157) 0:01:46.902 **** 2021-02-24T15:10:06.983 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-24T15:10:06.985 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:10:07.017 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:07 +0000 (0:00:00.060) 0:01:46.963 **** 2021-02-24T15:10:07.252 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-24T15:10:07.254 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-02-24T15:10:07.291 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:07 +0000 (0:00:00.274) 0:01:47.237 **** 2021-02-24T15:10:07.333 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-24T15:10:07.335 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:07.344 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:07.394 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:07 +0000 (0:00:00.102) 0:01:47.340 **** 2021-02-24T15:10:07.478 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-24T15:10:07.480 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-02-24T15:10:07.535 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:07 +0000 (0:00:00.141) 0:01:47.481 **** 2021-02-24T15:10:07.604 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-24T15:10:07.606 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:10:07.644 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:07 +0000 (0:00:00.109) 0:01:47.590 **** 2021-02-24T15:10:07.876 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-24T15:10:07.878 INFO:teuthology.task.ansible.out:fatal: [smithi181.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-02-24T15:10:07.924 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:07 +0000 (0:00:00.279) 0:01:47.870 **** 2021-02-24T15:10:07.951 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-24T15:10:07.953 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:10:07.986 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:07 +0000 (0:00:00.061) 0:01:47.932 **** 2021-02-24T15:10:07.993 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-24T15:10:07.995 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-02-24T15:10:08.033 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:08 +0000 (0:00:00.046) 0:01:47.979 **** 2021-02-24T15:10:08.073 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-24T15:10:08.073 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:08.077 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-02-24T15:10:08.114 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:08 +0000 (0:00:00.081) 0:01:48.060 **** 2021-02-24T15:10:08.320 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-24T15:10:08.321 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:10:08.355 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:08 +0000 (0:00:00.240) 0:01:48.301 **** 2021-02-24T15:10:08.446 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-24T15:10:08.448 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-02-24T15:10:08.491 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:08 +0000 (0:00:00.136) 0:01:48.437 **** 2021-02-24T15:10:08.583 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-24T15:10:08.585 INFO:teuthology.task.ansible.out:fatal: [smithi152.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-02-24T15:10:08.620 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:08 +0000 (0:00:00.129) 0:01:48.566 **** 2021-02-24T15:10:08.649 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-24T15:10:08.650 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:10:08.687 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:08 +0000 (0:00:00.067) 0:01:48.633 **** 2021-02-24T15:10:09.154 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-24T15:10:09.156 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-02-24T15:10:09.157 INFO:teuthology.task.ansible.out: 2021-02-24T15:10:09.191 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:09 +0000 (0:00:00.503) 0:01:49.137 **** 2021-02-24T15:10:09.219 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-24T15:10:09.220 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-02-24 15:07:51 UTC", "ActiveEnterTimestampMonotonic": "13239173", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount tmp.mount basic.target local-fs.target network.target time-sync.target -.mount sysinit.target systemd-tmpfiles-setup.service nss-lookup.target system.slice systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-02-24 15:07:51 UTC", "AssertTimestampMonotonic": "13238134", "Before": "shutdown.target xdm.service plymouth-quit.service getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-02-24 15:07:51 UTC", "ConditionTimestampMonotonic": "13238134", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "Co 2021-02-24T15:10:09.222 INFO:teuthology.task.ansible.out:ntrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "945", "ExecMainStartTimestamp": "Wed 2021-02-24 15:07:51 UTC", "ExecMainStartTimestampMonotonic": "13239135", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-02-24 15:07:51 UTC", "InactiveExitTimestampMonotonic": "13239173", "InvocationID": "19386f42d47f498ebeef6fda62998de2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", " 2021-02-24T15:10:09.224 INFO:teuthology.task.ansible.out:LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "945", "MemoryAccounting": "yes", "MemoryCurrent": "1753088", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", 2021-02-24T15:10:09.225 INFO:teuthology.task.ansible.out:"Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-02-24 15:07:51 UTC", "StateChangeTimestampMonotonic": "13239173", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-02-24 15:07:51 UTC", "WatchdogTimestampMonotonic": "13239172", "WatchdogUSec": "0"}} 2021-02-24T15:10:09.255 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:09 +0000 (0:00:00.064) 0:01:49.201 **** 2021-02-24T15:10:09.449 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-24T15:10:09.451 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001756", "end": "2021-02-24 15:10:09.423359", "rc": 0, "start": "2021-02-24 15:10:09.421603", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-02-24T15:10:09.489 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:09 +0000 (0:00:00.234) 0:01:49.435 **** 2021-02-24T15:10:09.507 INFO:teuthology.task.ansible.out: 2021-02-24T15:10:09.508 INFO:teuthology.task.ansible.out:TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-24T15:10:09.510 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-02-24 15:07:57 UTC", "ActiveEnterTimestampMonotonic": "13209031", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target -.mount system.slice basic.target sysinit.target var-run.mount tmp.mount systemd-tmpfiles-setup.service time-sync.target systemd-journald.socket nss-lookup.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-02-24 15:07:57 UTC", "AssertTimestampMonotonic": "13208055", "Before": "plymouth-quit.service xdm.service shutdown.target multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-02-24 15:07:57 UTC", "ConditionTimestampMonotonic": "13208054", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "Co 2021-02-24T15:10:09.512 INFO:teuthology.task.ansible.out:ntrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "944", "ExecMainStartTimestamp": "Wed 2021-02-24 15:07:57 UTC", "ExecMainStartTimestampMonotonic": "13208995", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-02-24 15:07:57 UTC", "InactiveExitTimestampMonotonic": "13209031", "InvocationID": "41eecfccad10481bb121d6d4fe2a7c6a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", " 2021-02-24T15:10:09.513 INFO:teuthology.task.ansible.out:LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "944", "MemoryAccounting": "yes", "MemoryCurrent": "1740800", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", 2021-02-24T15:10:09.515 INFO:teuthology.task.ansible.out:"Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-02-24 15:07:57 UTC", "StateChangeTimestampMonotonic": "13209031", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-02-24 15:07:57 UTC", "WatchdogTimestampMonotonic": "13209030", "WatchdogUSec": "0"}} 2021-02-24T15:10:09.549 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:09 +0000 (0:00:00.059) 0:01:49.495 **** 2021-02-24T15:10:09.734 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-24T15:10:09.737 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001759", "end": "2021-02-24 15:10:09.715632", "rc": 0, "start": "2021-02-24 15:10:09.713873", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-02-24T15:10:09.771 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:09 +0000 (0:00:00.221) 0:01:49.717 **** 2021-02-24T15:10:12.701 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-02-24T15:10:12.703 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: libsemanage-2.9-3.el8.x86_64", "Installed: python3-libsemanage-2.9-3.el8.x86_64", "Removed: python3-libsemanage-2.9-2.el8.x86_64", "Removed: libsemanage-2.9-2.el8.x86_64"]} 2021-02-24T15:10:12.738 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:12 +0000 (0:00:02.966) 0:01:52.684 **** 2021-02-24T15:10:12.777 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: libsemanage-2.9-3.el8.x86_64", "Installed: python3-libsemanage-2.9-3.el8.x86_64", "Removed: python3-libsemanage-2.9-2.el8.x86_64", "Removed: libsemanage-2.9-2.el8.x86_64"]} 2021-02-24T15:10:12.815 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:12 +0000 (0:00:00.076) 0:01:52.761 **** 2021-02-24T15:10:51.127 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-24T15:10:51.129 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch", "Installed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.8.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.8.noarch"]} 2021-02-24T15:10:51.165 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:51 +0000 (0:00:38.350) 0:02:31.111 **** 2021-02-24T15:10:51.499 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch", "Installed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.8.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.8.noarch"]} 2021-02-24T15:10:51.534 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:51 +0000 (0:00:00.368) 0:02:31.480 **** 2021-02-24T15:10:51.864 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-24T15:10:51.866 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-02-24T15:10:51.899 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:51 +0000 (0:00:00.364) 0:02:31.845 **** 2021-02-24T15:10:51.978 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-02-24T15:10:52.015 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:10:52 +0000 (0:00:00.116) 0:02:31.961 **** 2021-02-24T15:11:08.746 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-24T15:11:08.748 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.650739", "end": "2021-02-24 15:11:08.723135", "failed_when_result": false, "rc": 0, "start": "2021-02-24 15:10:52.072396", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-02-24T15:11:08.810 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:08 +0000 (0:00:16.794) 0:02:48.756 **** 2021-02-24T15:11:08.977 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.772026", "end": "2021-02-24 15:11:08.955128", "failed_when_result": false, "rc": 0, "start": "2021-02-24 15:10:52.183102", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-02-24T15:11:09.013 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:09 +0000 (0:00:00.202) 0:02:48.959 **** 2021-02-24T15:11:09.290 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-24T15:11:09.292 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-02-24T15:11:09.325 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:09 +0000 (0:00:00.312) 0:02:49.271 **** 2021-02-24T15:11:09.477 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-02-24T15:11:09.512 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:09 +0000 (0:00:00.187) 0:02:49.458 **** 2021-02-24T15:11:09.529 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-02-24T15:11:09.530 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013342", "end": "2021-02-24 15:11:09.510440", "rc": 0, "start": "2021-02-24 15:11:09.497098", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:11:09.567 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:09 +0000 (0:00:00.055) 0:02:49.513 **** 2021-02-24T15:11:09.720 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.018758", "end": "2021-02-24 15:11:09.701070", "rc": 0, "start": "2021-02-24 15:11:09.682312", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:11:09.756 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:09 +0000 (0:00:00.188) 0:02:49.702 **** 2021-02-24T15:11:09.772 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-24T15:11:09.774 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.018785", "end": "2021-02-24 15:11:09.753212", "rc": 0, "start": "2021-02-24 15:11:09.734427", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:11:09.809 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:09 +0000 (0:00:00.053) 0:02:49.755 **** 2021-02-24T15:11:09.951 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.010978", "end": "2021-02-24 15:11:09.932169", "rc": 0, "start": "2021-02-24 15:11:09.921191", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:11:09.990 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:09 +0000 (0:00:00.181) 0:02:49.936 **** 2021-02-24T15:11:26.642 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-24T15:11:26.644 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.636205", "end": "2021-02-24 15:11:26.612766", "rc": 0, "start": "2021-02-24 15:11:09.976561", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:11:26.681 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:26 +0000 (0:00:16.690) 0:03:06.627 **** 2021-02-24T15:11:26.783 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.596527", "end": "2021-02-24 15:11:26.757076", "rc": 0, "start": "2021-02-24 15:11:10.160549", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:11:26.819 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:26 +0000 (0:00:00.137) 0:03:06.765 **** 2021-02-24T15:11:26.880 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-24T15:11:26.882 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-02-24T15:11:26.916 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:26 +0000 (0:00:00.097) 0:03:06.862 **** 2021-02-24T15:11:26.918 INFO:teuthology.task.ansible.out: 2021-02-24T15:11:26.943 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-24T15:11:26.945 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-02-24T15:11:26.977 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:26 +0000 (0:00:00.061) 0:03:06.923 **** 2021-02-24T15:11:27.015 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-24T15:11:27.017 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} TASK [testnode : Including distro specific variables.] ************************* 2021-02-24T15:11:27.049 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.072) 0:03:06.996 **** 2021-02-24T15:11:27.083 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.032) 0:03:07.028 **** 2021-02-24T15:11:27.088 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-24T15:11:27.090 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-02-24T15:11:27.125 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.042) 0:03:07.071 **** 2021-02-24T15:11:27.131 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-24T15:11:27.132 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-02-24T15:11:27.168 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.042) 0:03:07.114 **** 2021-02-24T15:11:27.174 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-24T15:11:27.176 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-24T15:11:27.211 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.043) 0:03:07.157 **** 2021-02-24T15:11:27.217 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-24T15:11:27.219 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-24T15:11:27.256 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.045) 0:03:07.202 **** 2021-02-24T15:11:27.262 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-24T15:11:27.263 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-02-24T15:11:27.300 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.043) 0:03:07.246 **** 2021-02-24T15:11:27.338 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-24T15:11:27.340 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-24T15:11:27.372 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.072) 0:03:07.318 **** 2021-02-24T15:11:27.440 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-24T15:11:27.442 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-24T15:11:27.476 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.103) 0:03:07.422 **** 2021-02-24T15:11:27.565 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-24T15:11:27.600 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.124) 0:03:07.546 **** 2021-02-24T15:11:27.659 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-24T15:11:27.661 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2021-02-24T15:11:27.698 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.098) 0:03:07.644 **** 2021-02-24T15:11:27.725 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:27.759 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.060) 0:03:07.705 **** 2021-02-24T15:11:27.785 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-24T15:11:27.787 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2021-02-24T15:11:27.820 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.061) 0:03:07.766 **** 2021-02-24T15:11:27.851 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.031) 0:03:07.797 **** 2021-02-24T15:11:27.857 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-24T15:11:27.859 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:27.893 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.041) 0:03:07.839 **** 2021-02-24T15:11:27.920 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:27.953 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:27 +0000 (0:00:00.060) 0:03:07.899 **** 2021-02-24T15:11:28.054 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-24T15:11:28.056 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-02-24T15:11:28.091 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:28 +0000 (0:00:00.137) 0:03:08.037 **** 2021-02-24T15:11:28.162 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-02-24T15:11:28.199 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:28 +0000 (0:00:00.107) 0:03:08.145 **** 2021-02-24T15:11:28.626 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-24T15:11:28.629 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-02-24T15:11:28.669 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:28 +0000 (0:00:00.470) 0:03:08.615 **** 2021-02-24T15:11:28.697 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-24T15:11:28.699 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi181"}, "changed": false} 2021-02-24T15:11:28.749 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:28 +0000 (0:00:00.080) 0:03:08.695 **** 2021-02-24T15:11:28.863 INFO:teuthology.task.ansible.out: 2021-02-24T15:11:28.865 INFO:teuthology.task.ansible.out:TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-02-24T15:11:28.898 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:28 +0000 (0:00:00.149) 0:03:08.844 **** 2021-02-24T15:11:28.928 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-24T15:11:28.929 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi152"}, "changed": false} 2021-02-24T15:11:28.979 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:28 +0000 (0:00:00.080) 0:03:08.925 **** 2021-02-24T15:11:29.755 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-02-24T15:11:29.756 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi181.front.sepia.ceph.com", "ansible_hostname": "smithi181", "ansible_nodename": "smithi181"}, "changed": true, "name": "smithi181"} 2021-02-24T15:11:29.793 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:29 +0000 (0:00:00.813) 0:03:09.739 **** 2021-02-24T15:11:29.800 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi152.front.sepia.ceph.com", "ansible_hostname": "smithi152", "ansible_nodename": "smithi152"}, "changed": true, "name": "smithi152"} 2021-02-24T15:11:29.837 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:29 +0000 (0:00:00.044) 0:03:09.783 **** 2021-02-24T15:11:30.243 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-24T15:11:30.245 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-02-24T15:11:30.284 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:30 +0000 (0:00:00.447) 0:03:10.230 **** 2021-02-24T15:11:30.303 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-02-24T15:11:30.340 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:30 +0000 (0:00:00.056) 0:03:10.286 **** 2021-02-24T15:11:30.746 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-02-24T15:11:30.747 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-02-24T15:11:30.782 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:30 +0000 (0:00:00.441) 0:03:10.728 **** 2021-02-24T15:11:30.800 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-02-24T15:11:30.838 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:30 +0000 (0:00:00.056) 0:03:10.784 **** 2021-02-24T15:11:31.426 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-24T15:11:31.428 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-24T15:11:31.461 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:31 +0000 (0:00:00.623) 0:03:11.407 **** 2021-02-24T15:11:31.467 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-24T15:11:31.508 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:31 +0000 (0:00:00.046) 0:03:11.454 **** 2021-02-24T15:11:31.921 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-24T15:11:31.923 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-02-24T15:11:31.959 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:31 +0000 (0:00:00.450) 0:03:11.905 **** 2021-02-24T15:11:31.986 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-02-24T15:11:32.022 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:32 +0000 (0:00:00.063) 0:03:11.969 **** 2021-02-24T15:11:32.198 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-24T15:11:32.200 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-24T15:11:32.232 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:32 +0000 (0:00:00.209) 0:03:12.178 **** 2021-02-24T15:11:32.343 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-24T15:11:32.380 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:32 +0000 (0:00:00.147) 0:03:12.326 **** 2021-02-24T15:11:32.428 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-24T15:11:32.430 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-02-24T15:11:32.464 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:32 +0000 (0:00:00.084) 0:03:12.410 **** 2021-02-24T15:11:32.575 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-02-24T15:11:32.610 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:32 +0000 (0:00:00.145) 0:03:12.556 **** 2021-02-24T15:11:32.678 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-24T15:11:32.680 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-24T15:11:32.716 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:32 +0000 (0:00:00.106) 0:03:12.662 **** 2021-02-24T15:11:32.827 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-24T15:11:32.863 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:32 +0000 (0:00:00.147) 0:03:12.809 **** 2021-02-24T15:11:33.183 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-24T15:11:33.185 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-02-24T15:11:33.218 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:33 +0000 (0:00:00.354) 0:03:13.164 **** 2021-02-24T15:11:33.320 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-02-24T15:11:33.360 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:33 +0000 (0:00:00.141) 0:03:13.306 **** 2021-02-24T15:11:33.702 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-24T15:11:33.708 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-02-24T15:11:33.738 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:33 +0000 (0:00:00.377) 0:03:13.684 **** 2021-02-24T15:11:33.841 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-02-24T15:11:33.885 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:33 +0000 (0:00:00.146) 0:03:13.830 **** 2021-02-24T15:11:35.944 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-24T15:11:35.946 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.000625", "end": "2021-02-24 15:11:35.913697", "rc": 0, "start": "2021-02-24 15:11:33.913072", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:11:35.979 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:35 +0000 (0:00:02.094) 0:03:15.925 **** 2021-02-24T15:11:36.059 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.977430", "end": "2021-02-24 15:11:36.033897", "rc": 0, "start": "2021-02-24 15:11:34.056467", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:11:36.098 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:36 +0000 (0:00:00.119) 0:03:16.044 **** 2021-02-24T15:11:36.469 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-24T15:11:36.470 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-02-24T15:11:36.586 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-02-24T15:11:36.899 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-02-24T15:11:37.026 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-02-24T15:11:37.339 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-02-24T15:11:37.379 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:37 +0000 (0:00:01.281) 0:03:17.325 **** 2021-02-24T15:11:37.463 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-02-24T15:11:37.505 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:37 +0000 (0:00:00.125) 0:03:17.451 **** 2021-02-24T15:11:37.861 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-24T15:11:37.863 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-02-24T15:11:37.898 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:37 +0000 (0:00:00.393) 0:03:17.844 **** 2021-02-24T15:11:37.979 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-02-24T15:11:38.018 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:38 +0000 (0:00:00.120) 0:03:17.964 **** 2021-02-24T15:11:38.370 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-24T15:11:38.372 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-02-24T15:11:38.487 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-02-24T15:11:38.813 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-02-24T15:11:38.815 INFO:teuthology.task.ansible.out: 2021-02-24T15:11:38.929 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-02-24T15:11:39.268 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-02-24T15:11:39.311 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:01.292) 0:03:19.257 **** 2021-02-24T15:11:39.337 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-24T15:11:39.375 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.064) 0:03:19.321 **** 2021-02-24T15:11:39.393 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-24T15:11:39.395 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-02-24T15:11:39.431 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.056) 0:03:19.378 **** 2021-02-24T15:11:39.439 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.477 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.045) 0:03:19.423 **** 2021-02-24T15:11:39.485 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-24T15:11:39.525 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.048) 0:03:19.471 **** 2021-02-24T15:11:39.531 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-24T15:11:39.533 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.543 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.584 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.059) 0:03:19.530 **** 2021-02-24T15:11:39.590 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-02-24T15:11:39.592 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.630 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.046) 0:03:19.576 **** 2021-02-24T15:11:39.637 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-24T15:11:39.638 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.675 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.044) 0:03:19.621 **** 2021-02-24T15:11:39.681 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-24T15:11:39.682 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.692 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.729 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.054) 0:03:19.675 **** 2021-02-24T15:11:39.738 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-02-24T15:11:39.778 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.048) 0:03:19.724 **** 2021-02-24T15:11:39.784 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.822 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.044) 0:03:19.768 **** 2021-02-24T15:11:39.829 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-24T15:11:39.831 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.866 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.043) 0:03:19.812 **** 2021-02-24T15:11:39.872 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:11:39.874 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-02-24T15:11:39.908 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.042) 0:03:19.854 **** 2021-02-24T15:11:39.916 INFO:teuthology.task.ansible.out: 2021-02-24T15:11:39.918 INFO:teuthology.task.ansible.out:TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:39.954 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.045) 0:03:19.900 **** 2021-02-24T15:11:39.956 INFO:teuthology.task.ansible.out: 2021-02-24T15:11:39.962 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-24T15:11:39.964 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:40.001 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:39 +0000 (0:00:00.046) 0:03:19.947 **** 2021-02-24T15:11:40.039 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:40.073 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:40 +0000 (0:00:00.072) 0:03:20.019 **** 2021-02-24T15:11:40.164 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-24T15:11:40.166 INFO:teuthology.task.ansible.out:fatal: [smithi181.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007316", "end": "2021-02-24 15:11:40.147114", "msg": "non-zero return code", "rc": 1, "start": "2021-02-24 15:11:40.139798", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-02-24T15:11:40.206 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:40 +0000 (0:00:00.132) 0:03:20.152 **** 2021-02-24T15:11:40.249 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-24T15:11:40.251 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:40.284 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:40 +0000 (0:00:00.078) 0:03:20.230 **** 2021-02-24T15:11:40.291 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-24T15:11:40.292 INFO:teuthology.task.ansible.out:fatal: [smithi152.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007237", "end": "2021-02-24 15:11:40.267354", "msg": "non-zero return code", "rc": 1, "start": "2021-02-24 15:11:40.260117", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-02-24T15:11:40.329 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:40 +0000 (0:00:00.045) 0:03:20.275 **** 2021-02-24T15:11:40.367 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:11:40.403 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:40 +0000 (0:00:00.073) 0:03:20.349 **** 2021-02-24T15:11:42.536 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-24T15:11:42.538 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-02-24T15:11:42.576 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:42 +0000 (0:00:02.173) 0:03:22.522 **** 2021-02-24T15:11:42.775 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-02-24T15:11:42.814 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:42 +0000 (0:00:00.238) 0:03:22.760 **** 2021-02-24T15:11:44.664 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-24T15:11:44.666 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2021-02-24T15:11:44.721 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:44 +0000 (0:00:01.906) 0:03:24.667 **** 2021-02-24T15:11:44.845 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2021-02-24T15:11:44.882 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:11:44 +0000 (0:00:00.160) 0:03:24.828 **** 2021-02-24T15:12:27.039 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-24T15:12:27.041 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: util-linux-2.32.1-24.el8.x86_64", "Installed: util-linux-user-2.32.1-24.el8.x86_64", "Installed: python3-libdnf-0.48.0-5.el8.x86_64", "Installed: libdnf-0.48.0-5.el8.x86_64", "Installed: python3-librepo-1.12.0-2.el8.x86_64", "Installed: boost-chrono-1.66.0-10.el8.x86_64", "Installed: xfsprogs-5.0.0-4.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: libfdisk-2.32.1-24.el8.x86_64", "Installed: gdb-8.2-12.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: gcc-8.3.1-5.1.el8.x86_64", "Installed: gdb-headless-8.2-12.el8.x86_64", "Installed: nfs-utils-1:2.3.3-35.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: gcc-gdb-plugin-8.3.1-5.1.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: python3-virtualenv-15.1.0-19.module_el8.3.0+562+e162826a.noarch", "Installed: libgcc-8.3.1-5.1.el8.x86_64", "Installed: libgcrypt-1.8.5-4.el8.x86_64", "Installed: libuuid-2.32.1-24.el8.x86_64", "Installed: yum-utils-4.0.17-5.el8.no 2021-02-24T15:12:27.043 INFO:teuthology.task.ansible.out:arch", "Installed: libgomp-8.3.1-5.1.el8.x86_64", "Installed: perl-Git-2.27.0-1.el8.noarch", "Installed: boost-system-1.66.0-10.el8.x86_64", "Installed: yum-4.2.23-4.el8.noarch", "Installed: boost-thread-1.66.0-10.el8.x86_64", "Installed: librepo-1.12.0-2.el8.x86_64", "Installed: runc-1.0.0-70.rc92.module_el8.3.0+699+d61d9c41.x86_64", "Installed: podman-2.2.1-7.module_el8.3.0+699+d61d9c41.x86_64", "Installed: podman-catatonit-2.2.1-7.module_el8.3.0+699+d61d9c41.x86_64", "Installed: podman-docker-2.2.1-7.module_el8.3.0+699+d61d9c41.noarch", "Installed: dnf-4.2.23-4.el8.noarch", "Installed: dnf-data-4.2.23-4.el8.noarch", "Installed: dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: python3-nose-1.3.7-30.module_el8.3.0+562+e162826a.noarch", "Installed: libsmartcols-2.32.1-24.el8.x86_64", "Installed: openssl-1:1.1.1g-12.el8_3.x86_64", "Installed: lsof-4.93.2-1.el8.x86_64", "Installed: valgrind-1:3.16.0-2.el8.x86_64", "Installed: git-2.27.0-1.el8.x86_64", "Installed: libblkid-2.32.1-24.el8.x86_64", "Installed: openssl-libs-1:1.1.1g-12.el8_3.x86_64", "Installed: git-core-2.27.0-1.el8.x86_64", "Installed: git-core-doc-2.27.0-1.el8.noarch", "Installed: qemu-img-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Installed: cpp-8.3.1-5.1.el8.x86_64", "Installed: python3-hawkey-0.48.0-5.el8.x86_64", "Installed: libmodulemd-2.9.4-2.el8.x86_64", "Installed: libmount-2.32.1-24.el8.x86_64", "Installed: python3-dnf-4.2.23-4.el8.noarch", "Installed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: sysstat-11.7.3-5.el8.x86_64", "Installed: seavgabios-bin-1.13.0-2.module_el8.3.0+555+a55c8938.noarch", "Removed: python3-virtualenv-15.1.0-19.module_el8.1.0+245+c39af44f.noarch", "Removed: openssl-1:1.1.1c-15.el8.x86_64", "Removed: qemu-img-15: 2021-02-24T15:12:27.045 INFO:teuthology.task.ansible.out:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-common-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: openssl-libs-1:1.1.1c-15.el8.x86_64", "Removed: librepo-1.11.0-2.el8.x86_64", "Removed: libsmartcols-2.32.1-22.el8.x86_64", "Removed: gcc-8.3.1-4.5.el8.x86_64", "Removed: gcc-gdb-plugin-8.3.1-4.5.el8.x86_64", "Removed: gdb-8.2-6.el8.x86_64", "Removed: gdb-headless-8.2-6.el8.x86_64", "Removed: runc-1.0.0-64.rc9.module_el8.1.0+298+41f9343a.x86_64", "Removed: seavgabios-bin-1.11.1-4.module_el8.1.0+248+298dec18.noarch", "Removed: boost-chrono-1.66.0-6.el8.x86_64", "Removed: git-2.18.2-2.el8_1.x86_64", "Removed: git-core-2.18.2-2.el8_1.x86_64", "Removed: git-core-doc-2.18.2-2.el8_1.noarch", "Removed: boost-system-1.66.0-6.el8.x86_64", "Removed: boost-thread-1.66.0-6.el8.x86_64", "Removed: libuuid-2.32.1-22.el8.x86_64", "Removed: podman-1.6.4-4.module_el8.1.0+298+41f9343a.x86_64", "Removed: podman-docker-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: podman-manpages-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: libblkid-2.32.1-22.el8.x86_64", "Removed: libdnf-0.35.1-9.el8_1.x86_64", "Removed: perl-Git-2.18.2-2.el8_1.noarch", "Removed: lsof-4.91-2.el8.x86_64", "Removed: cpp-8.3.1-4.5.el8.x86_64", "Removed: sysstat-11.7.3-2.el8.x86_64", "Removed: libfdisk-2.32.1-22.el8.x86_64", "Removed: python3-dnf-4.2.7-7.el8_1.noarch", "Removed: python3-dnf-plugins-core-4.0.8-3.el8.noarch", "Removed: libgcc-8.3.1-5.el8.0.2.x86_64", "Removed: libgcrypt-1.8.3-4.el8.x86_64", "Removed: python3-hawkey-0.35.1-9.el8_1.x86_64", "Removed: libgomp-8.3.1-4.5.el8.x86_64", "Removed: python3-libdnf-0.35.1-9.el8_1.x86_64", "Removed: python3-librepo-1.11.0-2.el8.x86_64", "Removed: util-linux-2.32.1-22.el8.x86_64", "Removed: util-linux-user-2.32.1-22.el8.x86_64", "Removed: valgrind-1:3.15.0-9.el8.x86_64", "Removed: python3-nose-1.3.7-30.module_el8.1.0+245+c39af44f.noarch", "Remo 2021-02-24T15:12:27.046 INFO:teuthology.task.ansible.out:ved: dnf-4.2.7-7.el8_1.noarch", "Removed: dnf-data-4.2.7-7.el8_1.noarch", "Removed: libmount-2.32.1-22.el8.x86_64", "Removed: dnf-plugins-core-4.0.8-3.el8.noarch", "Removed: nfs-utils-1:2.3.3-26.el8.x86_64", "Removed: xfsprogs-5.0.0-2.el8.x86_64", "Removed: yum-4.2.7-7.el8_1.noarch", "Removed: yum-utils-4.0.8-3.el8.noarch"]} 2021-02-24T15:12:27.089 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:27 +0000 (0:00:42.206) 0:04:07.035 **** 2021-02-24T15:12:27.128 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-24T15:12:27.130 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:27.165 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:27 +0000 (0:00:00.075) 0:04:07.111 **** 2021-02-24T15:12:28.248 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-24T15:12:28.250 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-02-24T15:12:28.283 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:28 +0000 (0:00:01.118) 0:04:08.229 **** 2021-02-24T15:12:28.322 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-24T15:12:28.324 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:28.362 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:28 +0000 (0:00:00.079) 0:04:08.308 **** 2021-02-24T15:12:28.679 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-24T15:12:28.681 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target system.slice polkit.service dbus.service sysinit.target dbus.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service iptables.service shutdown.target ebtables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNode 2021-02-24T15:12:28.682 INFO:teuthology.task.ansible.out:s": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "L 2021-02-24T15:12:28.684 INFO:teuthology.task.ansible.out:imitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWe 2021-02-24T15:12:28.686 INFO:teuthology.task.ansible.out:ight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-24T15:12:28.724 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:28 +0000 (0:00:00.361) 0:04:08.670 **** 2021-02-24T15:12:29.022 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-24T15:12:29.023 INFO:teuthology.task.ansible.out:fatal: [smithi181.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-02-24T15:12:29.062 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:29 +0000 (0:00:00.336) 0:04:09.007 **** 2021-02-24T15:12:29.229 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-24T15:12:29.232 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: util-linux-2.32.1-24.el8.x86_64", "Installed: util-linux-user-2.32.1-24.el8.x86_64", "Installed: python3-libdnf-0.48.0-5.el8.x86_64", "Installed: libdnf-0.48.0-5.el8.x86_64", "Installed: python3-librepo-1.12.0-2.el8.x86_64", "Installed: boost-chrono-1.66.0-10.el8.x86_64", "Installed: xfsprogs-5.0.0-4.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: libfdisk-2.32.1-24.el8.x86_64", "Installed: gdb-8.2-12.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: gcc-8.3.1-5.1.el8.x86_64", "Installed: gdb-headless-8.2-12.el8.x86_64", "Installed: nfs-utils-1:2.3.3-35.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: gcc-gdb-plugin-8.3.1-5.1.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: python3-virtualenv-15.1.0-19.module_el8.3.0+562+e162826a.noarch", "Installed: libgcc-8.3.1-5.1.el8.x86_64", "Installed: libgcrypt-1.8.5-4.el8.x86_64", "Installed: libuuid-2.32.1-24.el8.x86_64", "Installed: yum-utils-4.0.17-5.el8.no 2021-02-24T15:12:29.233 INFO:teuthology.task.ansible.out:arch", "Installed: libgomp-8.3.1-5.1.el8.x86_64", "Installed: perl-Git-2.27.0-1.el8.noarch", "Installed: boost-system-1.66.0-10.el8.x86_64", "Installed: yum-4.2.23-4.el8.noarch", "Installed: boost-thread-1.66.0-10.el8.x86_64", "Installed: librepo-1.12.0-2.el8.x86_64", "Installed: runc-1.0.0-70.rc92.module_el8.3.0+699+d61d9c41.x86_64", "Installed: podman-2.2.1-7.module_el8.3.0+699+d61d9c41.x86_64", "Installed: podman-catatonit-2.2.1-7.module_el8.3.0+699+d61d9c41.x86_64", "Installed: podman-docker-2.2.1-7.module_el8.3.0+699+d61d9c41.noarch", "Installed: dnf-4.2.23-4.el8.noarch", "Installed: dnf-data-4.2.23-4.el8.noarch", "Installed: dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: python3-nose-1.3.7-30.module_el8.3.0+562+e162826a.noarch", "Installed: libsmartcols-2.32.1-24.el8.x86_64", "Installed: openssl-1:1.1.1g-12.el8_3.x86_64", "Installed: lsof-4.93.2-1.el8.x86_64", "Installed: valgrind-1:3.16.0-2.el8.x86_64", "Installed: git-2.27.0-1.el8.x86_64", "Installed: libblkid-2.32.1-24.el8.x86_64", "Installed: openssl-libs-1:1.1.1g-12.el8_3.x86_64", "Installed: git-core-2.27.0-1.el8.x86_64", "Installed: git-core-doc-2.27.0-1.el8.noarch", "Installed: qemu-img-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Installed: cpp-8.3.1-5.1.el8.x86_64", "Installed: python3-hawkey-0.48.0-5.el8.x86_64", "Installed: libmodulemd-2.9.4-2.el8.x86_64", "Installed: libmount-2.32.1-24.el8.x86_64", "Installed: python3-dnf-4.2.23-4.el8.noarch", "Installed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: sysstat-11.7.3-5.el8.x86_64", "Installed: seavgabios-bin-1.13.0-2.module_el8.3.0+555+a55c8938.noarch", "Removed: python3-virtualenv-15.1.0-19.module_el8.1.0+245+c39af44f.noarch", "Removed: openssl-1:1.1.1c-15.el8.x86_64", "Removed: qemu-img-15: 2021-02-24T15:12:29.235 INFO:teuthology.task.ansible.out:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-common-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: openssl-libs-1:1.1.1c-15.el8.x86_64", "Removed: librepo-1.11.0-2.el8.x86_64", "Removed: libsmartcols-2.32.1-22.el8.x86_64", "Removed: gcc-8.3.1-4.5.el8.x86_64", "Removed: gcc-gdb-plugin-8.3.1-4.5.el8.x86_64", "Removed: gdb-8.2-6.el8.x86_64", "Removed: gdb-headless-8.2-6.el8.x86_64", "Removed: runc-1.0.0-64.rc9.module_el8.1.0+298+41f9343a.x86_64", "Removed: seavgabios-bin-1.11.1-4.module_el8.1.0+248+298dec18.noarch", "Removed: boost-chrono-1.66.0-6.el8.x86_64", "Removed: git-2.18.2-2.el8_1.x86_64", "Removed: git-core-2.18.2-2.el8_1.x86_64", "Removed: git-core-doc-2.18.2-2.el8_1.noarch", "Removed: boost-system-1.66.0-6.el8.x86_64", "Removed: boost-thread-1.66.0-6.el8.x86_64", "Removed: libuuid-2.32.1-22.el8.x86_64", "Removed: podman-1.6.4-4.module_el8.1.0+298+41f9343a.x86_64", "Removed: podman-docker-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: podman-manpages-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: libblkid-2.32.1-22.el8.x86_64", "Removed: libdnf-0.35.1-9.el8_1.x86_64", "Removed: perl-Git-2.18.2-2.el8_1.noarch", "Removed: lsof-4.91-2.el8.x86_64", "Removed: cpp-8.3.1-4.5.el8.x86_64", "Removed: sysstat-11.7.3-2.el8.x86_64", "Removed: libfdisk-2.32.1-22.el8.x86_64", "Removed: python3-dnf-4.2.7-7.el8_1.noarch", "Removed: python3-dnf-plugins-core-4.0.8-3.el8.noarch", "Removed: libgcc-8.3.1-5.el8.0.2.x86_64", "Removed: libgcrypt-1.8.3-4.el8.x86_64", "Removed: python3-hawkey-0.35.1-9.el8_1.x86_64", "Removed: libgomp-8.3.1-4.5.el8.x86_64", "Removed: python3-libdnf-0.35.1-9.el8_1.x86_64", "Removed: python3-librepo-1.11.0-2.el8.x86_64", "Removed: util-linux-2.32.1-22.el8.x86_64", "Removed: util-linux-user-2.32.1-22.el8.x86_64", "Removed: valgrind-1:3.15.0-9.el8.x86_64", "Removed: python3-nose-1.3.7-30.module_el8.1.0+245+c39af44f.noarch", "Remo 2021-02-24T15:12:29.237 INFO:teuthology.task.ansible.out:ved: dnf-4.2.7-7.el8_1.noarch", "Removed: dnf-data-4.2.7-7.el8_1.noarch", "Removed: libmount-2.32.1-22.el8.x86_64", "Removed: dnf-plugins-core-4.0.8-3.el8.noarch", "Removed: nfs-utils-1:2.3.3-26.el8.x86_64", "Removed: xfsprogs-5.0.0-2.el8.x86_64", "Removed: yum-4.2.7-7.el8_1.noarch", "Removed: yum-utils-4.0.8-3.el8.noarch"]} 2021-02-24T15:12:29.274 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:29 +0000 (0:00:00.212) 0:04:09.220 **** 2021-02-24T15:12:29.312 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-24T15:12:29.313 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:29.373 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:29 +0000 (0:00:00.098) 0:04:09.319 **** 2021-02-24T15:12:29.783 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-24T15:12:29.785 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-02-24T15:12:29.824 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:29 +0000 (0:00:00.451) 0:04:09.770 **** 2021-02-24T15:12:29.852 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-24T15:12:29.853 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:29.887 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:29 +0000 (0:00:00.063) 0:04:09.833 **** 2021-02-24T15:12:29.924 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-24T15:12:29.926 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:29.968 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:29 +0000 (0:00:00.080) 0:04:09.914 **** 2021-02-24T15:12:29.999 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.045 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.077) 0:04:09.991 **** 2021-02-24T15:12:30.074 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.109 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.062) 0:04:10.054 **** 2021-02-24T15:12:30.158 INFO:teuthology.task.ansible.out: 2021-02-24T15:12:30.160 INFO:teuthology.task.ansible.out:TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.192 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.084) 0:04:10.138 **** 2021-02-24T15:12:30.220 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-24T15:12:30.222 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.261 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.068) 0:04:10.207 **** 2021-02-24T15:12:30.299 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-24T15:12:30.336 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.075) 0:04:10.282 **** 2021-02-24T15:12:30.369 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-24T15:12:30.371 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.411 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.075) 0:04:10.357 **** 2021-02-24T15:12:30.442 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-24T15:12:30.443 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.483 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.071) 0:04:10.429 **** 2021-02-24T15:12:30.511 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-24T15:12:30.513 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-02-24T15:12:30.556 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.073) 0:04:10.502 **** 2021-02-24T15:12:30.568 INFO:teuthology.task.ansible.out: 2021-02-24T15:12:30.569 INFO:teuthology.task.ansible.out:TASK [testnode : Install apt keys] ********************************************* skipping: [smithi181.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.608 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.051) 0:04:10.554 **** 2021-02-24T15:12:30.614 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-24T15:12:30.616 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.652 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.043) 0:04:10.598 **** 2021-02-24T15:12:30.659 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-24T15:12:30.661 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.700 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.048) 0:04:10.646 **** 2021-02-24T15:12:30.730 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-24T15:12:30.773 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.072) 0:04:10.719 **** 2021-02-24T15:12:30.803 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-24T15:12:30.804 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.837 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.064) 0:04:10.783 **** 2021-02-24T15:12:30.864 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.900 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.062) 0:04:10.846 **** 2021-02-24T15:12:30.937 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-24T15:12:30.939 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:30.975 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:30 +0000 (0:00:00.075) 0:04:10.921 **** 2021-02-24T15:12:30.982 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-24T15:12:30.983 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service basic.target polkit.service system.slice dbus.socket sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ip6tables.service ebtables.service ipset.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNode 2021-02-24T15:12:30.985 INFO:teuthology.task.ansible.out:s": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "L 2021-02-24T15:12:30.987 INFO:teuthology.task.ansible.out:imitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWe 2021-02-24T15:12:30.988 INFO:teuthology.task.ansible.out:ight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-24T15:12:31.022 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.046) 0:04:10.968 **** 2021-02-24T15:12:31.028 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-24T15:12:31.030 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.071 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.049) 0:04:11.017 **** 2021-02-24T15:12:31.098 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-24T15:12:31.100 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.133 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.062) 0:04:11.080 **** 2021-02-24T15:12:31.162 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-24T15:12:31.163 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.198 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.064) 0:04:11.144 **** 2021-02-24T15:12:31.225 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-24T15:12:31.226 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.261 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.063) 0:04:11.207 **** 2021-02-24T15:12:31.288 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-24T15:12:31.290 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.327 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.066) 0:04:11.273 **** 2021-02-24T15:12:31.333 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-24T15:12:31.335 INFO:teuthology.task.ansible.out:fatal: [smithi152.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-02-24T15:12:31.369 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.041) 0:04:11.315 **** 2021-02-24T15:12:31.376 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-24T15:12:31.377 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.412 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.042) 0:04:11.358 **** 2021-02-24T15:12:31.413 INFO:teuthology.task.ansible.out: 2021-02-24T15:12:31.439 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-24T15:12:31.441 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.485 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.073) 0:04:11.431 **** 2021-02-24T15:12:31.513 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.549 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.063) 0:04:11.495 **** 2021-02-24T15:12:31.576 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.611 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.062) 0:04:11.557 **** 2021-02-24T15:12:31.639 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.679 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.068) 0:04:11.625 **** 2021-02-24T15:12:31.686 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-24T15:12:31.687 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-02-24T15:12:31.721 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.041) 0:04:11.667 **** 2021-02-24T15:12:31.728 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-24T15:12:31.730 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.766 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.044) 0:04:11.712 **** 2021-02-24T15:12:31.774 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-24T15:12:31.775 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.809 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.043) 0:04:11.755 **** 2021-02-24T15:12:31.817 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-24T15:12:31.819 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.863 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.053) 0:04:11.809 **** 2021-02-24T15:12:31.870 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-24T15:12:31.872 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.905 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.041) 0:04:11.851 **** 2021-02-24T15:12:31.911 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-24T15:12:31.913 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.948 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.043) 0:04:11.894 **** 2021-02-24T15:12:31.954 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-02-24T15:12:31.956 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:31.991 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:31 +0000 (0:00:00.042) 0:04:11.937 **** 2021-02-24T15:12:31.999 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-24T15:12:32.001 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.034 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.043) 0:04:11.980 **** 2021-02-24T15:12:32.040 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-24T15:12:32.042 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.078 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.044) 0:04:12.024 **** 2021-02-24T15:12:32.087 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-24T15:12:32.089 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.123 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.044) 0:04:12.069 **** 2021-02-24T15:12:32.131 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-02-24T15:12:32.133 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.167 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.044) 0:04:12.113 **** 2021-02-24T15:12:32.178 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.224 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.056) 0:04:12.170 **** 2021-02-24T15:12:32.231 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-24T15:12:32.233 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.270 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.046) 0:04:12.216 **** 2021-02-24T15:12:32.278 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-24T15:12:32.280 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.320 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.049) 0:04:12.266 **** 2021-02-24T15:12:32.327 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-24T15:12:32.363 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.042) 0:04:12.309 **** 2021-02-24T15:12:32.369 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-24T15:12:32.371 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.406 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.042) 0:04:12.352 **** 2021-02-24T15:12:32.412 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-24T15:12:32.414 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.456 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.049) 0:04:12.402 **** 2021-02-24T15:12:32.462 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-24T15:12:32.464 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.499 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.043) 0:04:12.445 **** 2021-02-24T15:12:32.508 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-24T15:12:32.509 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.543 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.043) 0:04:12.489 **** 2021-02-24T15:12:32.550 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:12:32.552 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.595 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.051) 0:04:12.541 **** 2021-02-24T15:12:32.602 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-24T15:12:32.603 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.638 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.042) 0:04:12.584 **** 2021-02-24T15:12:32.646 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-24T15:12:32.648 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.681 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.043) 0:04:12.627 **** 2021-02-24T15:12:32.689 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-24T15:12:32.691 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.728 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.046) 0:04:12.674 **** 2021-02-24T15:12:32.734 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-24T15:12:32.736 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.770 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.042) 0:04:12.717 **** 2021-02-24T15:12:32.777 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-24T15:12:32.814 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.043) 0:04:12.760 **** 2021-02-24T15:12:32.821 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-24T15:12:32.822 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.856 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.042) 0:04:12.802 **** 2021-02-24T15:12:32.862 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-24T15:12:32.864 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.898 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.041) 0:04:12.844 **** 2021-02-24T15:12:32.905 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-24T15:12:32.906 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.941 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.043) 0:04:12.887 **** 2021-02-24T15:12:32.947 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-24T15:12:32.949 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:32.985 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:32 +0000 (0:00:00.043) 0:04:12.931 **** 2021-02-24T15:12:33.013 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-24T15:12:33.015 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.047 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.062) 0:04:12.993 **** 2021-02-24T15:12:33.075 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-24T15:12:33.077 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.109 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.061) 0:04:13.055 **** 2021-02-24T15:12:33.139 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-24T15:12:33.141 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.174 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.065) 0:04:13.121 **** 2021-02-24T15:12:33.182 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-24T15:12:33.183 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-02-24T15:12:33.222 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.046) 0:04:13.168 **** 2021-02-24T15:12:33.228 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-24T15:12:33.230 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.265 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.043) 0:04:13.211 **** 2021-02-24T15:12:33.293 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-24T15:12:33.295 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.337 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.071) 0:04:13.283 **** 2021-02-24T15:12:33.365 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-24T15:12:33.368 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.408 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.071) 0:04:13.354 **** 2021-02-24T15:12:33.425 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-24T15:12:33.427 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:12:33.466 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.057) 0:04:13.412 **** 2021-02-24T15:12:33.475 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-24T15:12:33.477 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.511 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.045) 0:04:13.457 **** 2021-02-24T15:12:33.538 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-24T15:12:33.540 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.574 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.063) 0:04:13.520 **** 2021-02-24T15:12:33.603 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-24T15:12:33.605 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.643 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.068) 0:04:13.589 **** 2021-02-24T15:12:33.661 INFO:teuthology.task.ansible.out: 2021-02-24T15:12:33.663 INFO:teuthology.task.ansible.out:TASK [testnode : Make fsstress same path as ubuntu.] *************************** [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-02-24T15:12:33.697 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.053) 0:04:13.643 **** 2021-02-24T15:12:33.703 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-24T15:12:33.705 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.739 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.041) 0:04:13.685 **** 2021-02-24T15:12:33.746 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-24T15:12:33.748 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.786 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.047) 0:04:13.732 **** 2021-02-24T15:12:33.792 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-24T15:12:33.794 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.834 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.048) 0:04:13.780 **** 2021-02-24T15:12:33.842 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.881 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.046) 0:04:13.827 **** 2021-02-24T15:12:33.888 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-24T15:12:33.889 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.928 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.047) 0:04:13.874 **** 2021-02-24T15:12:33.937 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-24T15:12:33.938 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:33.972 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:33 +0000 (0:00:00.043) 0:04:13.918 **** 2021-02-24T15:12:33.980 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-24T15:12:33.982 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.022 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.049) 0:04:13.968 **** 2021-02-24T15:12:34.029 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-24T15:12:34.031 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.066 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.044) 0:04:14.012 **** 2021-02-24T15:12:34.076 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.112 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.045) 0:04:14.058 **** 2021-02-24T15:12:34.119 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-24T15:12:34.121 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.155 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.043) 0:04:14.101 **** 2021-02-24T15:12:34.162 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-24T15:12:34.164 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.203 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.047) 0:04:14.149 **** 2021-02-24T15:12:34.210 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-24T15:12:34.212 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.247 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.044) 0:04:14.193 **** 2021-02-24T15:12:34.254 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-24T15:12:34.255 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.290 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.042) 0:04:14.236 **** 2021-02-24T15:12:34.297 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-24T15:12:34.299 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.334 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.043) 0:04:14.280 **** 2021-02-24T15:12:34.342 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-24T15:12:34.343 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.382 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.048) 0:04:14.328 **** 2021-02-24T15:12:34.389 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-24T15:12:34.391 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.426 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.044) 0:04:14.372 **** 2021-02-24T15:12:34.432 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-24T15:12:34.434 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.469 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.042) 0:04:14.415 **** 2021-02-24T15:12:34.475 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-24T15:12:34.477 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.510 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.041) 0:04:14.456 **** 2021-02-24T15:12:34.517 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-24T15:12:34.519 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.553 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.042) 0:04:14.499 **** 2021-02-24T15:12:34.569 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-24T15:12:34.571 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.604 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.051) 0:04:14.550 **** 2021-02-24T15:12:34.613 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-24T15:12:34.615 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.650 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.045) 0:04:14.596 **** 2021-02-24T15:12:34.656 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-24T15:12:34.658 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.693 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.043) 0:04:14.639 **** 2021-02-24T15:12:34.704 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:12:34.706 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.739 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.045) 0:04:14.685 **** 2021-02-24T15:12:34.746 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-24T15:12:34.748 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.786 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.046) 0:04:14.732 **** 2021-02-24T15:12:34.792 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.840 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.053) 0:04:14.786 **** 2021-02-24T15:12:34.847 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-24T15:12:34.849 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.885 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.045) 0:04:14.831 **** 2021-02-24T15:12:34.891 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-24T15:12:34.893 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:34.931 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.045) 0:04:14.877 **** 2021-02-24T15:12:34.938 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-24T15:12:34.941 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.000 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:34 +0000 (0:00:00.069) 0:04:14.946 **** 2021-02-24T15:12:35.007 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-24T15:12:35.009 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.059 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.058) 0:04:15.005 **** 2021-02-24T15:12:35.065 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-02-24T15:12:35.067 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.108 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.049) 0:04:15.054 **** 2021-02-24T15:12:35.114 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-24T15:12:35.116 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.162 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.053) 0:04:15.108 **** 2021-02-24T15:12:35.170 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-24T15:12:35.173 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.214 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.051) 0:04:15.160 **** 2021-02-24T15:12:35.243 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-24T15:12:35.244 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.278 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.064) 0:04:15.224 **** 2021-02-24T15:12:35.304 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-24T15:12:35.306 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.353 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.075) 0:04:15.299 **** 2021-02-24T15:12:35.376 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-24T15:12:35.378 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-02-24T15:12:35.420 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.066) 0:04:15.366 **** 2021-02-24T15:12:35.428 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-24T15:12:35.430 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.465 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.044) 0:04:15.411 **** 2021-02-24T15:12:35.492 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-24T15:12:35.494 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.530 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.065) 0:04:15.476 **** 2021-02-24T15:12:35.569 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-24T15:12:35.570 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.613 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.082) 0:04:15.559 **** 2021-02-24T15:12:35.631 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-24T15:12:35.632 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:12:35.667 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.054) 0:04:15.613 **** 2021-02-24T15:12:35.674 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-24T15:12:35.676 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.710 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.043) 0:04:15.656 **** 2021-02-24T15:12:35.739 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:12:35.740 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-24T15:12:35.775 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.065) 0:04:15.721 **** 2021-02-24T15:12:35.814 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-24T15:12:35.816 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.825 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-24T15:12:35.837 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.848 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.849 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.859 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.861 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-02-24T15:12:35.898 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.122) 0:04:15.844 **** 2021-02-24T15:12:35.905 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-24T15:12:35.907 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.946 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.047) 0:04:15.892 **** 2021-02-24T15:12:35.952 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-24T15:12:35.953 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:35.989 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:35 +0000 (0:00:00.043) 0:04:15.935 **** 2021-02-24T15:12:36.018 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.056 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.067) 0:04:16.002 **** 2021-02-24T15:12:36.084 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-24T15:12:36.086 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.119 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.061) 0:04:16.064 **** 2021-02-24T15:12:36.146 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-24T15:12:36.148 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003142", "end": "2021-02-24 15:12:36.121900", "rc": 0, "start": "2021-02-24 15:12:36.118758", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/virtualenv/bin/teuthology-lock"]} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.180 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.061) 0:04:16.126 **** 2021-02-24T15:12:36.219 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.038) 0:04:16.165 **** 2021-02-24T15:12:36.225 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-24T15:12:36.226 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.261 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.042) 0:04:16.207 **** 2021-02-24T15:12:36.267 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-24T15:12:36.270 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.308 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.046) 0:04:16.254 **** 2021-02-24T15:12:36.315 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-24T15:12:36.319 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.351 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.043) 0:04:16.298 **** 2021-02-24T15:12:36.358 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-24T15:12:36.360 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.400 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.048) 0:04:16.346 **** 2021-02-24T15:12:36.406 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-24T15:12:36.408 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.445 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.045) 0:04:16.392 **** 2021-02-24T15:12:36.453 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-24T15:12:36.454 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.491 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.045) 0:04:16.437 **** 2021-02-24T15:12:36.499 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-24T15:12:36.501 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.538 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.046) 0:04:16.484 **** 2021-02-24T15:12:36.545 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-24T15:12:36.547 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.583 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.044) 0:04:16.529 **** 2021-02-24T15:12:36.591 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-24T15:12:36.594 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.629 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.046) 0:04:16.575 **** 2021-02-24T15:12:36.657 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-24T15:12:36.658 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.692 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.062) 0:04:16.638 **** 2021-02-24T15:12:36.720 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-24T15:12:36.722 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.756 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.063) 0:04:16.702 **** 2021-02-24T15:12:36.785 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-24T15:12:36.786 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.819 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.063) 0:04:16.765 **** 2021-02-24T15:12:36.847 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-24T15:12:36.848 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.881 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.061) 0:04:16.827 **** 2021-02-24T15:12:36.907 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-24T15:12:36.909 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:36.942 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.061) 0:04:16.888 **** 2021-02-24T15:12:36.969 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.004 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:36 +0000 (0:00:00.062) 0:04:16.950 **** 2021-02-24T15:12:37.033 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-24T15:12:37.035 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.067 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.062) 0:04:17.013 **** 2021-02-24T15:12:37.098 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.140 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.073) 0:04:17.086 **** 2021-02-24T15:12:37.168 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-24T15:12:37.170 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.204 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.063) 0:04:17.150 **** 2021-02-24T15:12:37.231 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-24T15:12:37.233 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.270 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.065) 0:04:17.216 **** 2021-02-24T15:12:37.297 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.336 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.065) 0:04:17.282 **** 2021-02-24T15:12:37.362 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-24T15:12:37.364 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.396 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.060) 0:04:17.342 **** 2021-02-24T15:12:37.424 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-24T15:12:37.426 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.457 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.061) 0:04:17.403 **** 2021-02-24T15:12:37.484 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:12:37.486 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-24T15:12:37.519 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.061) 0:04:17.465 **** 2021-02-24T15:12:37.559 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-24T15:12:37.561 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.570 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-24T15:12:37.582 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.593 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.595 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.604 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.615 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.662 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.142) 0:04:17.608 **** 2021-02-24T15:12:37.858 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-24T15:12:37.860 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004627", "end": "2021-02-24 15:12:37.831330", "rc": 0, "start": "2021-02-24 15:12:37.826703", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/virtualenv/bin/teuthology-lock"]} 2021-02-24T15:12:37.899 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.237) 0:04:17.845 **** 2021-02-24T15:12:37.927 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-24T15:12:37.929 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:37.967 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:37 +0000 (0:00:00.068) 0:04:17.913 **** 2021-02-24T15:12:38.017 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-24T15:12:38.019 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:38.056 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:38 +0000 (0:00:00.088) 0:04:18.002 **** 2021-02-24T15:12:38.082 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-24T15:12:38.084 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:38.117 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:38 +0000 (0:00:00.061) 0:04:18.063 **** 2021-02-24T15:12:38.146 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-24T15:12:38.148 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:38.184 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:38 +0000 (0:00:00.066) 0:04:18.130 **** 2021-02-24T15:12:42.251 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-24T15:12:42.253 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper", "Installed: device-mapper-8:1.02.171-5.el8.x86_64", "Installed: device-mapper-event-8:1.02.171-5.el8.x86_64", "Installed: lvm2-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-event-libs-8:1.02.171-5.el8.x86_64", "Installed: lvm2-libs-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-libs-8:1.02.171-5.el8.x86_64", "Removed: device-mapper-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-libs-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-libs-8:1.02.169-3.el8.x86_64", "Removed: lvm2-8:2.03.08-3.el8.x86_64", "Removed: lvm2-libs-8:2.03.08-3.el8.x86_64"]} 2021-02-24T15:12:42.289 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:42 +0000 (0:00:04.104) 0:04:22.234 **** 2021-02-24T15:12:42.343 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-24T15:12:42.345 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356150272, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137732, 'block_used': 12957376, 'inode_total': 61054976, 'inode_available': 60986354, 'inode_used': 68622, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137732, "block_size": 4096, "block_total": 240095108, "block_used": 12957376, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986354, "inode_total": 61054976, "inode_used": 68622, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356150272, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}} 2021-02-24T15:12:42.379 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:42 +0000 (0:00:00.091) 0:04:22.325 **** 2021-02-24T15:12:42.596 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-24T15:12:42.598 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005290", "end": "2021-02-24 15:12:42.572883", "rc": 0, "start": "2021-02-24 15:12:42.567593", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:42.633 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:42 +0000 (0:00:00.254) 0:04:22.579 **** 2021-02-24T15:12:42.684 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-24T15:12:42.686 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356150272, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137732, 'block_used': 12957376, 'inode_total': 61054976, 'inode_available': 60986354, 'inode_used': 68622, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137732, "block_size": 4096, "block_total": 240095108, "block_used": 12957376, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986354, "inode_total": 61054976, "inode_used": 68622, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356150272, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:42.725 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:42 +0000 (0:00:00.091) 0:04:22.671 **** 2021-02-24T15:12:42.753 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-24T15:12:42.789 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:42 +0000 (0:00:00.064) 0:04:22.735 **** 2021-02-24T15:12:43.753 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-24T15:12:43.755 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper", "Installed: device-mapper-8:1.02.171-5.el8.x86_64", "Installed: device-mapper-event-8:1.02.171-5.el8.x86_64", "Installed: lvm2-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-event-libs-8:1.02.171-5.el8.x86_64", "Installed: lvm2-libs-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-libs-8:1.02.171-5.el8.x86_64", "Removed: device-mapper-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-libs-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-libs-8:1.02.169-3.el8.x86_64", "Removed: lvm2-8:2.03.08-3.el8.x86_64", "Removed: lvm2-libs-8:2.03.08-3.el8.x86_64"]} 2021-02-24T15:12:43.795 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:43 +0000 (0:00:01.005) 0:04:23.741 **** 2021-02-24T15:12:43.866 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-24T15:12:43.868 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356129792, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137727, 'block_used': 12957381, 'inode_total': 61054976, 'inode_available': 60986350, 'inode_used': 68626, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137727, "block_size": 4096, "block_total": 240095108, "block_used": 12957381, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986350, "inode_total": 61054976, "inode_used": 68626, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356129792, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}} 2021-02-24T15:12:43.902 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:43 +0000 (0:00:00.106) 0:04:23.848 **** 2021-02-24T15:12:44.109 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-24T15:12:44.111 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005270", "end": "2021-02-24 15:12:44.088591", "rc": 0, "start": "2021-02-24 15:12:44.083321", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:44.144 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:44 +0000 (0:00:00.241) 0:04:24.090 **** 2021-02-24T15:12:44.192 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-24T15:12:44.194 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356129792, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137727, 'block_used': 12957381, 'inode_total': 61054976, 'inode_available': 60986350, 'inode_used': 68626, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137727, "block_size": 4096, "block_total": 240095108, "block_used": 12957381, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986350, "inode_total": 61054976, "inode_used": 68626, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356129792, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:44.230 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:44 +0000 (0:00:00.086) 0:04:24.176 **** 2021-02-24T15:12:44.237 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-24T15:12:44.238 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gD15JBmkddXs3eXL51VnmcibGY3KDT2KY'], 'uuids': ['7302ec69-a391-424d-822e-67f3c9a7295d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.184047", "end": "2021-02-24 15:12:44.169753", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gD15JBmkddXs3eXL51VnmcibGY3KDT2KY"], "labels": [], "masters": [], "uuids": ["7302ec69-a391-424d-822e-67f3c9a7295d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:42.985706", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:44.263 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-24T15:12:44.299 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:44 +0000 (0:00:00.068) 0:04:24.244 **** 2021-02-24T15:12:45.501 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-24T15:12:45.503 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRQcDw-rQEZ-xkeJ-YOZy-OBut-Gbol-5fBHl8', 'nvme-INTEL_SSDPEDMD400G4_CVFT6246000E400BGN', 'nvme-nvme.8086-43564654363234363030304534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.083588", "end": "2021-02-24 15:12:45.474844", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-kRQcDw-rQEZ-xkeJ-YOZy-OBut-Gbol-5fBHl8", "nvme-INTEL_SSDPEDMD400G4_CVFT6246000E400BGN", "nvme-nvme.8086-43564654363234363030304534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:44.391256", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-02-24T15:12:45.505 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:45.715 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7DgY6zjfzdZGseEdsivZWvC6LLf0qV9kQe'], 'uuids': ['f0b0431a-bca1-4957-aaf0-ef793874c5e3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.188789", "end": "2021-02-24 15:12:45.679320", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7DgY6zjfzdZGseEdsivZWvC6LLf0qV9kQe"], "labels": [], "masters": [], "uuids": ["f0b0431a-bca1-4957-aaf0-ef793874c5e3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:44.490531", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:46.762 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gOBU7DJ2SpKTN95yNIl1QK7G1nwGV3bA3'], 'uuids': ['90e18b5a-a2b5-4f09-9349-9fb6aa61fe66'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.065638", "end": "2021-02-24 15:12:46.729244", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gOBU7DJ2SpKTN95yNIl1QK7G1nwGV3bA3"], "labels": [], "masters": [], "uuids": ["90e18b5a-a2b5-4f09-9349-9fb6aa61fe66"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:45.663606", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:47.008 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-tu0oic-bGnS-ax1i-zsLI-xM2G-eYTz-rphOqQ', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300JT400BGN', 'nvme-nvme.8086-435646543632333330304a5434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.106192", "end": "2021-02-24 15:12:46.976736", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-tu0oic-bGnS-ax1i-zsLI-xM2G-eYTz-rphOqQ", "nvme-INTEL_SSDPEDMD400G4_CVFT623300JT400BGN", "nvme-nvme.8086-435646543632333330304a5434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:45.870544", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-02-24T15:12:47.012 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:48.027 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gFZd1r3ELWr31KgtcZNDTfwL0BcKdbiqu'], 'uuids': ['764a6d89-34ef-4670-82ce-a39631bd2a1f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.075532", "end": "2021-02-24 15:12:47.996344", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gFZd1r3ELWr31KgtcZNDTfwL0BcKdbiqu"], "labels": [], "masters": [], "uuids": ["764a6d89-34ef-4670-82ce-a39631bd2a1f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:46.920812", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:48.292 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7DkeodvmiZm3d7s2Dq7OYLtfR5xYqCXD2b'], 'uuids': ['655ae3bf-41d2-4dbe-b87c-4331d898dded'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.053213", "end": "2021-02-24 15:12:48.257896", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7DkeodvmiZm3d7s2Dq7OYLtfR5xYqCXD2b"], "labels": [], "masters": [], "uuids": ["655ae3bf-41d2-4dbe-b87c-4331d898dded"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:47.204683", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:49.308 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gKueN2YcoWoCfOB7VxOJ0Cqf5LlW2KsQw'], 'uuids': ['16475221-1ee9-4997-bddd-b85dd00146ba'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.097711", "end": "2021-02-24 15:12:49.280610", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gKueN2YcoWoCfOB7VxOJ0Cqf5LlW2KsQw"], "labels": [], "masters": [], "uuids": ["16475221-1ee9-4997-bddd-b85dd00146ba"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:48.182899", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:49.320 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTWX', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTWX', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTWX', 'scsi-35000c5009293ee09', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTWX', 'wwn-0x5000c5009293ee09'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTWX', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293ee09', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTWX-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTWX-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTWX-part1', 'scsi-35000c5009293ee09-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTWX-part1', 'wwn-0x5000c5009293ee09-part1'], 'uuids': ['a313f13c-d1e6-43a8-a40a-989733f55ee1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTWX", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTWX", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTWX", "scsi-35000c5009293ee09", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTWX", "wwn-0x5000c5009293ee09"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTWX-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTWX-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-02-24T15:12:49.322 INFO:teuthology.task.ansible.out:Z1W5XTWX-part1", "scsi-35000c5009293ee09-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTWX-part1", "wwn-0x5000c5009293ee09-part1"], "labels": [], "masters": [], "uuids": ["a313f13c-d1e6-43a8-a40a-989733f55ee1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTWX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293ee09"}}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:49.552 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7D9I1fn6mgkG2sN5uD78VHEI2AqsPJ8kfy'], 'uuids': ['792c3e31-22f0-4d73-affe-cfaeb05102d8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.070650", "end": "2021-02-24 15:12:49.518323", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7D9I1fn6mgkG2sN5uD78VHEI2AqsPJ8kfy"], "labels": [], "masters": [], "uuids": ["792c3e31-22f0-4d73-affe-cfaeb05102d8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:48.447673", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:50.570 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7grKrA2oXVbAE4EjNfNdJQGmm1ckuLDATR'], 'uuids': ['cd0bbdc0-3b29-466e-a8e8-1558866bb059'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.070392", "end": "2021-02-24 15:12:50.546148", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7grKrA2oXVbAE4EjNfNdJQGmm1ckuLDATR"], "labels": [], "masters": [], "uuids": ["cd0bbdc0-3b29-466e-a8e8-1558866bb059"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:49.475756", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:50.624 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:50 +0000 (0:00:06.326) 0:04:30.570 **** 2021-02-24T15:12:50.812 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7De3Mlbf0eeseMFwGR06n2ZNcO26NVMq1M'], 'uuids': ['2989c25e-f757-4f07-94bf-06cf81171496'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.064578", "end": "2021-02-24 15:12:50.785826", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7De3Mlbf0eeseMFwGR06n2ZNcO26NVMq1M"], "labels": [], "masters": [], "uuids": ["2989c25e-f757-4f07-94bf-06cf81171496"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:49.721248", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:50.824 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XEKT', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XEKT', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XEKT', 'scsi-35000c50092928022', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XEKT', 'wwn-0x5000c50092928022'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XEKT', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092928022', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XEKT-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XEKT-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XEKT-part1', 'scsi-35000c50092928022-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XEKT-part1', 'wwn-0x5000c50092928022-part1'], 'uuids': ['a313f13c-d1e6-43a8-a40a-989733f55ee1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XEKT", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XEKT", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XEKT", "scsi-35000c50092928022", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XEKT", "wwn-0x5000c50092928022"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XEKT-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XEKT-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-02-24T15:12:50.826 INFO:teuthology.task.ansible.out:Z1W5XEKT-part1", "scsi-35000c50092928022-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XEKT-part1", "wwn-0x5000c50092928022-part1"], "labels": [], "masters": [], "uuids": ["a313f13c-d1e6-43a8-a40a-989733f55ee1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XEKT", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092928022"}}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:51.010 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-24T15:12:51.012 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gD15JBmkddXs3eXL51VnmcibGY3KDT2KY'], 'uuids': ['7302ec69-a391-424d-822e-67f3c9a7295d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138993", "end": "2021-02-24 15:12:50.973996", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gD15JBmkddXs3eXL51VnmcibGY3KDT2KY"], "labels": [], "masters": [], "uuids": ["7302ec69-a391-424d-822e-67f3c9a7295d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:50.835003", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136263 s, 846 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136263 s, 846 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:51.238 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-kRQcDw-rQEZ-xkeJ-YOZy-OBut-Gbol-5fBHl8', 'nvme-INTEL_SSDPEDMD400G4_CVFT6246000E400BGN', 'nvme-nvme.8086-43564654363234363030304534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036873", "end": "2021-02-24 15:12:51.208908", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-kRQcDw-rQEZ-xkeJ-YOZy-OBut-Gbol-5fBHl8", "nvme-INTEL_SSDPEDMD400G4_CVFT6246000E400BGN", "nvme-nvme.8086-43564654363234363030304534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:51.172035", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0342296 s, 3.4 GB/s", "std 2021-02-24T15:12:51.240 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0342296 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:51.568 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gOBU7DJ2SpKTN95yNIl1QK7G1nwGV3bA3'], 'uuids': ['90e18b5a-a2b5-4f09-9349-9fb6aa61fe66'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.142431", "end": "2021-02-24 15:12:51.540613", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gOBU7DJ2SpKTN95yNIl1QK7G1nwGV3bA3"], "labels": [], "masters": [], "uuids": ["90e18b5a-a2b5-4f09-9349-9fb6aa61fe66"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:51.398182", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139827 s, 825 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139827 s, 825 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:51.908 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gFZd1r3ELWr31KgtcZNDTfwL0BcKdbiqu'], 'uuids': ['764a6d89-34ef-4670-82ce-a39631bd2a1f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.150713", "end": "2021-02-24 15:12:51.882566", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gFZd1r3ELWr31KgtcZNDTfwL0BcKdbiqu"], "labels": [], "masters": [], "uuids": ["764a6d89-34ef-4670-82ce-a39631bd2a1f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:51.731853", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148085 s, 779 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148085 s, 779 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:52.089 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-24T15:12:52.091 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7D1BqAZ6Gxqb6P2dQZO0Vr4pGqiahAinyP'], 'uuids': ['19009c17-927f-4576-b930-a253b46d802c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.075971", "end": "2021-02-24 15:12:52.058740", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7D1BqAZ6Gxqb6P2dQZO0Vr4pGqiahAinyP"], "labels": [], "masters": [], "uuids": ["19009c17-927f-4576-b930-a253b46d802c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:50.982769", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-24T15:12:52.136 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:52 +0000 (0:00:01.511) 0:04:32.082 **** 2021-02-24T15:12:52.250 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-24T15:12:52.252 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gKueN2YcoWoCfOB7VxOJ0Cqf5LlW2KsQw'], 'uuids': ['16475221-1ee9-4997-bddd-b85dd00146ba'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.143354", "end": "2021-02-24 15:12:52.217806", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7gKueN2YcoWoCfOB7VxOJ0Cqf5LlW2KsQw"], "labels": [], "masters": [], "uuids": ["16475221-1ee9-4997-bddd-b85dd00146ba"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:52.074452", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140723 s, 820 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140723 s, 820 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:52.273 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTWX', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTWX', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTWX', 'scsi-35000c5009293ee09', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTWX', 'wwn-0x5000c5009293ee09'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTWX', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293ee09', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTWX-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTWX-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTWX-part1', 'scsi-35000c5009293ee09-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTWX-part1', 'wwn-0x5000c5009293ee09-part1'], 'uuids': ['a313f13c-d1e6-43a8-a40a-989733f55ee1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTWX", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTWX", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTWX", "scsi-35000c5009293ee09", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTWX", "wwn-0x5000c5009293ee09"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTWX-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTWX-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-02-24T15:12:52.275 INFO:teuthology.task.ansible.out:Z1W5XTWX-part1", "scsi-35000c5009293ee09-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTWX-part1", "wwn-0x5000c5009293ee09-part1"], "labels": [], "masters": [], "uuids": ["a313f13c-d1e6-43a8-a40a-989733f55ee1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTWX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293ee09"}}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:52.565 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7DgY6zjfzdZGseEdsivZWvC6LLf0qV9kQe'], 'uuids': ['f0b0431a-bca1-4957-aaf0-ef793874c5e3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140328", "end": "2021-02-24 15:12:52.495890", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7DgY6zjfzdZGseEdsivZWvC6LLf0qV9kQe"], "labels": [], "masters": [], "uuids": ["f0b0431a-bca1-4957-aaf0-ef793874c5e3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:52.355562", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137644 s, 838 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137644 s, 838 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:52.644 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7grKrA2oXVbAE4EjNfNdJQGmm1ckuLDATR'], 'uuids': ['cd0bbdc0-3b29-466e-a8e8-1558866bb059'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139914", "end": "2021-02-24 15:12:52.608917", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-skE3qQFqgfQorYr1CVUckUkakIScrL7grKrA2oXVbAE4EjNfNdJQGmm1ckuLDATR"], "labels": [], "masters": [], "uuids": ["cd0bbdc0-3b29-466e-a8e8-1558866bb059"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:52.469003", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137243 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137243 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:52.685 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:52 +0000 (0:00:00.548) 0:04:32.631 **** 2021-02-24T15:12:52.842 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-tu0oic-bGnS-ax1i-zsLI-xM2G-eYTz-rphOqQ', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300JT400BGN', 'nvme-nvme.8086-435646543632333330304a5434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037864", "end": "2021-02-24 15:12:52.811339", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-tu0oic-bGnS-ax1i-zsLI-xM2G-eYTz-rphOqQ", "nvme-INTEL_SSDPEDMD400G4_CVFT623300JT400BGN", "nvme-nvme.8086-435646543632333330304a5434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:52.773475", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0351355 s, 3.3 GB/s", "std 2021-02-24T15:12:52.844 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0351355 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:52.991 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-24T15:12:52.993 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.063373", "end": "2021-02-24 15:12:52.951724", "rc": 0, "start": "2021-02-24 15:12:52.888351", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:53.034 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:53 +0000 (0:00:00.349) 0:04:32.980 **** 2021-02-24T15:12:53.188 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-24T15:12:53.190 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7DkeodvmiZm3d7s2Dq7OYLtfR5xYqCXD2b'], 'uuids': ['655ae3bf-41d2-4dbe-b87c-4331d898dded'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.148597", "end": "2021-02-24 15:12:53.164474", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7DkeodvmiZm3d7s2Dq7OYLtfR5xYqCXD2b"], "labels": [], "masters": [], "uuids": ["655ae3bf-41d2-4dbe-b87c-4331d898dded"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:53.015877", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145984 s, 790 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145984 s, 790 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:53.291 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-24T15:12:53.295 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.040481", "end": "2021-02-24 15:12:53.267234", "rc": 0, "start": "2021-02-24 15:12:53.226753", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:53.345 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:53 +0000 (0:00:00.310) 0:04:33.290 **** 2021-02-24T15:12:53.401 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-24T15:12:53.448 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:53 +0000 (0:00:00.104) 0:04:33.394 **** 2021-02-24T15:12:53.487 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-24T15:12:53.489 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:53.528 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:53 +0000 (0:00:00.079) 0:04:33.474 **** 2021-02-24T15:12:53.548 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-24T15:12:53.549 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7D9I1fn6mgkG2sN5uD78VHEI2AqsPJ8kfy'], 'uuids': ['792c3e31-22f0-4d73-affe-cfaeb05102d8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141742", "end": "2021-02-24 15:12:53.512557", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7D9I1fn6mgkG2sN5uD78VHEI2AqsPJ8kfy"], "labels": [], "masters": [], "uuids": ["792c3e31-22f0-4d73-affe-cfaeb05102d8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:53.370815", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13909 s, 829 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13909 s, 829 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:53.588 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:53.633 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:53 +0000 (0:00:00.104) 0:04:33.579 **** 2021-02-24T15:12:53.682 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-24T15:12:53.684 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:53.719 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:53 +0000 (0:00:00.086) 0:04:33.665 **** 2021-02-24T15:12:53.757 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-24T15:12:53.759 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:53.794 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:53 +0000 (0:00:00.072) 0:04:33.738 **** 2021-02-24T15:12:53.888 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-24T15:12:53.890 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7De3Mlbf0eeseMFwGR06n2ZNcO26NVMq1M'], 'uuids': ['2989c25e-f757-4f07-94bf-06cf81171496'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.143046", "end": "2021-02-24 15:12:53.863559", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7De3Mlbf0eeseMFwGR06n2ZNcO26NVMq1M"], "labels": [], "masters": [], "uuids": ["2989c25e-f757-4f07-94bf-06cf81171496"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:53.720513", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140368 s, 822 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140368 s, 822 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:53.900 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XEKT', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XEKT', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XEKT', 'scsi-35000c50092928022', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XEKT', 'wwn-0x5000c50092928022'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XEKT', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092928022', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XEKT-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XEKT-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XEKT-part1', 'scsi-35000c50092928022-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XEKT-part1', 'wwn-0x5000c50092928022-part1'], 'uuids': ['a313f13c-d1e6-43a8-a40a-989733f55ee1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XEKT", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XEKT", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XEKT", "scsi-35000c50092928022", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XEKT", "wwn-0x5000c50092928022"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XEKT-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XEKT-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-02-24T15:12:53.902 INFO:teuthology.task.ansible.out:Z1W5XEKT-part1", "scsi-35000c50092928022-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XEKT-part1", "wwn-0x5000c50092928022-part1"], "labels": [], "masters": [], "uuids": ["a313f13c-d1e6-43a8-a40a-989733f55ee1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XEKT", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092928022"}}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:53.997 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-24T15:12:53.998 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:12:54.053 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.257) 0:04:33.996 **** 2021-02-24T15:12:54.118 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-24T15:12:54.119 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356150272, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137732, 'block_used': 12957376, 'inode_total': 61054976, 'inode_available': 60986354, 'inode_used': 68622, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137732, "block_size": 4096, "block_total": 240095108, "block_used": 12957376, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986354, "inode_total": 61054976, "inode_used": 68622, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356150272, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:54.162 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.112) 0:04:34.108 **** 2021-02-24T15:12:54.212 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-24T15:12:54.213 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:54.254 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.091) 0:04:34.200 **** 2021-02-24T15:12:54.260 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-24T15:12:54.263 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7D1BqAZ6Gxqb6P2dQZO0Vr4pGqiahAinyP'], 'uuids': ['19009c17-927f-4576-b930-a253b46d802c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.142221", "end": "2021-02-24 15:12:54.212116", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ZT07HwyuFTUILUJvjCkJGDxodU0o6G7D1BqAZ6Gxqb6P2dQZO0Vr4pGqiahAinyP"], "labels": [], "masters": [], "uuids": ["19009c17-927f-4576-b930-a253b46d802c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-24 15:12:54.069895", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13958 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13958 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:54.326 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.072) 0:04:34.272 **** 2021-02-24T15:12:54.334 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:12:54.336 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:54.379 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.052) 0:04:34.325 **** 2021-02-24T15:12:54.435 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:12:54.437 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:54.475 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.096) 0:04:34.421 **** 2021-02-24T15:12:54.512 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-24T15:12:54.514 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:54.550 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.074) 0:04:34.496 **** 2021-02-24T15:12:54.592 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-24T15:12:54.594 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.068796", "end": "2021-02-24 15:12:54.560361", "rc": 0, "start": "2021-02-24 15:12:54.491565", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:54.635 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.085) 0:04:34.581 **** 2021-02-24T15:12:54.680 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.044) 0:04:34.625 **** 2021-02-24T15:12:54.718 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-24T15:12:54.720 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:54.756 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.076) 0:04:34.702 **** 2021-02-24T15:12:54.887 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-24T15:12:54.888 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.050101", "end": "2021-02-24 15:12:54.856052", "rc": 0, "start": "2021-02-24 15:12:54.805951", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:12:54.926 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.169) 0:04:34.872 **** 2021-02-24T15:12:54.956 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-24T15:12:55.004 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:54 +0000 (0:00:00.077) 0:04:34.949 **** 2021-02-24T15:12:55.044 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-24T15:12:55.046 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:55.080 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.076) 0:04:35.026 **** 2021-02-24T15:12:55.118 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-24T15:12:55.120 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:55.153 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.072) 0:04:35.099 **** 2021-02-24T15:12:55.191 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-24T15:12:55.193 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:55.239 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.081) 0:04:35.180 **** 2021-02-24T15:12:55.277 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-24T15:12:55.279 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:55.319 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.083) 0:04:35.264 **** 2021-02-24T15:12:55.484 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-24T15:12:55.486 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-24T15:12:55.521 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.203) 0:04:35.467 **** 2021-02-24T15:12:55.528 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-24T15:12:55.538 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-24T15:12:55.573 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.051) 0:04:35.519 **** 2021-02-24T15:12:55.626 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-24T15:12:55.628 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356129792, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137727, 'block_used': 12957381, 'inode_total': 61054976, 'inode_available': 60986350, 'inode_used': 68626, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137727, "block_size": 4096, "block_total": 240095108, "block_used": 12957381, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986350, "inode_total": 61054976, "inode_used": 68626, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356129792, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:55.666 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.092) 0:04:35.611 **** 2021-02-24T15:12:55.704 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-24T15:12:55.707 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:55.740 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.075) 0:04:35.686 **** 2021-02-24T15:12:55.779 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:12:55.781 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:55.815 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.074) 0:04:35.761 **** 2021-02-24T15:12:55.854 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:12:55.856 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:55.890 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.075) 0:04:35.836 **** 2021-02-24T15:12:55.928 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-24T15:12:55.930 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:55.963 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:55 +0000 (0:00:00.073) 0:04:35.909 **** 2021-02-24T15:12:55.991 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:56.025 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:56 +0000 (0:00:00.061) 0:04:35.971 **** 2021-02-24T15:12:56.052 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-24T15:12:56.054 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:56.086 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:56 +0000 (0:00:00.060) 0:04:36.032 **** 2021-02-24T15:12:56.176 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-24T15:12:56.178 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:56.503 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:56.525 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-24T15:12:56.526 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-24T15:12:56.560 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:56 +0000 (0:00:00.474) 0:04:36.506 **** 2021-02-24T15:12:56.842 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-24T15:12:56.844 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:56.928 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:57.171 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:57.257 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:57.510 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:57.547 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:57 +0000 (0:00:00.985) 0:04:37.492 **** 2021-02-24T15:12:57.599 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:57.747 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-24T15:12:57.749 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-24T15:12:57.787 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:57 +0000 (0:00:00.240) 0:04:37.733 **** 2021-02-24T15:12:57.952 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:58.006 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-24T15:12:58.187 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-24T15:12:58.314 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-24T15:12:58.316 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-24T15:12:58.359 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:58 +0000 (0:00:00.571) 0:04:38.305 **** 2021-02-24T15:12:58.372 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-24T15:12:58.374 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-24T15:12:58.544 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-24T15:12:58.556 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:58.559 INFO:teuthology.task.ansible.out: 2021-02-24T15:12:58.567 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-24T15:12:58.570 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-24T15:12:58.603 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:58 +0000 (0:00:00.243) 0:04:38.549 **** 2021-02-24T15:12:58.636 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:58 +0000 (0:00:00.033) 0:04:38.582 **** 2021-02-24T15:12:58.666 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-02-24T15:12:58.668 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:58.701 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:58 +0000 (0:00:00.064) 0:04:38.647 **** 2021-02-24T15:12:58.741 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-24T15:12:58.746 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:58.777 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:58 +0000 (0:00:00.075) 0:04:38.723 **** 2021-02-24T15:12:58.817 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-24T15:12:58.819 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-24T15:12:58.997 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-24T15:12:59.009 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:12:59.051 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:59 +0000 (0:00:00.270) 0:04:38.994 **** 2021-02-24T15:12:59.096 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-24T15:12:59.098 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-24T15:12:59.145 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:59 +0000 (0:00:00.097) 0:04:39.091 **** 2021-02-24T15:12:59.257 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-24T15:12:59.259 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-24T15:12:59.451 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-24T15:12:59.462 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:59.502 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:59 +0000 (0:00:00.356) 0:04:39.448 **** 2021-02-24T15:12:59.533 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-02-24T15:12:59.534 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:59.568 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:59 +0000 (0:00:00.065) 0:04:39.514 **** 2021-02-24T15:12:59.617 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-24T15:12:59.619 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:12:59.662 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:59 +0000 (0:00:00.093) 0:04:39.608 **** 2021-02-24T15:12:59.887 INFO:teuthology.task.ansible.out: 2021-02-24T15:12:59.888 INFO:teuthology.task.ansible.out:TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:12:59.922 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:12:59 +0000 (0:00:00.260) 0:04:39.868 **** 2021-02-24T15:12:59.965 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-24T15:12:59.967 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-24T15:13:00.007 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:00 +0000 (0:00:00.085) 0:04:39.953 **** 2021-02-24T15:13:00.299 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi152.front.sepia.ceph.com] => {"changed": true} 2021-02-24T15:13:00.337 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:00 +0000 (0:00:00.330) 0:04:40.283 **** 2021-02-24T15:13:00.785 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true} 2021-02-24T15:13:00.824 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:00 +0000 (0:00:00.486) 0:04:40.770 **** 2021-02-24T15:13:00.960 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-24T15:13:00.999 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:00 +0000 (0:00:00.173) 0:04:40.943 **** 2021-02-24T15:13:01.057 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.096 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.097) 0:04:41.041 **** 2021-02-24T15:13:01.122 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-02-24T15:13:01.124 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.159 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.064) 0:04:41.105 **** 2021-02-24T15:13:01.196 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-24T15:13:01.198 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-24T15:13:01.238 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.078) 0:04:41.184 **** 2021-02-24T15:13:01.247 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-24T15:13:01.248 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.293 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.055) 0:04:41.239 **** 2021-02-24T15:13:01.303 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-24T15:13:01.305 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.343 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.049) 0:04:41.289 **** 2021-02-24T15:13:01.350 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-24T15:13:01.352 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.395 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.052) 0:04:41.341 **** 2021-02-24T15:13:01.432 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.449 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.054) 0:04:41.395 **** 2021-02-24T15:13:01.457 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-02-24T15:13:01.459 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.520 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.070) 0:04:41.466 **** 2021-02-24T15:13:01.530 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-24T15:13:01.531 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.570 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.049) 0:04:41.516 **** 2021-02-24T15:13:01.578 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-24T15:13:01.580 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.618 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.048) 0:04:41.564 **** 2021-02-24T15:13:01.620 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:01.626 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-24T15:13:01.628 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.675 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.057) 0:04:41.621 **** 2021-02-24T15:13:01.683 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-24T15:13:01.685 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.721 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.045) 0:04:41.667 **** 2021-02-24T15:13:01.729 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-02-24T15:13:01.731 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.774 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.053) 0:04:41.720 **** 2021-02-24T15:13:01.783 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-24T15:13:01.784 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.834 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.059) 0:04:41.780 **** 2021-02-24T15:13:01.838 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:01.853 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-24T15:13:01.855 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.892 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.058) 0:04:41.838 **** 2021-02-24T15:13:01.900 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-24T15:13:01.902 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:01.947 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:01 +0000 (0:00:00.054) 0:04:41.893 **** 2021-02-24T15:13:01.978 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.025 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.078) 0:04:41.971 **** 2021-02-24T15:13:02.044 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-24T15:13:02.046 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.086 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.060) 0:04:42.032 **** 2021-02-24T15:13:02.093 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-24T15:13:02.095 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.134 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.047) 0:04:42.080 **** 2021-02-24T15:13:02.142 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-02-24T15:13:02.143 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.186 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.051) 0:04:42.132 **** 2021-02-24T15:13:02.200 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-24T15:13:02.202 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.276 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.090) 0:04:42.222 **** 2021-02-24T15:13:02.299 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.337 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.057) 0:04:42.280 **** 2021-02-24T15:13:02.343 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.379 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.044) 0:04:42.325 **** 2021-02-24T15:13:02.386 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-24T15:13:02.388 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.426 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.047) 0:04:42.372 **** 2021-02-24T15:13:02.436 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-02-24T15:13:02.438 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.495 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.068) 0:04:42.441 **** 2021-02-24T15:13:02.497 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:02.510 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:02.512 INFO:teuthology.task.ansible.out:TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.562 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.067) 0:04:42.508 **** 2021-02-24T15:13:02.582 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-24T15:13:02.584 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.620 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.058) 0:04:42.566 **** 2021-02-24T15:13:02.629 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-24T15:13:02.632 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.672 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.051) 0:04:42.618 **** 2021-02-24T15:13:02.681 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-24T15:13:02.683 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.721 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.049) 0:04:42.667 **** 2021-02-24T15:13:02.783 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-24T15:13:02.785 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.828 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.106) 0:04:42.774 **** 2021-02-24T15:13:02.878 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-24T15:13:02.880 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:02.924 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:02 +0000 (0:00:00.095) 0:04:42.870 **** 2021-02-24T15:13:03.260 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-24T15:13:03.262 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-02-24T15:13:03.313 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:03 +0000 (0:00:00.389) 0:04:43.259 **** 2021-02-24T15:13:03.486 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-02-24T15:13:03.524 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:03 +0000 (0:00:00.210) 0:04:43.470 **** 2021-02-24T15:13:03.633 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-24T15:13:03.634 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-02-24 15:07:57 UTC", "ActiveEnterTimestampMonotonic": "12936232", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount ntpd.service systemd-tmpfiles-setup.service ntpdate.service basic.target systemd-journald.socket system.slice sntp.service tmp.mount sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-02-24 15:07:56 UTC", "AssertTimestampMonotonic": "11998953", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-02-24 15:07:56 UTC", "ConditionTimestampMonotonic": "11998840", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0 2021-02-24T15:13:03.636 INFO:teuthology.task.ansible.out:", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "901", "ExecMainStartTimestamp": "Wed 2021-02-24 15:07:57 UTC", "ExecMainStartTimestampMonotonic": "12894263", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-02-24 15:07:56 UTC", "InactiveExitTimestampMonotonic": "12018738", "InvocationID": "afa380b850274d9aa60e9ef52000660d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity 2021-02-24T15:13:03.638 INFO:teuthology.task.ansible.out:", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "901", "MemoryAccounting": "yes", "MemoryCurrent": "3440640", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOn 2021-02-24T15:13:03.639 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-02-24 15:07:57 UTC", "StateChangeTimestampMonotonic": "12936232", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-02-24 15:07:57 UTC", "WatchdogTimestampMonotonic": "12894279", "WatchdogUSec": "0"}} 2021-02-24T15:13:03.682 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:03 +0000 (0:00:00.158) 0:04:43.628 **** 2021-02-24T15:13:03.723 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:13:03.725 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-24T15:13:03.760 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:03 +0000 (0:00:00.078) 0:04:43.706 **** 2021-02-24T15:13:03.822 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:13:03.824 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-02-24T15:13:03.859 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:03 +0000 (0:00:00.098) 0:04:43.805 **** 2021-02-24T15:13:03.886 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-24T15:13:03.887 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-02-24 15:07:51 UTC", "ActiveEnterTimestampMonotonic": "12824463", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket ntpd.service sysinit.target basic.target system.slice systemd-tmpfiles-setup.service sntp.service -.mount tmp.mount ntpdate.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-02-24 15:07:50 UTC", "AssertTimestampMonotonic": "11624245", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-02-24 15:07:50 UTC", "ConditionTimestampMonotonic": "11624185", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0 2021-02-24T15:13:03.889 INFO:teuthology.task.ansible.out:", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "892", "ExecMainStartTimestamp": "Wed 2021-02-24 15:07:51 UTC", "ExecMainStartTimestampMonotonic": "12763815", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-02-24 15:07:50 UTC", "InactiveExitTimestampMonotonic": "11628015", "InvocationID": "a8cd1e28b8c24996b7d3eceecb95db7e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity 2021-02-24T15:13:03.890 INFO:teuthology.task.ansible.out:", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "892", "MemoryAccounting": "yes", "MemoryCurrent": "3301376", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOn 2021-02-24T15:13:03.892 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-02-24 15:07:51 UTC", "StateChangeTimestampMonotonic": "12824463", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-02-24 15:07:51 UTC", "WatchdogTimestampMonotonic": "12763825", "WatchdogUSec": "0"}} 2021-02-24T15:13:03.928 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:03 +0000 (0:00:00.068) 0:04:43.874 **** 2021-02-24T15:13:03.944 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:03.980 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:03 +0000 (0:00:00.052) 0:04:43.926 **** 2021-02-24T15:13:03.990 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:13:03.991 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-24T15:13:04.031 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:04 +0000 (0:00:00.050) 0:04:43.977 **** 2021-02-24T15:13:04.041 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-24T15:13:04.043 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:04.101 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:04 +0000 (0:00:00.069) 0:04:44.047 **** 2021-02-24T15:13:04.110 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-02-24T15:13:04.155 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:04 +0000 (0:00:00.053) 0:04:44.101 **** 2021-02-24T15:13:04.163 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:04.218 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:04 +0000 (0:00:00.063) 0:04:44.164 **** 2021-02-24T15:13:04.227 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-24T15:13:04.229 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:04.268 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:04 +0000 (0:00:00.049) 0:04:44.214 **** 2021-02-24T15:13:04.296 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:04.297 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:04.336 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:04 +0000 (0:00:00.067) 0:04:44.282 **** 2021-02-24T15:13:04.365 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-02-24T15:13:04.367 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:04.405 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:04 +0000 (0:00:00.069) 0:04:44.351 **** 2021-02-24T15:13:04.437 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-24T15:13:04.441 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-02-24T15:13:04.475 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:04 +0000 (0:00:00.069) 0:04:44.421 **** 2021-02-24T15:13:04.610 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-02-24T15:13:04.646 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:04 +0000 (0:00:00.171) 0:04:44.592 **** 2021-02-24T15:13:05.030 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-24T15:13:05.032 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-02-24T15:13:05.084 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:05 +0000 (0:00:00.437) 0:04:45.030 **** 2021-02-24T15:13:05.252 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-02-24T15:13:05.301 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:05 +0000 (0:00:00.217) 0:04:45.247 **** 2021-02-24T15:13:06.512 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-24T15:13:06.514 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python 2021-02-24T15:13:06.515 INFO:teuthology.task.ansible.out:3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-24T15:13:06.557 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:06 +0000 (0:00:01.251) 0:04:46.499 **** 2021-02-24T15:13:06.598 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:06 +0000 (0:00:00.044) 0:04:46.544 **** 2021-02-24T15:13:06.620 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-24T15:13:06.622 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:06.660 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:06 +0000 (0:00:00.062) 0:04:46.606 **** 2021-02-24T15:13:06.670 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:06.709 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:06 +0000 (0:00:00.048) 0:04:46.655 **** 2021-02-24T15:13:06.719 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-24T15:13:06.721 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-02-24T15:13:06.773 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:06 +0000 (0:00:00.064) 0:04:46.719 **** 2021-02-24T15:13:06.782 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-02-24T15:13:06.915 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:06 +0000 (0:00:00.141) 0:04:46.861 **** 2021-02-24T15:13:07.041 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-24T15:13:07.042 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-24T15:13:07.101 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.186) 0:04:47.047 **** 2021-02-24T15:13:07.158 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-24T15:13:07.221 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.119) 0:04:47.167 **** 2021-02-24T15:13:07.232 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-24T15:13:07.242 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:07.279 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.058) 0:04:47.225 **** 2021-02-24T15:13:07.287 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:07.337 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.058) 0:04:47.283 **** 2021-02-24T15:13:07.348 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:07.356 INFO:teuthology.task.ansible.out:TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-24T15:13:07.358 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-24T15:13:07.420 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.082) 0:04:47.366 **** 2021-02-24T15:13:07.447 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-24T15:13:07.488 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.068) 0:04:47.434 **** 2021-02-24T15:13:07.495 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-24T15:13:07.497 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:07.536 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.047) 0:04:47.482 **** 2021-02-24T15:13:07.552 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:07.637 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.100) 0:04:47.583 **** 2021-02-24T15:13:07.764 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-24T15:13:07.799 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.162) 0:04:47.745 **** 2021-02-24T15:13:07.914 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-24T15:13:08.009 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:07 +0000 (0:00:00.194) 0:04:47.955 **** 2021-02-24T15:13:08.048 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-24T15:13:08.050 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-24T15:13:08.119 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:08 +0000 (0:00:00.109) 0:04:48.065 **** 2021-02-24T15:13:08.251 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-24T15:13:08.253 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.306 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:08 +0000 (0:00:00.186) 0:04:48.252 **** 2021-02-24T15:13:08.314 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-24T15:13:08.316 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-24T15:13:08.318 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:08.409 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:08 +0000 (0:00:00.102) 0:04:48.355 **** 2021-02-24T15:13:08.428 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-24T15:13:08.430 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.441 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.481 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.487 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.550 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:08 +0000 (0:00:00.139) 0:04:48.494 **** 2021-02-24T15:13:08.557 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.622 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:08 +0000 (0:00:00.074) 0:04:48.568 **** 2021-02-24T15:13:08.660 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-24T15:13:08.662 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.672 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.673 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.684 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.700 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.798 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:08 +0000 (0:00:00.175) 0:04:48.744 **** 2021-02-24T15:13:08.823 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-24T15:13:08.825 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi181.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.828 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.870 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.884 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-02-24T15:13:08.978 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:08 +0000 (0:00:00.179) 0:04:48.924 **** 2021-02-24T15:13:08.984 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:13:08.986 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.065 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.086) 0:04:49.011 **** 2021-02-24T15:13:09.107 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-24T15:13:09.109 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.110 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.111 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.128 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.130 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.171 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.106) 0:04:49.117 **** 2021-02-24T15:13:09.178 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-24T15:13:09.180 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.219 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.047) 0:04:49.165 **** 2021-02-24T15:13:09.241 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-24T15:13:09.243 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.321 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.101) 0:04:49.267 **** 2021-02-24T15:13:09.336 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-24T15:13:09.337 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.406 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.085) 0:04:49.352 **** 2021-02-24T15:13:09.415 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-24T15:13:09.417 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.456 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.050) 0:04:49.402 **** 2021-02-24T15:13:09.464 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.524 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.067) 0:04:49.470 **** 2021-02-24T15:13:09.537 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-24T15:13:09.539 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.612 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.087) 0:04:49.558 **** 2021-02-24T15:13:09.633 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:09.636 INFO:teuthology.task.ansible.out:TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.685 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.073) 0:04:49.631 **** 2021-02-24T15:13:09.693 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-24T15:13:09.695 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.733 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.047) 0:04:49.679 **** 2021-02-24T15:13:09.741 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-24T15:13:09.744 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.780 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.047) 0:04:49.726 **** 2021-02-24T15:13:09.788 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.830 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.050) 0:04:49.776 **** 2021-02-24T15:13:09.838 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-24T15:13:09.840 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.876 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.046) 0:04:49.822 **** 2021-02-24T15:13:09.879 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:09.887 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-24T15:13:09.888 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.929 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.052) 0:04:49.875 **** 2021-02-24T15:13:09.936 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:09.938 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:09.973 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:09 +0000 (0:00:00.043) 0:04:49.919 **** 2021-02-24T15:13:09.985 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-24T15:13:09.986 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:10.031 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:10 +0000 (0:00:00.057) 0:04:49.977 **** 2021-02-24T15:13:10.084 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:10.119 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:10 +0000 (0:00:00.088) 0:04:50.065 **** 2021-02-24T15:13:10.225 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-24T15:13:10.227 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005003", "end": "2021-02-24 15:13:10.176861", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-24 15:13:10.171858", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:10.353 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005059", "end": "2021-02-24 15:13:10.314972", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-24 15:13:10.309913", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:10.396 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003004", "end": "2021-02-24 15:13:10.363412", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-24 15:13:10.360408", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:10.522 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003170", "end": "2021-02-24 15:13:10.493158", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-24 15:13:10.489988", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:10.580 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002889", "end": "2021-02-24 15:13:10.538923", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-24 15:13:10.536034", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:10.712 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002873", "end": "2021-02-24 15:13:10.685293", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-24 15:13:10.682420", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:10.755 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003115", "end": "2021-02-24 15:13:10.721426", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-24 15:13:10.718311", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:10.798 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:10 +0000 (0:00:00.678) 0:04:50.744 **** 2021-02-24T15:13:10.829 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-24T15:13:10.864 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:10 +0000 (0:00:00.065) 0:04:50.810 **** 2021-02-24T15:13:10.894 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-24T15:13:10.896 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003199", "end": "2021-02-24 15:13:10.864981", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-24 15:13:10.861782", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:10.934 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:10 +0000 (0:00:00.069) 0:04:50.880 **** 2021-02-24T15:13:10.972 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-24T15:13:11.015 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:11 +0000 (0:00:00.081) 0:04:50.961 **** 2021-02-24T15:13:11.087 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-24T15:13:11.089 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-24T15:13:11.211 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-24T15:13:11.324 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-02-24T15:13:11.362 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:11 +0000 (0:00:00.346) 0:04:51.308 **** 2021-02-24T15:13:11.399 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:11 +0000 (0:00:00.037) 0:04:51.345 **** 2021-02-24T15:13:12.031 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:12.033 INFO:teuthology.task.ansible.out:TASK [Gathering Facts] ********************************************************* ok: [smithi152.front.sepia.ceph.com] 2021-02-24T15:13:12.135 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:12 +0000 (0:00:00.735) 0:04:52.081 **** 2021-02-24T15:13:12.148 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] 2021-02-24T15:13:12.194 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-24T15:13:12.196 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:12.232 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:12 +0000 (0:00:00.097) 0:04:52.178 **** 2021-02-24T15:13:12.234 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:12.293 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:12 +0000 (0:00:00.060) 0:04:52.239 **** 2021-02-24T15:13:12.303 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-24T15:13:12.304 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-02-24T15:13:12.347 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:12 +0000 (0:00:00.054) 0:04:52.293 **** 2021-02-24T15:13:12.355 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-24T15:13:12.356 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:12.399 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:12 +0000 (0:00:00.051) 0:04:52.345 **** 2021-02-24T15:13:12.409 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-24T15:13:12.412 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-02-24T15:13:12.449 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:12 +0000 (0:00:00.050) 0:04:52.395 **** 2021-02-24T15:13:12.457 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-02-24T15:13:12.503 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:12 +0000 (0:00:00.052) 0:04:52.448 **** 2021-02-24T15:13:12.563 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:12.565 INFO:teuthology.task.ansible.out:TASK [container-host : Including distro specific variables] ******************** ok: [smithi181.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-02-24T15:13:12.611 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:12 +0000 (0:00:00.109) 0:04:52.557 **** 2021-02-24T15:13:12.613 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:13.553 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:13.555 INFO:teuthology.task.ansible.out:TASK [container-host : Install container packages] ***************************** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: podman", "Installed: podman-docker"]} 2021-02-24T15:13:13.595 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:13 +0000 (0:00:00.983) 0:04:53.541 **** 2021-02-24T15:13:13.637 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-24T15:13:13.639 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-02-24T15:13:13.674 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:13 +0000 (0:00:00.079) 0:04:53.620 **** 2021-02-24T15:13:13.685 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-24T15:13:13.686 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: podman", "Installed: podman-docker"]} 2021-02-24T15:13:13.724 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:13 +0000 (0:00:00.049) 0:04:53.670 **** 2021-02-24T15:13:13.736 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-24T15:13:13.737 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:13.779 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:13 +0000 (0:00:00.055) 0:04:53.725 **** 2021-02-24T15:13:13.787 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-24T15:13:13.789 INFO:teuthology.task.ansible.out:ok: [smithi181.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-02-24T15:13:13.832 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:13 +0000 (0:00:00.053) 0:04:53.778 **** 2021-02-24T15:13:13.863 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-24T15:13:13.865 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:13.911 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:13 +0000 (0:00:00.078) 0:04:53.857 **** 2021-02-24T15:13:14.016 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-24T15:13:14.024 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:13:14.154 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:13:14.197 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:13:14.256 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:14 +0000 (0:00:00.345) 0:04:54.202 **** 2021-02-24T15:13:14.360 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-24T15:13:14.403 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:14 +0000 (0:00:00.147) 0:04:54.349 **** 2021-02-24T15:13:14.840 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** changed: [smithi152.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179594.3151593-124412249529816/source", "state": "file", "uid": 0} 2021-02-24T15:13:14.842 INFO:teuthology.task.ansible.out: 2021-02-24T15:13:15.000 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179594.4652803-172098324561647/source", "state": "file", "uid": 0} 2021-02-24T15:13:15.416 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179594.8488338-154357093282416/source", "state": "file", "uid": 0} 2021-02-24T15:13:15.473 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:15 +0000 (0:00:01.069) 0:04:55.419 **** 2021-02-24T15:13:15.617 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1614179594.9929152-150479017246074/source", "state": "file", "uid": 0} 2021-02-24T15:13:15.671 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:15 +0000 (0:00:00.197) 0:04:55.617 **** 2021-02-24T15:13:18.721 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-24T15:13:18.723 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-4xg_fulg-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-4xg_fulg-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files. 2021-02-24T15:13:18.725 INFO:teuthology.task.ansible.out:pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-02-24T15:13:18.809 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:18 +0000 (0:00:03.138) 0:04:58.755 **** 2021-02-24T15:13:18.926 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-24T15:13:18.928 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Install registries-conf-ctl] **************************** changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-p86h2qvd-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-p86h2qvd-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted. 2021-02-24T15:13:18.929 INFO:teuthology.task.ansible.out:org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-02-24T15:13:19.005 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:18 +0000 (0:00:00.196) 0:04:58.951 **** 2021-02-24T15:13:19.059 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:19 +0000 (0:00:00.053) 0:04:59.004 **** 2021-02-24T15:13:19.079 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-02-24T15:13:19.081 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:19.170 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:19 +0000 (0:00:00.111) 0:04:59.116 **** 2021-02-24T15:13:19.180 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-24T15:13:19.182 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:19.233 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:19 +0000 (0:00:00.063) 0:04:59.179 **** 2021-02-24T15:13:19.289 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:19.355 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:19 +0000 (0:00:00.121) 0:04:59.301 **** 2021-02-24T15:13:19.609 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-24T15:13:19.611 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.168869", "end": "2021-02-24 15:13:19.582012", "rc": 0, "start": "2021-02-24 15:13:19.413143", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:19.676 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:19 +0000 (0:00:00.320) 0:04:59.622 **** 2021-02-24T15:13:19.732 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-02-24T15:13:19.734 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:19.819 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-24T15:13:19.821 INFO:teuthology.task.ansible.out:changed: [smithi181.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.167368", "end": "2021-02-24 15:13:19.756309", "rc": 0, "start": "2021-02-24 15:13:19.588941", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-24T15:13:19.855 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:19 +0000 (0:00:00.179) 0:04:59.801 **** 2021-02-24T15:13:19.895 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-02-24T15:13:19.897 INFO:teuthology.task.ansible.out:skipping: [smithi181.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-24T15:13:20.005 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-02-24T15:13:20.009 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-02-24T15:13:20.014 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi152.front.sepia.ceph.com : ok=126 changed=46 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 smithi181.front.sepia.ceph.com : ok=126 changed=46 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 2021-02-24T15:13:20.015 INFO:teuthology.task.ansible.out:Wednesday 24 February 2021 15:13:20 +0000 (0:00:00.158) 0:04:59.960 **** =============================================================================== testnode : Install packages -------------------------------------------- 42.21s common : nrpe - Ensure SELinux policy is up to date -------------------- 38.35s users : Create all admin users with sudo access. ----------------------- 31.47s users : Update authorized_keys using the keys repo --------------------- 29.21s common : nrpe - Remove SELinux policy package -------------------------- 16.79s common : nrpe - Load SELinux policy package ---------------------------- 16.69s users : Remove revoked users ------------------------------------------- 11.60s common : Install Kerberos Packages (RedHat) ----------------------------- 7.12s testnode : Zap all non-root disks --------------------------------------- 6.33s testnode : Make sure rpm dependencies are installed --------------------- 4.10s container-host : Install registries-conf-ctl ---------------------------- 3.14s common : nrpe - Install SELinux dependencies ---------------------------- 2.97s common : Make sure smartmontools is installed --------------------------- 2.63s testnode : Ensure ceph packages are not present. ------------------------ 2.17s testnode : Rebuild rpmdb ------------------------------------------------ 2.09s testnode : Ensure ceph dependency packages are not present. ------------- 1.91s users : Update authorized_keys for each user with literal keys ---------- 1.84s Gathering Facts --------------------------------------------------------- 1.59s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.29s testnode : Configure local mirrorlists ---------------------------------- 1.28s 2021-02-24T15:13:20.411 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2021-02-24T15:13:20.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:13:20.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-24T15:13:20.489 DEBUG:teuthology.orchestra.run.smithi152:> true 2021-02-24T15:13:20.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:13:20.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-24T15:13:20.664 DEBUG:teuthology.orchestra.run.smithi181:> true 2021-02-24T15:13:20.761 INFO:teuthology.run_tasks:Running task clock... 2021-02-24T15:13:20.772 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-02-24T15:13:20.773 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-24T15:13:20.775 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-24T15:13:20.813 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-02-24T15:13:20.830 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-02-24T15:13:20.866 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2021-02-24T15:13:20.877 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2021-02-24T15:13:20.892 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-02-24T15:13:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-02-24T15:13:20.964 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2021-02-24T15:13:20.967 INFO:teuthology.orchestra.run.smithi152.stdout:210 Number of sources = 4 2021-02-24T15:13:20.968 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-24T15:13:20.968 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2021-02-24T15:13:20.968 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-24T15:13:20.968 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-24T15:13:20.969 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-24T15:13:20.969 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-24T15:13:20.969 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-24T15:13:20.970 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-24T15:13:21.004 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-02-24T15:13:21.020 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-02-24T15:13:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2021-02-24T15:13:21.067 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2021-02-24T15:13:21.082 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-02-24T15:13:21.096 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-02-24T15:13:21.155 INFO:teuthology.orchestra.run.smithi181.stderr:bash: ntpq: command not found 2021-02-24T15:13:21.158 INFO:teuthology.orchestra.run.smithi181.stdout:210 Number of sources = 4 2021-02-24T15:13:21.159 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-24T15:13:21.159 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2021-02-24T15:13:21.159 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-24T15:13:21.159 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-24T15:13:21.160 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-24T15:13:21.160 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-24T15:13:21.160 INFO:teuthology.run_tasks:Running task install... 2021-02-24T15:13:21.210 DEBUG:teuthology.task.install:project ceph 2021-02-24T15:13:21.211 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'c089f21ba7ed78502aadcbf90668ca79817e877e'}} 2021-02-24T15:13:21.211 DEBUG:teuthology.task.install:config {'sha1': 'c089f21ba7ed78502aadcbf90668ca79817e877e'} 2021-02-24T15:13:21.212 INFO:teuthology.task.install:Using flavor: basic 2021-02-24T15:13:21.224 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-02-24T15:13:21.225 INFO:teuthology.task.install:extra packages: [] 2021-02-24T15:13:21.225 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2021-02-24T15:13:21.263 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS 2021-02-24T15:13:21.264 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-24T15:13:21.265 DEBUG:teuthology.orchestra.run.smithi181:> sudo lsb_release -is 2021-02-24T15:13:21.265 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c089f21ba7ed78502aadcbf90668ca79817e877e', 'tag': None, 'wait_for_package': False} 2021-02-24T15:13:21.266 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2021-02-24T15:13:21.300 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS 2021-02-24T15:13:21.301 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-24T15:13:21.301 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c089f21ba7ed78502aadcbf90668ca79817e877e', 'tag': None, 'wait_for_package': False} 2021-02-24T15:13:21.302 DEBUG:teuthology.orchestra.run.smithi181:> sudo lsb_release -is 2021-02-24T15:13:21.337 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS 2021-02-24T15:13:21.338 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-24T15:13:21.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c089f21ba7ed78502aadcbf90668ca79817e877e 2021-02-24T15:13:21.375 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS 2021-02-24T15:13:21.376 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-24T15:13:21.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c089f21ba7ed78502aadcbf90668ca79817e877e 2021-02-24T15:13:21.508 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-sage-testing-2021-02-23-1850/c089f21ba7ed78502aadcbf90668ca79817e877e/centos/8/flavors/default/ 2021-02-24T15:13:21.509 INFO:teuthology.task.install.rpm:Package version is 17.0.0-1076.gc089f21b 2021-02-24T15:13:21.546 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-sage-testing-2021-02-23-1850/c089f21ba7ed78502aadcbf90668ca79817e877e/centos/8/flavors/default/ 2021-02-24T15:13:21.546 INFO:teuthology.task.install.rpm:Package version is 17.0.0-1076.gc089f21b 2021-02-24T15:13:21.667 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-sage-testing-2021-02-23-1850/c089f21ba7ed78502aadcbf90668ca79817e877e/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-sage-testing-2021-02-23-1850/c089f21ba7ed78502aadcbf90668ca79817e877e/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-sage-testing-2021-02-23-1850/c089f21ba7ed78502aadcbf90668ca79817e877e/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-02-24T15:13:21.668 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:13:21.668 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-02-24T15:13:21.676 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-sage-testing-2021-02-23-1850/c089f21ba7ed78502aadcbf90668ca79817e877e/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-sage-testing-2021-02-23-1850/c089f21ba7ed78502aadcbf90668ca79817e877e/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-sage-testing-2021-02-23-1850/c089f21ba7ed78502aadcbf90668ca79817e877e/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-02-24T15:13:21.677 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:13:21.678 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-02-24T15:13:21.694 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-02-24T15:13:21.695 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c089f21ba7ed78502aadcbf90668ca79817e877e/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-02-24T15:13:21.706 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-02-24T15:13:21.706 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c089f21ba7ed78502aadcbf90668ca79817e877e/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-02-24T15:13:21.760 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-02-24T15:13:21.772 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-02-24T15:13:21.836 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-02-24T15:13:21.848 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-02-24T15:13:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2021-02-24T15:13:21.901 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2021-02-24T15:13:21.912 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2021-02-24T15:13:21.913 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2021-02-24T15:13:22.237 INFO:teuthology.orchestra.run.smithi152.stdout:108 files removed 2021-02-24T15:13:22.249 INFO:teuthology.orchestra.run.smithi181.stdout:108 files removed 2021-02-24T15:13:22.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw 2021-02-24T15:13:22.281 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw 2021-02-24T15:13:22.891 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 299 kB/s | 74 kB 00:00 2021-02-24T15:13:22.905 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 300 kB/s | 74 kB 00:00 2021-02-24T15:13:23.129 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 74 kB/s | 15 kB 00:00 2021-02-24T15:13:23.142 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 75 kB/s | 15 kB 00:00 2021-02-24T15:13:23.360 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2021-02-24T15:13:23.370 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2021-02-24T15:13:23.537 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - AppStream 41 MB/s | 6.3 MB 00:00 2021-02-24T15:13:23.573 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-8 - AppStream 35 MB/s | 6.3 MB 00:00 2021-02-24T15:13:24.625 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - Base 26 MB/s | 2.3 MB 00:00 2021-02-24T15:13:24.672 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-8 - Base 25 MB/s | 2.3 MB 00:00 2021-02-24T15:13:25.066 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - Extras 141 kB/s | 9.0 kB 00:00 2021-02-24T15:13:25.125 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-8 - Extras 136 kB/s | 9.0 kB 00:00 2021-02-24T15:13:25.678 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 16 MB/s | 8.9 MB 00:00 2021-02-24T15:13:25.730 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 16 MB/s | 8.9 MB 00:00 2021-02-24T15:13:27.522 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2021-02-24T15:13:27.578 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-02-24T15:13:28.683 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:13:28.692 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:13:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:13:28.693 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:13:28.693 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:13:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 8.7 M 2021-02-24T15:13:28.693 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2021-02-24T15:13:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.3 M 2021-02-24T15:13:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.4 M 2021-02-24T15:13:28.694 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2021-02-24T15:13:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 5.1 M 2021-02-24T15:13:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 19 M 2021-02-24T15:13:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 24 k 2021-02-24T15:13:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-02-24T15:13:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.8-1.el8 epel 306 k 2021-02-24T15:13:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-02-24T15:13:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 748 k 2021-02-24T15:13:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-02-24T15:13:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.9.0-2.el8 CentOS-Base 47 k 2021-02-24T15:13:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 456 k 2021-02-24T15:13:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-02-24T15:13:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.6 M 2021-02-24T15:13:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-02-24T15:13:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-02-24T15:13:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse 2021-02-24T15:13:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 42 k 2021-02-24T15:13:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 73 k 2021-02-24T15:13:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 176 k 2021-02-24T15:13:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-02-24T15:13:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 364 k 2021-02-24T15:13:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 345 k 2021-02-24T15:13:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 110 k 2021-02-24T15:13:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:13:28.709 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:13:28.709 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:13:28.709 INFO:teuthology.orchestra.run.smithi152.stdout:Install 22 Packages 2021-02-24T15:13:28.710 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2021-02-24T15:13:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:13:28.711 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 47 M 2021-02-24T15:13:28.711 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:13:28.717 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:13:28.731 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:13:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:13:28.731 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:13:28.732 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:13:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 8.7 M 2021-02-24T15:13:28.732 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2021-02-24T15:13:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.3 M 2021-02-24T15:13:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.4 M 2021-02-24T15:13:28.733 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2021-02-24T15:13:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 5.1 M 2021-02-24T15:13:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 19 M 2021-02-24T15:13:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 24 k 2021-02-24T15:13:28.734 INFO:teuthology.orchestra.run.smithi181.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-02-24T15:13:28.734 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.8-1.el8 epel 306 k 2021-02-24T15:13:28.734 INFO:teuthology.orchestra.run.smithi181.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-02-24T15:13:28.734 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 748 k 2021-02-24T15:13:28.734 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-02-24T15:13:28.735 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.9.0-2.el8 CentOS-Base 47 k 2021-02-24T15:13:28.735 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 456 k 2021-02-24T15:13:28.735 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-02-24T15:13:28.735 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.6 M 2021-02-24T15:13:28.735 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-02-24T15:13:28.736 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-02-24T15:13:28.736 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse 2021-02-24T15:13:28.736 INFO:teuthology.orchestra.run.smithi181.stdout: x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 42 k 2021-02-24T15:13:28.736 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 73 k 2021-02-24T15:13:28.737 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 176 k 2021-02-24T15:13:28.737 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-02-24T15:13:28.737 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 364 k 2021-02-24T15:13:28.738 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 345 k 2021-02-24T15:13:28.738 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 110 k 2021-02-24T15:13:28.738 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:13:28.739 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:13:28.739 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:13:28.739 INFO:teuthology.orchestra.run.smithi181.stdout:Install 22 Packages 2021-02-24T15:13:28.739 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 2 Packages 2021-02-24T15:13:28.740 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:13:28.740 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 47 M 2021-02-24T15:13:28.741 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:13:30.088 INFO:teuthology.orchestra.run.smithi152.stdout:(1/24): ceph-base-17.0.0-1076.gc089f21b.el8.x86 3.7 MB/s | 5.1 MB 00:01 2021-02-24T15:13:30.139 INFO:teuthology.orchestra.run.smithi152.stdout:(2/24): ceph-selinux-17.0.0-1076.gc089f21b.el8. 459 kB/s | 24 kB 00:00 2021-02-24T15:13:30.153 INFO:teuthology.orchestra.run.smithi181.stdout:(1/24): ceph-base-17.0.0-1076.gc089f21b.el8.x86 3.6 MB/s | 5.1 MB 00:01 2021-02-24T15:13:30.207 INFO:teuthology.orchestra.run.smithi181.stdout:(2/24): ceph-selinux-17.0.0-1076.gc089f21b.el8. 439 kB/s | 24 kB 00:00 2021-02-24T15:13:30.306 INFO:teuthology.orchestra.run.smithi152.stdout:(3/24): libcephfs2-17.0.0-1076.gc089f21b.el8.x8 4.4 MB/s | 748 kB 00:00 2021-02-24T15:13:30.397 INFO:teuthology.orchestra.run.smithi181.stdout:(3/24): libcephfs2-17.0.0-1076.gc089f21b.el8.x8 3.9 MB/s | 748 kB 00:00 2021-02-24T15:13:30.434 INFO:teuthology.orchestra.run.smithi152.stdout:(4/24): libradosstriper1-17.0.0-1076.gc089f21b. 3.5 MB/s | 456 kB 00:00 2021-02-24T15:13:30.532 INFO:teuthology.orchestra.run.smithi181.stdout:(4/24): libradosstriper1-17.0.0-1076.gc089f21b. 3.3 MB/s | 456 kB 00:00 2021-02-24T15:13:31.204 INFO:teuthology.orchestra.run.smithi152.stdout:(5/24): librgw2-17.0.0-1076.gc089f21b.el8.x86_6 4.7 MB/s | 3.6 MB 00:00 2021-02-24T15:13:31.261 INFO:teuthology.orchestra.run.smithi152.stdout:(6/24): python3-ceph-argparse-17.0.0-1076.gc089 743 kB/s | 42 kB 00:00 2021-02-24T15:13:31.320 INFO:teuthology.orchestra.run.smithi152.stdout:(7/24): python3-ceph-common-17.0.0-1076.gc089f2 1.2 MB/s | 73 kB 00:00 2021-02-24T15:13:31.333 INFO:teuthology.orchestra.run.smithi181.stdout:(5/24): librgw2-17.0.0-1076.gc089f21b.el8.x86_6 4.6 MB/s | 3.6 MB 00:00 2021-02-24T15:13:31.376 INFO:teuthology.orchestra.run.smithi152.stdout:(8/24): python3-cephfs-17.0.0-1076.gc089f21b.el 3.1 MB/s | 176 kB 00:00 2021-02-24T15:13:31.387 INFO:teuthology.orchestra.run.smithi181.stdout:(6/24): python3-ceph-argparse-17.0.0-1076.gc089 789 kB/s | 42 kB 00:00 2021-02-24T15:13:31.415 INFO:teuthology.orchestra.run.smithi152.stdout:(9/24): ceph-radosgw-17.0.0-1076.gc089f21b.el8. 3.2 MB/s | 8.7 MB 00:02 2021-02-24T15:13:31.436 INFO:teuthology.orchestra.run.smithi181.stdout:(7/24): python3-ceph-common-17.0.0-1076.gc089f2 1.4 MB/s | 73 kB 00:00 2021-02-24T15:13:31.468 INFO:teuthology.orchestra.run.smithi152.stdout:(10/24): python3-rados-17.0.0-1076.gc089f21b.el 3.8 MB/s | 364 kB 00:00 2021-02-24T15:13:31.492 INFO:teuthology.orchestra.run.smithi181.stdout:(8/24): python3-cephfs-17.0.0-1076.gc089f21b.el 3.1 MB/s | 176 kB 00:00 2021-02-24T15:13:31.527 INFO:teuthology.orchestra.run.smithi152.stdout:(11/24): python3-rgw-17.0.0-1076.gc089f21b.el8. 1.8 MB/s | 110 kB 00:00 2021-02-24T15:13:31.529 INFO:teuthology.orchestra.run.smithi152.stdout:(12/24): python3-rbd-17.0.0-1076.gc089f21b.el8. 3.0 MB/s | 345 kB 00:00 2021-02-24T15:13:31.575 INFO:teuthology.orchestra.run.smithi152.stdout:(13/24): librdkafka-0.11.4-1.el8.x86_64.rpm 7.3 MB/s | 353 kB 00:00 2021-02-24T15:13:31.576 INFO:teuthology.orchestra.run.smithi152.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 30 MB/s | 44 kB 00:00 2021-02-24T15:13:31.579 INFO:teuthology.orchestra.run.smithi152.stdout:(15/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 25 MB/s | 47 kB 00:00 2021-02-24T15:13:31.580 INFO:teuthology.orchestra.run.smithi152.stdout:(16/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2021-02-24T15:13:31.589 INFO:teuthology.orchestra.run.smithi181.stdout:(9/24): python3-rados-17.0.0-1076.gc089f21b.el8 3.7 MB/s | 364 kB 00:00 2021-02-24T15:13:31.672 INFO:teuthology.orchestra.run.smithi181.stdout:(10/24): python3-rbd-17.0.0-1076.gc089f21b.el8. 4.1 MB/s | 345 kB 00:00 2021-02-24T15:13:31.677 INFO:teuthology.orchestra.run.smithi152.stdout:(17/24): gperftools-libs-2.8-1.el8.x86_64.rpm 3.1 MB/s | 306 kB 00:00 2021-02-24T15:13:31.678 INFO:teuthology.orchestra.run.smithi152.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 1.1 MB/s | 116 kB 00:00 2021-02-24T15:13:31.698 INFO:teuthology.orchestra.run.smithi152.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2021-02-24T15:13:31.707 INFO:teuthology.orchestra.run.smithi181.stdout:(11/24): ceph-radosgw-17.0.0-1076.gc089f21b.el8 2.9 MB/s | 8.7 MB 00:02 2021-02-24T15:13:31.709 INFO:teuthology.orchestra.run.smithi181.stdout:(12/24): python3-rgw-17.0.0-1076.gc089f21b.el8. 2.9 MB/s | 110 kB 00:00 2021-02-24T15:13:31.710 INFO:teuthology.orchestra.run.smithi152.stdout:(20/24): leveldb-1.22-1.el8.x86_64.rpm 5.5 MB/s | 181 kB 00:00 2021-02-24T15:13:31.718 INFO:teuthology.orchestra.run.smithi152.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2021-02-24T15:13:31.743 INFO:teuthology.orchestra.run.smithi181.stdout:(13/24): librdkafka-0.11.4-1.el8.x86_64.rpm 9.8 MB/s | 353 kB 00:00 2021-02-24T15:13:31.745 INFO:teuthology.orchestra.run.smithi181.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 24 MB/s | 44 kB 00:00 2021-02-24T15:13:31.746 INFO:teuthology.orchestra.run.smithi181.stdout:(15/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.8 MB/s | 259 kB 00:00 2021-02-24T15:13:31.747 INFO:teuthology.orchestra.run.smithi181.stdout:(16/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 21 MB/s | 47 kB 00:00 2021-02-24T15:13:31.829 INFO:teuthology.orchestra.run.smithi181.stdout:(17/24): fmt-6.2.1-1.el8.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2021-02-24T15:13:31.861 INFO:teuthology.orchestra.run.smithi181.stdout:(18/24): leveldb-1.22-1.el8.x86_64.rpm 5.4 MB/s | 181 kB 00:00 2021-02-24T15:13:31.877 INFO:teuthology.orchestra.run.smithi181.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2021-02-24T15:13:31.894 INFO:teuthology.orchestra.run.smithi181.stdout:(20/24): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2021-02-24T15:13:31.951 INFO:teuthology.orchestra.run.smithi181.stdout:(21/24): gperftools-libs-2.8-1.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2021-02-24T15:13:32.357 INFO:teuthology.orchestra.run.smithi152.stdout:(22/24): ceph-common-17.0.0-1076.gc089f21b.el8. 5.3 MB/s | 19 MB 00:03 2021-02-24T15:13:32.367 INFO:teuthology.orchestra.run.smithi152.stdout:(23/24): librados2-17.0.0-1076.gc089f21b.el8.x8 5.0 MB/s | 3.3 MB 00:00 2021-02-24T15:13:32.453 INFO:teuthology.orchestra.run.smithi152.stdout:(24/24): librbd1-17.0.0-1076.gc089f21b.el8.x86_ 4.7 MB/s | 3.4 MB 00:00 2021-02-24T15:13:32.456 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:13:32.457 INFO:teuthology.orchestra.run.smithi152.stdout:Total 13 MB/s | 47 MB 00:03 2021-02-24T15:13:32.460 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:13:32.463 INFO:teuthology.orchestra.run.smithi181.stdout:(22/24): librados2-17.0.0-1076.gc089f21b.el8.x8 5.7 MB/s | 3.3 MB 00:00 2021-02-24T15:13:32.506 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:13:32.506 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:13:32.607 INFO:teuthology.orchestra.run.smithi181.stdout:(23/24): librbd1-17.0.0-1076.gc089f21b.el8.x86_ 5.2 MB/s | 3.4 MB 00:00 2021-02-24T15:13:32.792 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:13:32.794 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:13:33.073 INFO:teuthology.orchestra.run.smithi181.stdout:(24/24): ceph-common-17.0.0-1076.gc089f21b.el8. 4.5 MB/s | 19 MB 00:04 2021-02-24T15:13:33.077 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:13:33.077 INFO:teuthology.orchestra.run.smithi181.stdout:Total 11 MB/s | 47 MB 00:04 2021-02-24T15:13:33.081 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:13:33.127 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:13:33.127 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:13:33.407 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:13:33.409 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:13:33.854 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:13:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-02-24T15:13:34.165 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2021-02-24T15:13:34.364 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-02-24T15:13:34.459 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:13:34.587 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-02-24T15:13:34.744 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-02-24T15:13:34.774 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2021-02-24T15:13:34.897 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 4/26 2021-02-24T15:13:34.931 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-02-24T15:13:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 4/26 2021-02-24T15:13:35.203 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:17.0.0-1076.gc089f21b.el8.x86_64 5/26 2021-02-24T15:13:35.316 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-02-24T15:13:35.355 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 6/26 2021-02-24T15:13:35.469 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 4/26 2021-02-24T15:13:35.564 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 4/26 2021-02-24T15:13:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:17.0.0-1076.gc089f21b.el8.x86_64 5/26 2021-02-24T15:13:35.767 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 6/26 2021-02-24T15:13:35.873 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 6/26 2021-02-24T15:13:35.971 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 7/26 2021-02-24T15:13:36.040 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 7/26 2021-02-24T15:13:36.187 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 8/26 2021-02-24T15:13:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 6/26 2021-02-24T15:13:36.346 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-24T15:13:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 7/26 2021-02-24T15:13:36.478 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 7/26 2021-02-24T15:13:36.638 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 8/26 2021-02-24T15:13:36.756 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-24T15:13:36.787 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-24T15:13:36.888 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:17.0.0-1076.gc089f21b.el8.x86_64 10/26 2021-02-24T15:13:36.971 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:17.0.0-1076.gc089f21b.el8.x86_64 10/26 2021-02-24T15:13:37.152 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-02-24T15:13:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-24T15:13:37.265 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:17.0.0-1076.gc089f21b.el8. 12/26 2021-02-24T15:13:37.331 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:17.0.0-1076.gc089f21b.el8.x86_64 10/26 2021-02-24T15:13:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:17.0.0-1076.gc089f21b.el8.x86_64 13/26 2021-02-24T15:13:37.409 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:17.0.0-1076.gc089f21b.el8.x86_64 10/26 2021-02-24T15:13:37.586 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-02-24T15:13:37.597 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:17.0.0-1076.gc089f21b.el8.x86_64 14/26 2021-02-24T15:13:37.698 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:17.0.0-1076.gc089f21b.el8. 12/26 2021-02-24T15:13:37.764 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:17.0.0-1076.gc089f21b.el8.x86_64 15/26 2021-02-24T15:13:37.834 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:17.0.0-1076.gc089f21b.el8.x86_64 13/26 2021-02-24T15:13:37.913 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:17.0.0-1076.gc089f21b.el8.x86_6 16/26 2021-02-24T15:13:37.989 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:17.0.0-1076.gc089f21b.el8.x86_6 16/26 2021-02-24T15:13:37.990 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:17.0.0-1076.gc089f21b.el8.x86_64 14/26 2021-02-24T15:13:38.157 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:17.0.0-1076.gc089f21b.el8.x86_64 15/26 2021-02-24T15:13:38.163 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2021-02-24T15:13:38.314 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:17.0.0-1076.gc089f21b.el8.x86_6 16/26 2021-02-24T15:13:38.363 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.8-1.el8.x86_64 18/26 2021-02-24T15:13:38.386 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:17.0.0-1076.gc089f21b.el8.x86_6 16/26 2021-02-24T15:13:38.496 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2021-02-24T15:13:38.572 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2021-02-24T15:13:38.605 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:17.0.0-1076.gc089f21b.el8.x8 20/26 2021-02-24T15:13:38.739 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.8-1.el8.x86_64 18/26 2021-02-24T15:13:38.881 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2021-02-24T15:13:39.006 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:17.0.0-1076.gc089f21b.el8.x8 20/26 2021-02-24T15:13:41.927 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 21/26 2021-02-24T15:13:42.122 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 21/26 2021-02-24T15:13:42.291 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 21/26 2021-02-24T15:13:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 21/26 2021-02-24T15:13:42.782 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 21/26 2021-02-24T15:13:43.047 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 22/26 2021-02-24T15:13:43.134 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 22/26 2021-02-24T15:13:43.147 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 21/26 2021-02-24T15:13:43.237 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:17.0.0-1076.gc089f21b.el8.x86_64 23/26 2021-02-24T15:13:43.375 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 22/26 2021-02-24T15:13:43.466 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 22/26 2021-02-24T15:13:43.589 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:17.0.0-1076.gc089f21b.el8.x86_64 23/26 2021-02-24T15:14:00.111 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:17.0.0-1076.gc089f21b.el8.x86_64 23/26 2021-02-24T15:14:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2021-02-24T15:14:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2021-02-24T15:14:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2021-02-24T15:14:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /run 2021-02-24T15:14:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2021-02-24T15:14:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2021-02-24T15:14:00.112 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2021-02-24T15:14:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2021-02-24T15:14:00.113 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2021-02-24T15:14:00.113 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:00.291 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:17.0.0-1076.gc089f21b.el8.x86_64 23/26 2021-02-24T15:14:00.292 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2021-02-24T15:14:00.292 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2021-02-24T15:14:00.292 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /dev 2021-02-24T15:14:00.293 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /run 2021-02-24T15:14:00.293 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2021-02-24T15:14:00.293 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2021-02-24T15:14:00.293 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2021-02-24T15:14:00.293 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2021-02-24T15:14:00.294 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /dev 2021-02-24T15:14:00.294 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:01.210 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:17.0.0-1076.gc089f21b.el8.x86_64 24/26 2021-02-24T15:14:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-1076.gc089f21b.el8.x86_64 24/26 2021-02-24T15:14:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-24T15:14:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:17.0.0-1076.gc089f21b.el8.x86_64 24/26 2021-02-24T15:14:01.480 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-1076.gc089f21b.el8.x86_64 24/26 2021-02-24T15:14:01.480 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-24T15:14:01.503 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-24T15:14:01.503 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-24T15:14:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-24T15:14:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-24T15:14:02.175 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-24T15:14:02.175 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 1/26 2021-02-24T15:14:02.175 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 2/26 2021-02-24T15:14:02.176 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:17.0.0-1076.gc089f21b.el8.x86_64 3/26 2021-02-24T15:14:02.176 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:17.0.0-1076.gc089f21b.el8.x86_64 4/26 2021-02-24T15:14:02.176 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 5/26 2021-02-24T15:14:02.176 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:17.0.0-1076.gc089f21b.el8.x86_6 6/26 2021-02-24T15:14:02.176 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:17.0.0-1076.gc089f21b.el8.x86_64 7/26 2021-02-24T15:14:02.177 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:17.0.0-1076.gc089f21b.el8. 8/26 2021-02-24T15:14:02.177 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:17.0.0-1076.gc089f21b.el8.x8 9/26 2021-02-24T15:14:02.177 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:17.0.0-1076.gc089f21b.el8.x86_64 10/26 2021-02-24T15:14:02.177 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:17.0.0-1076.gc089f21b.el8.x86_64 11/26 2021-02-24T15:14:02.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:17.0.0-1076.gc089f21b.el8.x86_64 12/26 2021-02-24T15:14:02.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:17.0.0-1076.gc089f21b.el8.x86_64 13/26 2021-02-24T15:14:02.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/26 2021-02-24T15:14:02.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2021-02-24T15:14:02.179 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2021-02-24T15:14:02.179 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 17/26 2021-02-24T15:14:02.179 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2021-02-24T15:14:02.179 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.8-1.el8.x86_64 19/26 2021-02-24T15:14:02.180 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2021-02-24T15:14:02.180 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2021-02-24T15:14:02.180 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2021-02-24T15:14:02.180 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 23/26 2021-02-24T15:14:02.183 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-02-24T15:14:02.184 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 25/26 2021-02-24T15:14:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-24T15:14:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 1/26 2021-02-24T15:14:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 2/26 2021-02-24T15:14:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:17.0.0-1076.gc089f21b.el8.x86_64 3/26 2021-02-24T15:14:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:17.0.0-1076.gc089f21b.el8.x86_64 4/26 2021-02-24T15:14:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 5/26 2021-02-24T15:14:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:17.0.0-1076.gc089f21b.el8.x86_6 6/26 2021-02-24T15:14:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:17.0.0-1076.gc089f21b.el8.x86_64 7/26 2021-02-24T15:14:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:17.0.0-1076.gc089f21b.el8. 8/26 2021-02-24T15:14:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:17.0.0-1076.gc089f21b.el8.x8 9/26 2021-02-24T15:14:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:17.0.0-1076.gc089f21b.el8.x86_64 10/26 2021-02-24T15:14:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:17.0.0-1076.gc089f21b.el8.x86_64 11/26 2021-02-24T15:14:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:17.0.0-1076.gc089f21b.el8.x86_64 12/26 2021-02-24T15:14:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:17.0.0-1076.gc089f21b.el8.x86_64 13/26 2021-02-24T15:14:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/26 2021-02-24T15:14:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2021-02-24T15:14:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2021-02-24T15:14:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 17/26 2021-02-24T15:14:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2021-02-24T15:14:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.8-1.el8.x86_64 19/26 2021-02-24T15:14:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2021-02-24T15:14:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2021-02-24T15:14:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2021-02-24T15:14:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 23/26 2021-02-24T15:14:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-02-24T15:14:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 25/26 2021-02-24T15:14:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-02-24T15:14:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:03.068 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2021-02-24T15:14:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:03.069 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:14:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: fmt-6.2.1-1.el8.x86_64 2021-02-24T15:14:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.8-1.el8.x86_64 2021-02-24T15:14:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: leveldb-1.22-1.el8.x86_64 2021-02-24T15:14:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.2-3.el8.x86_64 2021-02-24T15:14:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-02-24T15:14:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-02-24T15:14:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.3.1-3.el8.x86_64 2021-02-24T15:14:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-02-24T15:14:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-02-24T15:14:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:03.074 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:14:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-02-24T15:14:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:03.202 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2021-02-24T15:14:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:03.203 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:14:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: fmt-6.2.1-1.el8.x86_64 2021-02-24T15:14:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.8-1.el8.x86_64 2021-02-24T15:14:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: leveldb-1.22-1.el8.x86_64 2021-02-24T15:14:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.2-3.el8.x86_64 2021-02-24T15:14:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-02-24T15:14:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-02-24T15:14:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.3.1-3.el8.x86_64 2021-02-24T15:14:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-02-24T15:14:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-02-24T15:14:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:03.211 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:14:03.311 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-test 2021-02-24T15:14:03.441 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-test 2021-02-24T15:14:03.778 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:36 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:03.906 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:00:36 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:04.249 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:14:04.251 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:04.251 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:14:04.251 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:04.251 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:14:04.252 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 40 M 2021-02-24T15:14:04.252 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2021-02-24T15:14:04.252 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-02-24T15:14:04.252 INFO:teuthology.orchestra.run.smithi152.stdout: libxslt x86_64 1.1.32-5.el8 CentOS-Base 250 k 2021-02-24T15:14:04.253 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-02-24T15:14:04.253 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-02-24T15:14:04.253 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-02-24T15:14:04.253 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:04.253 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:14:04.254 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:04.254 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2021-02-24T15:14:04.254 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:04.255 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 41 M 2021-02-24T15:14:04.255 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 228 M 2021-02-24T15:14:04.255 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:14:04.288 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.6 MB/s | 161 kB 00:00 2021-02-24T15:14:04.293 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): socat-1.7.3.3-2.el8.x86_64.rpm 58 MB/s | 302 kB 00:00 2021-02-24T15:14:04.295 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2021-02-24T15:14:04.299 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): libxslt-1.1.32-5.el8.x86_64.rpm 58 MB/s | 250 kB 00:00 2021-02-24T15:14:04.360 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2021-02-24T15:14:04.365 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:14:04.367 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:04.367 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:14:04.367 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:04.367 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:14:04.367 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 40 M 2021-02-24T15:14:04.368 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2021-02-24T15:14:04.368 INFO:teuthology.orchestra.run.smithi181.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-02-24T15:14:04.368 INFO:teuthology.orchestra.run.smithi181.stdout: libxslt x86_64 1.1.32-5.el8 CentOS-Base 250 k 2021-02-24T15:14:04.368 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-02-24T15:14:04.369 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-02-24T15:14:04.369 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-02-24T15:14:04.369 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:04.369 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:14:04.369 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:04.370 INFO:teuthology.orchestra.run.smithi181.stdout:Install 6 Packages 2021-02-24T15:14:04.370 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:04.370 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 41 M 2021-02-24T15:14:04.371 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 228 M 2021-02-24T15:14:04.371 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:14:04.404 INFO:teuthology.orchestra.run.smithi181.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.6 MB/s | 161 kB 00:00 2021-02-24T15:14:04.409 INFO:teuthology.orchestra.run.smithi181.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.9 MB/s | 187 kB 00:00 2021-02-24T15:14:04.411 INFO:teuthology.orchestra.run.smithi181.stdout:(3/6): socat-1.7.3.3-2.el8.x86_64.rpm 38 MB/s | 302 kB 00:00 2021-02-24T15:14:04.412 INFO:teuthology.orchestra.run.smithi181.stdout:(4/6): libxslt-1.1.32-5.el8.x86_64.rpm 43 MB/s | 250 kB 00:00 2021-02-24T15:14:04.477 INFO:teuthology.orchestra.run.smithi181.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2021-02-24T15:14:07.350 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): ceph-test-17.0.0-1076.gc089f21b.el8.x86_ 13 MB/s | 40 MB 00:03 2021-02-24T15:14:07.354 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:07.354 INFO:teuthology.orchestra.run.smithi152.stdout:Total 13 MB/s | 41 MB 00:03 2021-02-24T15:14:07.358 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:14:07.381 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:14:07.381 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:14:07.609 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:14:07.612 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:14:07.724 INFO:teuthology.orchestra.run.smithi181.stdout:(6/6): ceph-test-17.0.0-1076.gc089f21b.el8.x86_ 12 MB/s | 40 MB 00:03 2021-02-24T15:14:07.731 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:07.731 INFO:teuthology.orchestra.run.smithi181.stdout:Total 12 MB/s | 41 MB 00:03 2021-02-24T15:14:07.731 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:14:07.753 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:14:07.754 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:14:07.984 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:14:07.984 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:14:08.048 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:14:08.235 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 1/6 2021-02-24T15:14:08.418 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-02-24T15:14:08.420 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:14:08.594 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/6 2021-02-24T15:14:08.636 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 1/6 2021-02-24T15:14:08.774 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/6 2021-02-24T15:14:08.777 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-02-24T15:14:08.851 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/6 2021-02-24T15:14:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/6 2021-02-24T15:14:09.042 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/6 2021-02-24T15:14:09.120 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/6 2021-02-24T15:14:13.191 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2021-02-24T15:14:13.405 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:17.0.0-1076.gc089f21b.el8.x86_64 6/6 2021-02-24T15:14:13.622 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2021-02-24T15:14:13.639 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-test-2:17.0.0-1076.gc089f21b.el8.x86_64 6/6 2021-02-24T15:14:13.640 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:17.0.0-1076.gc089f21b.el8.x86_64 1/6 2021-02-24T15:14:13.640 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2021-02-24T15:14:13.641 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/6 2021-02-24T15:14:13.641 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/6 2021-02-24T15:14:13.641 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 5/6 2021-02-24T15:14:14.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2021-02-24T15:14:14.036 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:14.036 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:14:14.037 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:17.0.0-1076.gc089f21b.el8.x86_64 jq-1.5-12.el8.x86_64 2021-02-24T15:14:14.037 INFO:teuthology.orchestra.run.smithi152.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2021-02-24T15:14:14.037 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2021-02-24T15:14:14.037 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:14.037 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:14:14.241 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph 2021-02-24T15:14:14.693 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:47 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:14.765 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:17.0.0-1076.gc089f21b.el8.x86_64 6/6 2021-02-24T15:14:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-test-2:17.0.0-1076.gc089f21b.el8.x86_64 6/6 2021-02-24T15:14:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:17.0.0-1076.gc089f21b.el8.x86_64 1/6 2021-02-24T15:14:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2021-02-24T15:14:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/6 2021-02-24T15:14:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/6 2021-02-24T15:14:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 5/6 2021-02-24T15:14:15.375 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2021-02-24T15:14:15.375 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:15.376 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:14:15.376 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:17.0.0-1076.gc089f21b.el8.x86_64 jq-1.5-12.el8.x86_64 2021-02-24T15:14:15.376 INFO:teuthology.orchestra.run.smithi181.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2021-02-24T15:14:15.376 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2021-02-24T15:14:15.377 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:15.377 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:14:15.524 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph 2021-02-24T15:14:15.673 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:14:15.677 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================= 2021-02-24T15:14:15.678 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:14:15.678 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================= 2021-02-24T15:14:15.678 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:14:15.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 6.4 k 2021-02-24T15:14:15.678 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2021-02-24T15:14:15.679 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 2.2 M 2021-02-24T15:14:15.679 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 1.4 M 2021-02-24T15:14:15.679 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 200 k 2021-02-24T15:14:15.679 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.5 M 2021-02-24T15:14:15.680 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 16 M 2021-02-24T15:14:15.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-02-24T15:14:15.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-02-24T15:14:15.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-02-24T15:14:15.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-02-24T15:14:15.681 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-02-24T15:14:15.681 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-02-24T15:14:15.681 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-02-24T15:14:15.681 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-02-24T15:14:15.681 INFO:teuthology.orchestra.run.smithi152.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2021-02-24T15:14:15.682 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-02-24T15:14:15.682 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-02-24T15:14:15.683 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-02-24T15:14:15.683 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-02-24T15:14:15.683 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-02-24T15:14:15.683 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-02-24T15:14:15.684 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-02-24T15:14:15.684 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-02-24T15:14:15.684 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-02-24T15:14:15.684 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-02-24T15:14:15.684 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-02-24T15:14:15.685 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-02-24T15:14:15.685 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.24.2-4.el8 CentOS-Base 176 k 2021-02-24T15:14:15.685 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-02-24T15:14:15.685 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-02-24T15:14:15.685 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-02-24T15:14:15.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-02-24T15:14:15.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-02-24T15:14:15.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-02-24T15:14:15.686 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2021-02-24T15:14:15.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-02-24T15:14:15.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-02-24T15:14:15.687 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:15.687 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:14:15.687 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================= 2021-02-24T15:14:15.688 INFO:teuthology.orchestra.run.smithi152.stdout:Install 36 Packages 2021-02-24T15:14:15.688 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:15.689 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 28 M 2021-02-24T15:14:15.689 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 114 M 2021-02-24T15:14:15.689 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:14:15.825 INFO:teuthology.orchestra.run.smithi152.stdout:(1/36): ceph-17.0.0-1076.gc089f21b.el8.x86_64.r 46 kB/s | 6.4 kB 00:00 2021-02-24T15:14:15.979 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:00:48 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:16.013 INFO:teuthology.orchestra.run.smithi152.stdout:(2/36): ceph-mgr-17.0.0-1076.gc089f21b.el8.x86_ 4.4 MB/s | 1.4 MB 00:00 2021-02-24T15:14:16.115 INFO:teuthology.orchestra.run.smithi152.stdout:(3/36): ceph-mds-17.0.0-1076.gc089f21b.el8.x86_ 5.1 MB/s | 2.2 MB 00:00 2021-02-24T15:14:16.263 INFO:teuthology.orchestra.run.smithi152.stdout:(4/36): ceph-mgr-modules-core-17.0.0-1076.gc089 1.3 MB/s | 200 kB 00:00 2021-02-24T15:14:16.332 INFO:teuthology.orchestra.run.smithi152.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 3.0 MB/s | 214 kB 00:00 2021-02-24T15:14:16.397 INFO:teuthology.orchestra.run.smithi152.stdout:(6/36): python3-lxml-4.2.3-1.el8.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2021-02-24T15:14:16.450 INFO:teuthology.orchestra.run.smithi152.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 2.9 MB/s | 157 kB 00:00 2021-02-24T15:14:16.466 INFO:teuthology.orchestra.run.smithi152.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 2.4 MB/s | 39 kB 00:00 2021-02-24T15:14:16.474 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:14:16.477 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2021-02-24T15:14:16.478 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:14:16.478 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2021-02-24T15:14:16.478 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:14:16.478 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 6.4 k 2021-02-24T15:14:16.478 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2021-02-24T15:14:16.479 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 2.2 M 2021-02-24T15:14:16.479 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 1.4 M 2021-02-24T15:14:16.479 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 200 k 2021-02-24T15:14:16.479 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.5 M 2021-02-24T15:14:16.480 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 16 M 2021-02-24T15:14:16.480 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-02-24T15:14:16.480 INFO:teuthology.orchestra.run.smithi181.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-02-24T15:14:16.480 INFO:teuthology.orchestra.run.smithi181.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-02-24T15:14:16.480 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-02-24T15:14:16.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-02-24T15:14:16.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-02-24T15:14:16.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-02-24T15:14:16.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-02-24T15:14:16.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2021-02-24T15:14:16.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-02-24T15:14:16.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-02-24T15:14:16.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-02-24T15:14:16.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-02-24T15:14:16.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-02-24T15:14:16.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-02-24T15:14:16.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-02-24T15:14:16.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-02-24T15:14:16.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-02-24T15:14:16.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-02-24T15:14:16.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-02-24T15:14:16.488 INFO:teuthology.orchestra.run.smithi181.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-02-24T15:14:16.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.24.2-4.el8 CentOS-Base 176 k 2021-02-24T15:14:16.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-02-24T15:14:16.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-02-24T15:14:16.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-02-24T15:14:16.489 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-02-24T15:14:16.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-02-24T15:14:16.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-02-24T15:14:16.490 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2021-02-24T15:14:16.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-02-24T15:14:16.490 INFO:teuthology.orchestra.run.smithi181.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-02-24T15:14:16.491 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:16.491 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:14:16.491 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2021-02-24T15:14:16.492 INFO:teuthology.orchestra.run.smithi181.stdout:Install 36 Packages 2021-02-24T15:14:16.492 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:16.493 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 28 M 2021-02-24T15:14:16.493 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 114 M 2021-02-24T15:14:16.493 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:14:16.523 INFO:teuthology.orchestra.run.smithi152.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 962 kB/s | 54 kB 00:00 2021-02-24T15:14:16.526 INFO:teuthology.orchestra.run.smithi152.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 22 MB/s | 27 kB 00:00 2021-02-24T15:14:16.530 INFO:teuthology.orchestra.run.smithi152.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 74 MB/s | 457 kB 00:00 2021-02-24T15:14:16.573 INFO:teuthology.orchestra.run.smithi152.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 4.5 MB/s | 195 kB 00:00 2021-02-24T15:14:16.576 INFO:teuthology.orchestra.run.smithi152.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 25 MB/s | 34 kB 00:00 2021-02-24T15:14:16.577 INFO:teuthology.orchestra.run.smithi152.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 54 MB/s | 123 kB 00:00 2021-02-24T15:14:16.581 INFO:teuthology.orchestra.run.smithi152.stdout:(15/36): python3-urllib3-1.24.2-4.el8.noarch.rp 60 MB/s | 176 kB 00:00 2021-02-24T15:14:16.606 INFO:teuthology.orchestra.run.smithi152.stdout:(16/36): ceph-mon-17.0.0-1076.gc089f21b.el8.x86 4.5 MB/s | 3.5 MB 00:00 2021-02-24T15:14:16.636 INFO:teuthology.orchestra.run.smithi181.stdout:(1/36): ceph-17.0.0-1076.gc089f21b.el8.x86_64.r 43 kB/s | 6.4 kB 00:00 2021-02-24T15:14:16.664 INFO:teuthology.orchestra.run.smithi152.stdout:(17/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 524 kB/s | 44 kB 00:00 2021-02-24T15:14:16.686 INFO:teuthology.orchestra.run.smithi152.stdout:(18/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.3 MB/s | 185 kB 00:00 2021-02-24T15:14:16.722 INFO:teuthology.orchestra.run.smithi152.stdout:(19/36): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.9 MB/s | 173 kB 00:00 2021-02-24T15:14:16.836 INFO:teuthology.orchestra.run.smithi152.stdout:(20/36): ceph-osd-17.0.0-1076.gc089f21b.el8.x86 19 MB/s | 16 MB 00:00 2021-02-24T15:14:16.838 INFO:teuthology.orchestra.run.smithi152.stdout:(21/36): python3-cherrypy-18.4.0-1.el8.noarch.r 2.5 MB/s | 384 kB 00:00 2021-02-24T15:14:16.838 INFO:teuthology.orchestra.run.smithi152.stdout:(22/36): python3-cssselect-0.9.2-10.el8.noarch. 345 kB/s | 40 kB 00:00 2021-02-24T15:14:16.855 INFO:teuthology.orchestra.run.smithi152.stdout:(23/36): python3-logutils-0.3.5-11.el8.noarch.r 2.9 MB/s | 49 kB 00:00 2021-02-24T15:14:16.858 INFO:teuthology.orchestra.run.smithi152.stdout:(24/36): python3-jaraco-functools-2.0-4.el8.noa 890 kB/s | 18 kB 00:00 2021-02-24T15:14:16.870 INFO:teuthology.orchestra.run.smithi152.stdout:(25/36): python3-jaraco-6.2-6.el8.noarch.rpm 337 kB/s | 11 kB 00:00 2021-02-24T15:14:16.872 INFO:teuthology.orchestra.run.smithi152.stdout:(26/36): python3-more-itertools-7.2.0-3.el8.noa 3.5 MB/s | 59 kB 00:00 2021-02-24T15:14:16.886 INFO:teuthology.orchestra.run.smithi152.stdout:(27/36): python3-portend-2.6-1.el8.noarch.rpm 958 kB/s | 16 kB 00:00 2021-02-24T15:14:16.888 INFO:teuthology.orchestra.run.smithi152.stdout:(28/36): python3-simplegeneric-0.8.1-17.el8.noa 1.1 MB/s | 19 kB 00:00 2021-02-24T15:14:16.898 INFO:teuthology.orchestra.run.smithi152.stdout:(29/36): python3-pecan-1.3.2-9.el8.noarch.rpm 7.0 MB/s | 283 kB 00:00 2021-02-24T15:14:16.902 INFO:teuthology.orchestra.run.smithi152.stdout:(30/36): python3-singledispatch-3.4.0.3-18.el8. 1.4 MB/s | 24 kB 00:00 2021-02-24T15:14:16.905 INFO:teuthology.orchestra.run.smithi152.stdout:(31/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.7 MB/s | 29 kB 00:00 2021-02-24T15:14:16.918 INFO:teuthology.orchestra.run.smithi152.stdout:(32/36): python3-trustme-0.6.0-4.el8.noarch.rpm 1.4 MB/s | 27 kB 00:00 2021-02-24T15:14:16.938 INFO:teuthology.orchestra.run.smithi152.stdout:(33/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 7.5 MB/s | 251 kB 00:00 2021-02-24T15:14:16.938 INFO:teuthology.orchestra.run.smithi152.stdout:(34/36): python3-webtest-2.0.33-1.el8.noarch.rp 4.0 MB/s | 85 kB 00:00 2021-02-24T15:14:16.952 INFO:teuthology.orchestra.run.smithi152.stdout:(35/36): python3-waitress-1.2.1-2.el8.1.noarch. 4.8 MB/s | 241 kB 00:00 2021-02-24T15:14:16.955 INFO:teuthology.orchestra.run.smithi152.stdout:(36/36): python3-zc-lockfile-2.0-2.el8.noarch.r 1.3 MB/s | 23 kB 00:00 2021-02-24T15:14:16.958 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:16.958 INFO:teuthology.orchestra.run.smithi152.stdout:Total 22 MB/s | 28 MB 00:01 2021-02-24T15:14:16.968 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:14:16.985 INFO:teuthology.orchestra.run.smithi181.stdout:(2/36): ceph-mgr-17.0.0-1076.gc089f21b.el8.x86_ 2.9 MB/s | 1.4 MB 00:00 2021-02-24T15:14:17.009 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:14:17.010 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:14:17.188 INFO:teuthology.orchestra.run.smithi181.stdout:(3/36): ceph-mds-17.0.0-1076.gc089f21b.el8.x86_ 3.1 MB/s | 2.2 MB 00:00 2021-02-24T15:14:17.242 INFO:teuthology.orchestra.run.smithi181.stdout:(4/36): ceph-mgr-modules-core-17.0.0-1076.gc089 4.1 MB/s | 200 kB 00:00 2021-02-24T15:14:17.269 INFO:teuthology.orchestra.run.smithi181.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 6.4 MB/s | 214 kB 00:00 2021-02-24T15:14:17.287 INFO:teuthology.orchestra.run.smithi181.stdout:(6/36): python3-lxml-4.2.3-1.el8.x86_64.rpm 83 MB/s | 1.5 MB 00:00 2021-02-24T15:14:17.290 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:14:17.290 INFO:teuthology.orchestra.run.smithi181.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 56 MB/s | 157 kB 00:00 2021-02-24T15:14:17.292 INFO:teuthology.orchestra.run.smithi181.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 24 MB/s | 39 kB 00:00 2021-02-24T15:14:17.292 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:14:17.293 INFO:teuthology.orchestra.run.smithi181.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 34 MB/s | 54 kB 00:00 2021-02-24T15:14:17.295 INFO:teuthology.orchestra.run.smithi181.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 20 MB/s | 27 kB 00:00 2021-02-24T15:14:17.301 INFO:teuthology.orchestra.run.smithi181.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 74 MB/s | 457 kB 00:00 2021-02-24T15:14:17.304 INFO:teuthology.orchestra.run.smithi181.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 61 MB/s | 195 kB 00:00 2021-02-24T15:14:17.306 INFO:teuthology.orchestra.run.smithi181.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 25 MB/s | 34 kB 00:00 2021-02-24T15:14:17.308 INFO:teuthology.orchestra.run.smithi181.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 54 MB/s | 123 kB 00:00 2021-02-24T15:14:17.311 INFO:teuthology.orchestra.run.smithi181.stdout:(15/36): python3-urllib3-1.24.2-4.el8.noarch.rp 60 MB/s | 176 kB 00:00 2021-02-24T15:14:17.389 INFO:teuthology.orchestra.run.smithi181.stdout:(16/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 562 kB/s | 44 kB 00:00 2021-02-24T15:14:17.448 INFO:teuthology.orchestra.run.smithi181.stdout:(17/36): ceph-mon-17.0.0-1076.gc089f21b.el8.x86 4.3 MB/s | 3.5 MB 00:00 2021-02-24T15:14:17.449 INFO:teuthology.orchestra.run.smithi181.stdout:(18/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.0 MB/s | 185 kB 00:00 2021-02-24T15:14:17.508 INFO:teuthology.orchestra.run.smithi181.stdout:(19/36): python3-cherrypy-18.4.0-1.el8.noarch.r 6.4 MB/s | 384 kB 00:00 2021-02-24T15:14:17.528 INFO:teuthology.orchestra.run.smithi181.stdout:(20/36): python3-cssselect-0.9.2-10.el8.noarch. 2.0 MB/s | 40 kB 00:00 2021-02-24T15:14:17.529 INFO:teuthology.orchestra.run.smithi181.stdout:(21/36): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.1 MB/s | 173 kB 00:00 2021-02-24T15:14:17.547 INFO:teuthology.orchestra.run.smithi181.stdout:(22/36): python3-jaraco-functools-2.0-4.el8.noa 1.1 MB/s | 18 kB 00:00 2021-02-24T15:14:17.547 INFO:teuthology.orchestra.run.smithi181.stdout:(23/36): python3-jaraco-6.2-6.el8.noarch.rpm 570 kB/s | 11 kB 00:00 2021-02-24T15:14:17.562 INFO:teuthology.orchestra.run.smithi181.stdout:(24/36): python3-logutils-0.3.5-11.el8.noarch.r 2.8 MB/s | 49 kB 00:00 2021-02-24T15:14:17.568 INFO:teuthology.orchestra.run.smithi181.stdout:(25/36): python3-more-itertools-7.2.0-3.el8.noa 2.9 MB/s | 59 kB 00:00 2021-02-24T15:14:17.587 INFO:teuthology.orchestra.run.smithi181.stdout:(26/36): python3-portend-2.6-1.el8.noarch.rpm 800 kB/s | 16 kB 00:00 2021-02-24T15:14:17.595 INFO:teuthology.orchestra.run.smithi181.stdout:(27/36): python3-pecan-1.3.2-9.el8.noarch.rpm 8.3 MB/s | 283 kB 00:00 2021-02-24T15:14:17.607 INFO:teuthology.orchestra.run.smithi181.stdout:(28/36): python3-simplegeneric-0.8.1-17.el8.noa 947 kB/s | 19 kB 00:00 2021-02-24T15:14:17.612 INFO:teuthology.orchestra.run.smithi181.stdout:(29/36): python3-singledispatch-3.4.0.3-18.el8. 1.4 MB/s | 24 kB 00:00 2021-02-24T15:14:17.627 INFO:teuthology.orchestra.run.smithi181.stdout:(30/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.5 MB/s | 29 kB 00:00 2021-02-24T15:14:17.629 INFO:teuthology.orchestra.run.smithi181.stdout:(31/36): python3-trustme-0.6.0-4.el8.noarch.rpm 1.6 MB/s | 27 kB 00:00 2021-02-24T15:14:17.662 INFO:teuthology.orchestra.run.smithi181.stdout:(32/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 7.5 MB/s | 251 kB 00:00 2021-02-24T15:14:17.666 INFO:teuthology.orchestra.run.smithi181.stdout:(33/36): python3-waitress-1.2.1-2.el8.1.noarch. 6.0 MB/s | 241 kB 00:00 2021-02-24T15:14:17.679 INFO:teuthology.orchestra.run.smithi181.stdout:(34/36): python3-webtest-2.0.33-1.el8.noarch.rp 5.0 MB/s | 85 kB 00:00 2021-02-24T15:14:17.686 INFO:teuthology.orchestra.run.smithi181.stdout:(35/36): python3-zc-lockfile-2.0-2.el8.noarch.r 1.2 MB/s | 23 kB 00:00 2021-02-24T15:14:17.925 INFO:teuthology.orchestra.run.smithi181.stdout:(36/36): ceph-osd-17.0.0-1076.gc089f21b.el8.x86 17 MB/s | 16 MB 00:00 2021-02-24T15:14:17.928 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:17.928 INFO:teuthology.orchestra.run.smithi181.stdout:Total 19 MB/s | 28 MB 00:01 2021-02-24T15:14:17.937 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:14:17.977 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:14:17.978 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:14:18.207 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:14:18.210 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:14:18.541 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:14:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2021-02-24T15:14:18.933 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2021-02-24T15:14:19.120 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2021-02-24T15:14:19.298 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2021-02-24T15:14:19.392 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:14:19.446 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 5/36 2021-02-24T15:14:19.601 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2021-02-24T15:14:19.602 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2021-02-24T15:14:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2021-02-24T15:14:19.758 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2021-02-24T15:14:19.952 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2021-02-24T15:14:20.017 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2021-02-24T15:14:20.153 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2021-02-24T15:14:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2021-02-24T15:14:20.307 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 5/36 2021-02-24T15:14:20.334 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2021-02-24T15:14:20.420 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2021-02-24T15:14:20.534 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 11/36 2021-02-24T15:14:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2021-02-24T15:14:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2021-02-24T15:14:20.752 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2021-02-24T15:14:20.888 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2021-02-24T15:14:20.889 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2021-02-24T15:14:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2021-02-24T15:14:21.101 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2021-02-24T15:14:21.260 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 11/36 2021-02-24T15:14:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.24.2-4.el8.noarch 15/36 2021-02-24T15:14:21.444 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2021-02-24T15:14:21.546 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2021-02-24T15:14:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2021-02-24T15:14:21.834 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2021-02-24T15:14:21.838 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2021-02-24T15:14:22.033 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2021-02-24T15:14:22.086 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.24.2-4.el8.noarch 15/36 2021-02-24T15:14:22.234 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2021-02-24T15:14:22.297 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2021-02-24T15:14:22.453 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2021-02-24T15:14:22.550 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2021-02-24T15:14:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2021-02-24T15:14:22.831 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2021-02-24T15:14:22.955 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2021-02-24T15:14:23.082 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/36 2021-02-24T15:14:23.138 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2021-02-24T15:14:23.279 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2021-02-24T15:14:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2021-02-24T15:14:23.498 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2021-02-24T15:14:23.614 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2021-02-24T15:14:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/36 2021-02-24T15:14:23.863 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2021-02-24T15:14:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2021-02-24T15:14:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2021-02-24T15:14:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2021-02-24T15:14:24.215 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2021-02-24T15:14:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2021-02-24T15:14:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2021-02-24T15:14:24.636 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2021-02-24T15:14:24.656 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2021-02-24T15:14:24.831 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2021-02-24T15:14:24.982 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2021-02-24T15:14:25.163 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2021-02-24T15:14:25.333 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-1076.gc089f21b.el8. 31/36 2021-02-24T15:14:25.455 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2021-02-24T15:14:25.490 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 32/36 2021-02-24T15:14:25.810 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-1076.gc089f21b.el8. 31/36 2021-02-24T15:14:25.976 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 32/36 2021-02-24T15:14:26.915 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 32/36 2021-02-24T15:14:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 32/36 2021-02-24T15:14:27.506 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:17.0.0-1076.gc089f21b.el8.x86_64 33/36 2021-02-24T15:14:27.601 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:17.0.0-1076.gc089f21b.el8.x86_64 33/36 2021-02-24T15:14:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:17.0.0-1076.gc089f21b.el8.x86_64 33/36 2021-02-24T15:14:27.963 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:17.0.0-1076.gc089f21b.el8.x86_64 33/36 2021-02-24T15:14:28.064 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:17.0.0-1076.gc089f21b.el8.x86_64 34/36 2021-02-24T15:14:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:17.0.0-1076.gc089f21b.el8.x86_64 34/36 2021-02-24T15:14:28.284 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:17.0.0-1076.gc089f21b.el8.x86_64 34/36 2021-02-24T15:14:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:17.0.0-1076.gc089f21b.el8.x86_64 34/36 2021-02-24T15:14:28.456 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:17.0.0-1076.gc089f21b.el8.x86_64 35/36 2021-02-24T15:14:28.476 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:17.0.0-1076.gc089f21b.el8.x86_64 35/36 2021-02-24T15:14:28.523 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:17.0.0-1076.gc089f21b.el8.x86_64 35/36 2021-02-24T15:14:28.543 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:17.0.0-1076.gc089f21b.el8.x86_64 35/36 2021-02-24T15:14:28.612 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:17.0.0-1076.gc089f21b.el8.x86_64 36/36 2021-02-24T15:14:28.652 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:17.0.0-1076.gc089f21b.el8.x86_64 36/36 2021-02-24T15:14:28.958 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-2:17.0.0-1076.gc089f21b.el8.x86_64 36/36 2021-02-24T15:14:28.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:17.0.0-1076.gc089f21b.el8.x86_64 1/36 2021-02-24T15:14:28.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:17.0.0-1076.gc089f21b.el8.x86_64 2/36 2021-02-24T15:14:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 3/36 2021-02-24T15:14:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:17.0.0-1076.gc089f21b.el8.x86_64 4/36 2021-02-24T15:14:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:17.0.0-1076.gc089f21b.el8.x86_64 5/36 2021-02-24T15:14:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-1076.gc089f21b.el8. 6/36 2021-02-24T15:14:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2021-02-24T15:14:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/36 2021-02-24T15:14:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2021-02-24T15:14:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2021-02-24T15:14:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2021-02-24T15:14:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2021-02-24T15:14:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2021-02-24T15:14:28.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2021-02-24T15:14:28.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2021-02-24T15:14:28.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2021-02-24T15:14:28.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.24.2-4.el8.noarch 17/36 2021-02-24T15:14:28.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2021-02-24T15:14:28.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2021-02-24T15:14:28.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 20/36 2021-02-24T15:14:28.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2021-02-24T15:14:28.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2021-02-24T15:14:28.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2021-02-24T15:14:28.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2021-02-24T15:14:28.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2021-02-24T15:14:28.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2021-02-24T15:14:28.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2021-02-24T15:14:28.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2021-02-24T15:14:28.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2021-02-24T15:14:28.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2021-02-24T15:14:28.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2021-02-24T15:14:28.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 32/36 2021-02-24T15:14:28.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2021-02-24T15:14:28.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2021-02-24T15:14:28.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2021-02-24T15:14:29.001 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-2:17.0.0-1076.gc089f21b.el8.x86_64 36/36 2021-02-24T15:14:29.002 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:17.0.0-1076.gc089f21b.el8.x86_64 1/36 2021-02-24T15:14:29.002 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:17.0.0-1076.gc089f21b.el8.x86_64 2/36 2021-02-24T15:14:29.002 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 3/36 2021-02-24T15:14:29.003 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:17.0.0-1076.gc089f21b.el8.x86_64 4/36 2021-02-24T15:14:29.003 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:17.0.0-1076.gc089f21b.el8.x86_64 5/36 2021-02-24T15:14:29.003 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-1076.gc089f21b.el8. 6/36 2021-02-24T15:14:29.003 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2021-02-24T15:14:29.004 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/36 2021-02-24T15:14:29.004 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2021-02-24T15:14:29.004 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2021-02-24T15:14:29.005 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2021-02-24T15:14:29.005 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2021-02-24T15:14:29.005 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2021-02-24T15:14:29.006 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2021-02-24T15:14:29.010 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2021-02-24T15:14:29.011 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2021-02-24T15:14:29.011 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.24.2-4.el8.noarch 17/36 2021-02-24T15:14:29.011 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2021-02-24T15:14:29.012 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2021-02-24T15:14:29.012 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 20/36 2021-02-24T15:14:29.012 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2021-02-24T15:14:29.012 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2021-02-24T15:14:29.013 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2021-02-24T15:14:29.013 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2021-02-24T15:14:29.013 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2021-02-24T15:14:29.013 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2021-02-24T15:14:29.014 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2021-02-24T15:14:29.016 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2021-02-24T15:14:29.016 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2021-02-24T15:14:29.016 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2021-02-24T15:14:29.016 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2021-02-24T15:14:29.017 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 32/36 2021-02-24T15:14:29.018 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2021-02-24T15:14:29.018 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2021-02-24T15:14:29.019 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2021-02-24T15:14:29.689 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2021-02-24T15:14:29.689 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:29.689 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:14:29.690 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.690 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.690 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.690 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:29.691 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.691 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.691 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-02-24T15:14:29.691 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-02-24T15:14:29.691 INFO:teuthology.orchestra.run.smithi152.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-02-24T15:14:29.692 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-02-24T15:14:29.692 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-02-24T15:14:29.692 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-02-24T15:14:29.692 INFO:teuthology.orchestra.run.smithi152.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-02-24T15:14:29.692 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-6.2-6.el8.noarch 2021-02-24T15:14:29.693 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-02-24T15:14:29.693 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-02-24T15:14:29.693 INFO:teuthology.orchestra.run.smithi152.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-02-24T15:14:29.693 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.0.6-13.el8.noarch 2021-02-24T15:14:29.694 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-02-24T15:14:29.694 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-02-24T15:14:29.694 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-02-24T15:14:29.694 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-2.6-1.el8.noarch 2021-02-24T15:14:29.694 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-02-24T15:14:29.695 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2017.2-9.el8.noarch 2021-02-24T15:14:29.695 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-02-24T15:14:29.695 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-02-24T15:14:29.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-02-24T15:14:29.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-02-24T15:14:29.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-02-24T15:14:29.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.24.2-4.el8.noarch 2021-02-24T15:14:29.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-02-24T15:14:29.697 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-02-24T15:14:29.697 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-02-24T15:14:29.697 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-02-24T15:14:29.697 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-02-24T15:14:29.698 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-02-24T15:14:29.698 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:29.700 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:14:29.765 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2021-02-24T15:14:29.765 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:29.766 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:14:29.766 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.766 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.766 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.767 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:29.767 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.767 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:29.767 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-02-24T15:14:29.767 INFO:teuthology.orchestra.run.smithi181.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-02-24T15:14:29.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-02-24T15:14:29.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-02-24T15:14:29.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-02-24T15:14:29.768 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-02-24T15:14:29.769 INFO:teuthology.orchestra.run.smithi181.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-02-24T15:14:29.770 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-6.2-6.el8.noarch 2021-02-24T15:14:29.770 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-02-24T15:14:29.770 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-02-24T15:14:29.770 INFO:teuthology.orchestra.run.smithi181.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-02-24T15:14:29.771 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.0.6-13.el8.noarch 2021-02-24T15:14:29.771 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-02-24T15:14:29.771 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-02-24T15:14:29.771 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-02-24T15:14:29.771 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-2.6-1.el8.noarch 2021-02-24T15:14:29.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-02-24T15:14:29.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2017.2-9.el8.noarch 2021-02-24T15:14:29.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-02-24T15:14:29.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-02-24T15:14:29.772 INFO:teuthology.orchestra.run.smithi181.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-02-24T15:14:29.773 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-02-24T15:14:29.773 INFO:teuthology.orchestra.run.smithi181.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-02-24T15:14:29.773 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.24.2-4.el8.noarch 2021-02-24T15:14:29.773 INFO:teuthology.orchestra.run.smithi181.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-02-24T15:14:29.773 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-02-24T15:14:29.775 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-02-24T15:14:29.776 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-02-24T15:14:29.776 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-02-24T15:14:29.776 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-02-24T15:14:29.776 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:29.776 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:14:29.921 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-base 2021-02-24T15:14:29.998 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-base 2021-02-24T15:14:30.383 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:03 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:30.457 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:03 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:30.754 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:14:30.795 INFO:teuthology.orchestra.run.smithi181.stdout:Package ceph-base-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:14:30.865 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:14:30.869 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2021-02-24T15:14:30.869 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:14:30.906 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:14:30.907 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2021-02-24T15:14:30.907 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:14:30.936 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install cephadm 2021-02-24T15:14:30.980 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install cephadm 2021-02-24T15:14:31.388 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:04 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:31.442 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:04 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:31.842 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:14:31.843 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:14:31.843 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:31.844 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:14:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 64 k 2021-02-24T15:14:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:31.844 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:14:31.844 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:31.845 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2021-02-24T15:14:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:31.845 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 64 k 2021-02-24T15:14:31.845 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 281 k 2021-02-24T15:14:31.845 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:14:31.909 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:14:31.910 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:14:31.911 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:31.911 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:14:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 64 k 2021-02-24T15:14:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:31.911 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:14:31.912 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:31.912 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2021-02-24T15:14:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:31.912 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 64 k 2021-02-24T15:14:31.912 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 281 k 2021-02-24T15:14:31.913 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:14:31.990 INFO:teuthology.orchestra.run.smithi152.stdout:cephadm-17.0.0-1076.gc089f21b.el8.noarch.rpm 440 kB/s | 64 kB 00:00 2021-02-24T15:14:31.991 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:31.991 INFO:teuthology.orchestra.run.smithi152.stdout:Total 436 kB/s | 64 kB 00:00 2021-02-24T15:14:31.992 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:14:31.999 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:14:32.000 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:14:32.002 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:14:32.007 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:14:32.049 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:14:32.058 INFO:teuthology.orchestra.run.smithi181.stdout:cephadm-17.0.0-1076.gc089f21b.el8.noarch.rpm 439 kB/s | 64 kB 00:00 2021-02-24T15:14:32.058 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:32.059 INFO:teuthology.orchestra.run.smithi181.stdout:Total 435 kB/s | 64 kB 00:00 2021-02-24T15:14:32.059 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:14:32.071 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:14:32.071 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:14:32.071 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:14:32.072 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:14:32.114 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:14:33.622 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/1 2021-02-24T15:14:33.779 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/1 2021-02-24T15:14:33.949 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/1 2021-02-24T15:14:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/1 2021-02-24T15:14:34.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/1 2021-02-24T15:14:34.189 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:34.189 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:14:34.189 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:34.190 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:34.190 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:14:34.218 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/1 2021-02-24T15:14:34.353 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-immutable-object-cache 2021-02-24T15:14:34.389 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/1 2021-02-24T15:14:34.685 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/1 2021-02-24T15:14:34.686 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:34.686 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:14:34.686 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:34.687 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:34.687 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:14:34.820 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:07 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:34.837 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-immutable-object-cache 2021-02-24T15:14:35.276 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:14:35.277 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:35.277 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2021-02-24T15:14:35.278 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:35.278 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:14:35.278 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 156 k 2021-02-24T15:14:35.278 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:35.278 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:14:35.279 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:35.279 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2021-02-24T15:14:35.279 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:35.279 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 156 k 2021-02-24T15:14:35.280 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 587 k 2021-02-24T15:14:35.280 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:14:35.301 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:08 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:35.487 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-immutable-object-cache-17.0.0-1076.gc089f2 746 kB/s | 156 kB 00:00 2021-02-24T15:14:35.488 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:35.488 INFO:teuthology.orchestra.run.smithi181.stdout:Total 740 kB/s | 156 kB 00:00 2021-02-24T15:14:35.489 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:14:35.502 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:14:35.503 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:14:35.551 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:14:35.564 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:14:35.776 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:14:35.777 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:35.777 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2021-02-24T15:14:35.777 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:35.778 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:14:35.778 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 156 k 2021-02-24T15:14:35.778 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:35.778 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:14:35.778 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:35.779 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2021-02-24T15:14:35.779 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:35.779 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 156 k 2021-02-24T15:14:35.779 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 587 k 2021-02-24T15:14:35.780 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:14:35.862 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:14:35.947 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-immutable-object-cache-17.0.0-1076.gc089f2 919 kB/s | 156 kB 00:00 2021-02-24T15:14:35.948 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:35.948 INFO:teuthology.orchestra.run.smithi152.stdout:Total 912 kB/s | 156 kB 00:00 2021-02-24T15:14:35.949 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:14:35.961 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:14:35.962 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:14:36.008 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:14:36.010 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:14:36.055 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-1076.gc089f21b. 1/1 2021-02-24T15:14:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:14:36.345 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-1076.gc089f21b. 1/1 2021-02-24T15:14:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-1076.gc089f21b. 1/1 2021-02-24T15:14:36.626 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-1076.gc089f21b. 1/1 2021-02-24T15:14:36.626 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:36.627 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:14:36.627 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:36.627 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:36.627 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:14:36.692 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-1076.gc089f21b. 1/1 2021-02-24T15:14:36.783 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr 2021-02-24T15:14:36.943 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-1076.gc089f21b. 1/1 2021-02-24T15:14:36.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:36.943 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:14:36.943 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:14:36.944 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:36.944 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:14:37.167 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr 2021-02-24T15:14:37.241 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:10 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:37.586 INFO:teuthology.orchestra.run.smithi181.stdout:Package ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:14:37.630 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:10 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:37.700 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:14:37.701 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2021-02-24T15:14:37.701 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:14:37.767 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-dashboard 2021-02-24T15:14:37.970 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-mgr-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:14:38.086 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:14:38.087 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2021-02-24T15:14:38.087 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:14:38.160 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-dashboard 2021-02-24T15:14:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:11 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:38.612 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:11 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:38.680 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:14:38.681 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:38.681 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:14:38.681 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:38.682 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:14:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 2.2 M 2021-02-24T15:14:38.682 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2021-02-24T15:14:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 23 k 2021-02-24T15:14:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 8.9 k 2021-02-24T15:14:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-02-24T15:14:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-02-24T15:14:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-02-24T15:14:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:38.684 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:14:38.684 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:14:38.684 INFO:teuthology.orchestra.run.smithi181.stdout:Install 6 Packages 2021-02-24T15:14:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:38.685 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 2.5 M 2021-02-24T15:14:38.685 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 15 M 2021-02-24T15:14:38.685 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:14:38.794 INFO:teuthology.orchestra.run.smithi181.stdout:(1/6): ceph-prometheus-alerts-17.0.0-1076.gc089 81 kB/s | 8.9 kB 00:00 2021-02-24T15:14:38.807 INFO:teuthology.orchestra.run.smithi181.stdout:(2/6): ceph-grafana-dashboards-17.0.0-1076.gc08 185 kB/s | 23 kB 00:00 2021-02-24T15:14:38.825 INFO:teuthology.orchestra.run.smithi181.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2021-02-24T15:14:38.867 INFO:teuthology.orchestra.run.smithi181.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 562 kB/s | 34 kB 00:00 2021-02-24T15:14:38.906 INFO:teuthology.orchestra.run.smithi181.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.4 MB/s | 196 kB 00:00 2021-02-24T15:14:38.981 INFO:teuthology.orchestra.run.smithi181.stdout:(6/6): ceph-mgr-dashboard-17.0.0-1076.gc089f21b 7.6 MB/s | 2.2 MB 00:00 2021-02-24T15:14:38.983 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:38.983 INFO:teuthology.orchestra.run.smithi181.stdout:Total 8.5 MB/s | 2.5 MB 00:00 2021-02-24T15:14:38.984 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:14:38.994 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:14:38.994 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:14:39.068 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:14:39.069 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:39.069 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:14:39.070 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:39.070 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:14:39.070 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 2.2 M 2021-02-24T15:14:39.071 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2021-02-24T15:14:39.071 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 23 k 2021-02-24T15:14:39.071 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 8.9 k 2021-02-24T15:14:39.071 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-02-24T15:14:39.072 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-02-24T15:14:39.072 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-02-24T15:14:39.072 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:39.072 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:14:39.072 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:14:39.073 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2021-02-24T15:14:39.073 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:39.074 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 2.5 M 2021-02-24T15:14:39.074 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 15 M 2021-02-24T15:14:39.075 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:14:39.101 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:14:39.104 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:14:39.182 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): ceph-prometheus-alerts-17.0.0-1076.gc089 81 kB/s | 8.9 kB 00:00 2021-02-24T15:14:39.197 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): ceph-grafana-dashboards-17.0.0-1076.gc08 182 kB/s | 23 kB 00:00 2021-02-24T15:14:39.213 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2021-02-24T15:14:39.257 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 563 kB/s | 34 kB 00:00 2021-02-24T15:14:39.309 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.0 MB/s | 196 kB 00:00 2021-02-24T15:14:39.382 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:14:39.460 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): ceph-mgr-dashboard-17.0.0-1076.gc089f21b 5.8 MB/s | 2.2 MB 00:00 2021-02-24T15:14:39.466 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:39.466 INFO:teuthology.orchestra.run.smithi152.stdout:Total 6.5 MB/s | 2.5 MB 00:00 2021-02-24T15:14:39.467 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:14:39.479 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:14:39.479 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:14:39.577 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:14:39.578 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-02-24T15:14:39.580 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:14:39.822 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-02-24T15:14:39.856 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:14:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-02-24T15:14:40.094 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-02-24T15:14:40.102 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-1076.gc089f21b.el8.n 4/6 2021-02-24T15:14:40.346 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-02-24T15:14:40.555 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-02-24T15:14:40.668 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-1076.gc089f21b.el8.n 4/6 2021-02-24T15:14:41.080 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-1076.gc089f21b.el8. 5/6 2021-02-24T15:14:41.681 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-1076.gc089f21b.el8. 5/6 2021-02-24T15:14:41.937 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-1076.gc089f21b.el8.noarc 6/6 2021-02-24T15:14:42.204 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-1076.gc089f21b.el8.noarc 6/6 2021-02-24T15:14:42.204 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-1076.gc089f21b.el8. 1/6 2021-02-24T15:14:42.205 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-1076.gc089f21b.el8.noarc 2/6 2021-02-24T15:14:42.205 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-1076.gc089f21b.el8.n 3/6 2021-02-24T15:14:42.205 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-02-24T15:14:42.205 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-02-24T15:14:42.500 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-02-24T15:14:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:42.501 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:14:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-02-24T15:14:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-02-24T15:14:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.4.1-12.el8.noarch 2021-02-24T15:14:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:42.503 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:14:42.570 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-diskprediction-local 2021-02-24T15:14:43.022 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:16 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:43.023 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-1076.gc089f21b.el8.noarc 6/6 2021-02-24T15:14:43.255 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-1076.gc089f21b.el8.noarc 6/6 2021-02-24T15:14:43.256 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-1076.gc089f21b.el8. 1/6 2021-02-24T15:14:43.256 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-1076.gc089f21b.el8.noarc 2/6 2021-02-24T15:14:43.256 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-1076.gc089f21b.el8.n 3/6 2021-02-24T15:14:43.256 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-02-24T15:14:43.257 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-02-24T15:14:43.551 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-02-24T15:14:43.552 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:43.552 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:14:43.552 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:43.552 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:43.553 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:43.553 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-02-24T15:14:43.553 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-02-24T15:14:43.554 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.4.1-12.el8.noarch 2021-02-24T15:14:43.554 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:43.555 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:14:43.625 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-diskprediction-local 2021-02-24T15:14:43.722 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:14:43.723 INFO:teuthology.orchestra.run.smithi152.stdout:===================================================================================================== 2021-02-24T15:14:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:14:43.724 INFO:teuthology.orchestra.run.smithi152.stdout:===================================================================================================== 2021-02-24T15:14:43.724 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:14:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 7.4 M 2021-02-24T15:14:43.724 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2021-02-24T15:14:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 8.3.1-5.1.el8 CentOS-Base 639 k 2021-02-24T15:14:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 8.3.1-5.1.el8 CentOS-Base 169 k 2021-02-24T15:14:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-24T15:14:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-24T15:14:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-02-24T15:14:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-02-24T15:14:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.0.0-20.module_el8.3.0+562+e162826a CentOS-AppStream 15 M 2021-02-24T15:14:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:14:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:===================================================================================================== 2021-02-24T15:14:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:Install 8 Packages 2021-02-24T15:14:43.727 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 35 M 2021-02-24T15:14:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 194 M 2021-02-24T15:14:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:14:44.078 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:17 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:44.378 INFO:teuthology.orchestra.run.smithi152.stdout:(1/8): ceph-mgr-diskprediction-local-17.0.0-107 11 MB/s | 7.4 MB 00:00 2021-02-24T15:14:44.531 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:14:44.532 INFO:teuthology.orchestra.run.smithi181.stdout:===================================================================================================== 2021-02-24T15:14:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:14:44.533 INFO:teuthology.orchestra.run.smithi181.stdout:===================================================================================================== 2021-02-24T15:14:44.533 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:14:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 7.4 M 2021-02-24T15:14:44.533 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2021-02-24T15:14:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 8.3.1-5.1.el8 CentOS-Base 639 k 2021-02-24T15:14:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 8.3.1-5.1.el8 CentOS-Base 169 k 2021-02-24T15:14:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-24T15:14:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-threads x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-24T15:14:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-02-24T15:14:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-02-24T15:14:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.0.0-20.module_el8.3.0+562+e162826a CentOS-AppStream 15 M 2021-02-24T15:14:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:44.535 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:14:44.536 INFO:teuthology.orchestra.run.smithi181.stdout:===================================================================================================== 2021-02-24T15:14:44.536 INFO:teuthology.orchestra.run.smithi181.stdout:Install 8 Packages 2021-02-24T15:14:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:44.537 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 35 M 2021-02-24T15:14:44.537 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 194 M 2021-02-24T15:14:44.537 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:14:44.563 INFO:teuthology.orchestra.run.smithi152.stdout:(2/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 5.2 MB/s | 4.3 MB 00:00 2021-02-24T15:14:44.604 INFO:teuthology.orchestra.run.smithi152.stdout:(3/8): openblas-0.3.3-5.el8.x86_64.rpm 4.8 MB/s | 4.3 MB 00:00 2021-02-24T15:14:44.686 INFO:teuthology.orchestra.run.smithi181.stdout:(1/8): openblas-0.3.3-5.el8.x86_64.rpm 28 MB/s | 4.3 MB 00:00 2021-02-24T15:14:44.705 INFO:teuthology.orchestra.run.smithi152.stdout:(4/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 1.6 MB/s | 225 kB 00:00 2021-02-24T15:14:44.732 INFO:teuthology.orchestra.run.smithi152.stdout:(5/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 23 MB/s | 639 kB 00:00 2021-02-24T15:14:44.746 INFO:teuthology.orchestra.run.smithi181.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 62 MB/s | 3.7 MB 00:00 2021-02-24T15:14:44.750 INFO:teuthology.orchestra.run.smithi181.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 61 MB/s | 225 kB 00:00 2021-02-24T15:14:44.785 INFO:teuthology.orchestra.run.smithi152.stdout:(6/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 3.1 MB/s | 169 kB 00:00 2021-02-24T15:14:45.026 INFO:teuthology.orchestra.run.smithi181.stdout:(4/8): ceph-mgr-diskprediction-local-17.0.0-107 15 MB/s | 7.4 MB 00:00 2021-02-24T15:14:45.104 INFO:teuthology.orchestra.run.smithi152.stdout:(7/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 5.2 MB/s | 3.7 MB 00:00 2021-02-24T15:14:45.128 INFO:teuthology.orchestra.run.smithi181.stdout:(5/8): python3-scipy-1.0.0-20.module_el8.3.0+56 38 MB/s | 15 MB 00:00 2021-02-24T15:14:45.152 INFO:teuthology.orchestra.run.smithi181.stdout:(6/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 8.9 MB/s | 169 kB 00:00 2021-02-24T15:14:45.215 INFO:teuthology.orchestra.run.smithi181.stdout:(7/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 3.3 MB/s | 639 kB 00:00 2021-02-24T15:14:45.227 INFO:teuthology.orchestra.run.smithi181.stdout:(8/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 6.3 MB/s | 4.3 MB 00:00 2021-02-24T15:14:45.230 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:45.231 INFO:teuthology.orchestra.run.smithi181.stdout:Total 51 MB/s | 35 MB 00:00 2021-02-24T15:14:45.239 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:14:45.259 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:14:45.259 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:14:45.348 INFO:teuthology.orchestra.run.smithi152.stdout:(8/8): python3-scipy-1.0.0-20.module_el8.3.0+56 20 MB/s | 15 MB 00:00 2021-02-24T15:14:45.352 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:45.352 INFO:teuthology.orchestra.run.smithi152.stdout:Total 22 MB/s | 35 MB 00:01 2021-02-24T15:14:45.361 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:14:45.382 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:14:45.382 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:14:45.545 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:14:45.547 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:14:45.665 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:14:45.668 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:14:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:14:46.195 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-24T15:14:46.260 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:14:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-24T15:14:46.427 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-24T15:14:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-24T15:14:46.550 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-24T15:14:46.677 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-24T15:14:46.969 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-24T15:14:47.128 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.3-5.el8.x86_64 3/8 2021-02-24T15:14:47.218 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-24T15:14:47.386 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.3-5.el8.x86_64 3/8 2021-02-24T15:14:47.629 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 3/8 2021-02-24T15:14:47.794 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-02-24T15:14:47.887 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 3/8 2021-02-24T15:14:48.052 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-02-24T15:14:48.493 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-02-24T15:14:48.770 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-02-24T15:14:48.960 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-02-24T15:14:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-02-24T15:14:49.169 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-24T15:14:49.351 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-24T15:14:51.093 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-24T15:14:51.272 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-24T15:14:52.345 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 7/8 2021-02-24T15:14:52.502 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-1076.gc089f21 8/8 2021-02-24T15:14:52.703 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 7/8 2021-02-24T15:14:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-1076.gc089f21 8/8 2021-02-24T15:14:52.762 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-1076.gc089f21 8/8 2021-02-24T15:14:52.762 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-1076.gc089f21 1/8 2021-02-24T15:14:52.762 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 2/8 2021-02-24T15:14:52.763 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-02-24T15:14:52.763 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-02-24T15:14:52.763 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-02-24T15:14:52.763 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 6/8 2021-02-24T15:14:52.764 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 7/8 2021-02-24T15:14:52.962 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-1076.gc089f21 8/8 2021-02-24T15:14:52.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-1076.gc089f21 1/8 2021-02-24T15:14:52.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 2/8 2021-02-24T15:14:52.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-02-24T15:14:52.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-02-24T15:14:52.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-02-24T15:14:52.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 6/8 2021-02-24T15:14:52.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 7/8 2021-02-24T15:14:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 8/8 2021-02-24T15:14:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:53.041 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:14:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-02-24T15:14:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-02-24T15:14:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.3-5.el8.x86_64 2021-02-24T15:14:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-02-24T15:14:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-02-24T15:14:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-02-24T15:14:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x86_64 2021-02-24T15:14:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:53.043 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:14:53.117 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-rook 2021-02-24T15:14:53.257 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 8/8 2021-02-24T15:14:53.257 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:53.258 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:14:53.258 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:14:53.258 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-02-24T15:14:53.258 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-02-24T15:14:53.258 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.3-5.el8.x86_64 2021-02-24T15:14:53.259 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-02-24T15:14:53.259 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-02-24T15:14:53.259 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-02-24T15:14:53.259 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x86_64 2021-02-24T15:14:53.260 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:53.260 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:14:53.333 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-rook 2021-02-24T15:14:53.575 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:26 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:53.786 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:26 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:14:54.147 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:14:54.148 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================== 2021-02-24T15:14:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:14:54.149 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================== 2021-02-24T15:14:54.149 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:14:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 27 k 2021-02-24T15:14:54.150 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2021-02-24T15:14:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-02-24T15:14:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-02-24T15:14:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-02-24T15:14:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-02-24T15:14:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-02-24T15:14:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-02-24T15:14:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-02-24T15:14:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-02-24T15:14:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-02-24T15:14:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-02-24T15:14:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-02-24T15:14:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-02-24T15:14:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:54.153 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:14:54.153 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================== 2021-02-24T15:14:54.153 INFO:teuthology.orchestra.run.smithi181.stdout:Install 13 Packages 2021-02-24T15:14:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:14:54.155 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 1.9 M 2021-02-24T15:14:54.155 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 24 M 2021-02-24T15:14:54.155 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:14:54.184 INFO:teuthology.orchestra.run.smithi181.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 874 kB/s | 27 kB 00:00 2021-02-24T15:14:54.186 INFO:teuthology.orchestra.run.smithi181.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 36 MB/s | 126 kB 00:00 2021-02-24T15:14:54.187 INFO:teuthology.orchestra.run.smithi181.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 579 kB/s | 20 kB 00:00 2021-02-24T15:14:54.189 INFO:teuthology.orchestra.run.smithi181.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 32 MB/s | 110 kB 00:00 2021-02-24T15:14:54.190 INFO:teuthology.orchestra.run.smithi181.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 40 MB/s | 155 kB 00:00 2021-02-24T15:14:54.191 INFO:teuthology.orchestra.run.smithi181.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 30 MB/s | 43 kB 00:00 2021-02-24T15:14:54.240 INFO:teuthology.orchestra.run.smithi181.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 335 kB/s | 16 kB 00:00 2021-02-24T15:14:54.254 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:14:54.255 INFO:teuthology.orchestra.run.smithi181.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 556 kB/s | 33 kB 00:00 2021-02-24T15:14:54.256 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================== 2021-02-24T15:14:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:14:54.256 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================== 2021-02-24T15:14:54.256 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:14:54.257 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 27 k 2021-02-24T15:14:54.257 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2021-02-24T15:14:54.257 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-02-24T15:14:54.257 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-02-24T15:14:54.257 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-02-24T15:14:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-02-24T15:14:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-02-24T15:14:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-02-24T15:14:54.258 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-02-24T15:14:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-02-24T15:14:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-02-24T15:14:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-02-24T15:14:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-02-24T15:14:54.259 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-02-24T15:14:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:54.260 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:14:54.260 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================== 2021-02-24T15:14:54.260 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2021-02-24T15:14:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:14:54.261 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 1.9 M 2021-02-24T15:14:54.261 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 24 M 2021-02-24T15:14:54.261 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:14:54.288 INFO:teuthology.orchestra.run.smithi181.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 1.7 MB/s | 81 kB 00:00 2021-02-24T15:14:54.289 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 864 kB/s | 27 kB 00:00 2021-02-24T15:14:54.292 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 39 MB/s | 126 kB 00:00 2021-02-24T15:14:54.292 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 578 kB/s | 20 kB 00:00 2021-02-24T15:14:54.295 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 41 MB/s | 110 kB 00:00 2021-02-24T15:14:54.297 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 38 MB/s | 155 kB 00:00 2021-02-24T15:14:54.297 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 20 MB/s | 43 kB 00:00 2021-02-24T15:14:54.305 INFO:teuthology.orchestra.run.smithi181.stdout:(10/13): python3-rsa-3.4.2-16.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2021-02-24T15:14:54.323 INFO:teuthology.orchestra.run.smithi181.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.6 MB/s | 61 kB 00:00 2021-02-24T15:14:54.356 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 277 kB/s | 16 kB 00:00 2021-02-24T15:14:54.357 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 553 kB/s | 33 kB 00:00 2021-02-24T15:14:54.395 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 2.0 MB/s | 81 kB 00:00 2021-02-24T15:14:54.406 INFO:teuthology.orchestra.run.smithi181.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 7.5 MB/s | 1.2 MB 00:00 2021-02-24T15:14:54.415 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): python3-rsa-3.4.2-16.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2021-02-24T15:14:54.436 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.0 MB/s | 61 kB 00:00 2021-02-24T15:14:54.531 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 6.7 MB/s | 1.2 MB 00:00 2021-02-24T15:14:54.544 INFO:teuthology.orchestra.run.smithi181.stdout:(13/13): ceph-mgr-rook-17.0.0-1076.gc089f21b.el 68 kB/s | 27 kB 00:00 2021-02-24T15:14:54.545 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:54.546 INFO:teuthology.orchestra.run.smithi181.stdout:Total 4.9 MB/s | 1.9 MB 00:00 2021-02-24T15:14:54.551 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:14:54.566 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:14:54.566 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:14:54.635 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:14:54.637 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:14:54.652 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): ceph-mgr-rook-17.0.0-1076.gc089f21b.el 68 kB/s | 27 kB 00:00 2021-02-24T15:14:54.654 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:14:54.654 INFO:teuthology.orchestra.run.smithi152.stdout:Total 4.8 MB/s | 1.9 MB 00:00 2021-02-24T15:14:54.659 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:14:54.675 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:14:54.675 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:14:54.746 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:14:54.746 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:14:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:14:55.251 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:14:55.348 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-02-24T15:14:55.515 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-02-24T15:14:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-02-24T15:14:55.797 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 3/13 2021-02-24T15:14:56.010 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-02-24T15:14:56.176 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-02-24T15:14:56.365 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-02-24T15:14:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-02-24T15:14:56.600 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 3/13 2021-02-24T15:14:56.666 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-02-24T15:14:56.862 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-02-24T15:14:56.868 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-02-24T15:14:57.035 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-02-24T15:14:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-02-24T15:14:57.548 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-02-24T15:14:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-02-24T15:14:57.921 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-02-24T15:14:58.167 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-02-24T15:14:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-02-24T15:14:58.502 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-02-24T15:14:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:17.0.0-1076.gc089f21b.el8.noarch 13/13 2021-02-24T15:14:58.884 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-1076.gc089f21b.el8.noarch 13/13 2021-02-24T15:14:58.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:17.0.0-1076.gc089f21b.el8.noarch 1/13 2021-02-24T15:14:58.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-02-24T15:14:58.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-02-24T15:14:58.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-02-24T15:14:58.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-02-24T15:14:58.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-02-24T15:14:58.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-02-24T15:14:58.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-02-24T15:14:58.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-02-24T15:14:58.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-02-24T15:14:58.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-02-24T15:14:58.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 12/13 2021-02-24T15:14:58.893 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-02-24T15:14:59.128 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-02-24T15:14:59.316 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-02-24T15:14:59.499 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-02-24T15:14:59.675 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:17.0.0-1076.gc089f21b.el8.noarch 13/13 2021-02-24T15:14:59.914 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-1076.gc089f21b.el8.noarch 13/13 2021-02-24T15:14:59.914 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:17.0.0-1076.gc089f21b.el8.noarch 1/13 2021-02-24T15:14:59.914 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-02-24T15:14:59.915 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-02-24T15:14:59.915 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-02-24T15:14:59.915 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-02-24T15:14:59.915 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-02-24T15:14:59.915 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-02-24T15:14:59.916 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-02-24T15:14:59.916 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-02-24T15:14:59.916 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-02-24T15:14:59.916 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-02-24T15:14:59.916 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 12/13 2021-02-24T15:15:00.015 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-02-24T15:15:00.015 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:00.015 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:15:00.016 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:15:00.016 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-02-24T15:15:00.016 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-02-24T15:15:00.016 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-02-24T15:15:00.016 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-02-24T15:15:00.017 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-02-24T15:15:00.017 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-02-24T15:15:00.017 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-02-24T15:15:00.017 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-02-24T15:15:00.018 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-02-24T15:15:00.018 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-02-24T15:15:00.018 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-02-24T15:15:00.018 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-02-24T15:15:00.018 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:00.019 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:00.084 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-cephadm 2021-02-24T15:15:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-02-24T15:15:00.274 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:00.275 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:15:00.275 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:15:00.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-02-24T15:15:00.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-02-24T15:15:00.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-02-24T15:15:00.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-02-24T15:15:00.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-02-24T15:15:00.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-02-24T15:15:00.277 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-02-24T15:15:00.277 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-02-24T15:15:00.277 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-02-24T15:15:00.277 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-02-24T15:15:00.277 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-02-24T15:15:00.278 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-02-24T15:15:00.278 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:00.279 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:00.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-cephadm 2021-02-24T15:15:00.540 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:33 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:00.810 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:33 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:01.001 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:01.002 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:01.003 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:15:01.003 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:01.003 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:15:01.003 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 73 k 2021-02-24T15:15:01.004 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2021-02-24T15:15:01.004 INFO:teuthology.orchestra.run.smithi181.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-02-24T15:15:01.004 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-02-24T15:15:01.004 INFO:teuthology.orchestra.run.smithi181.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-02-24T15:15:01.004 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-02-24T15:15:01.005 INFO:teuthology.orchestra.run.smithi181.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-02-24T15:15:01.005 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:01.005 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:15:01.005 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:01.005 INFO:teuthology.orchestra.run.smithi181.stdout:Install 6 Packages 2021-02-24T15:15:01.006 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:01.006 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 5.8 M 2021-02-24T15:15:01.007 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 24 M 2021-02-24T15:15:01.007 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:15:01.059 INFO:teuthology.orchestra.run.smithi181.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 9.9 MB/s | 538 kB 00:00 2021-02-24T15:15:01.102 INFO:teuthology.orchestra.run.smithi181.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 49 MB/s | 4.8 MB 00:00 2021-02-24T15:15:01.108 INFO:teuthology.orchestra.run.smithi181.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 429 kB/s | 21 kB 00:00 2021-02-24T15:15:01.141 INFO:teuthology.orchestra.run.smithi181.stdout:(4/6): python3-remoto-1.1.4-4.el8.noarch.rpm 1.4 MB/s | 48 kB 00:00 2021-02-24T15:15:01.152 INFO:teuthology.orchestra.run.smithi181.stdout:(5/6): ceph-mgr-cephadm-17.0.0-1076.gc089f21b.e 496 kB/s | 73 kB 00:00 2021-02-24T15:15:01.200 INFO:teuthology.orchestra.run.smithi181.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 3.6 MB/s | 355 kB 00:00 2021-02-24T15:15:01.201 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:01.202 INFO:teuthology.orchestra.run.smithi181.stdout:Total 29 MB/s | 5.8 MB 00:00 2021-02-24T15:15:01.204 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:15:01.218 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:15:01.218 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:15:01.263 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:01.264 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:01.264 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:15:01.265 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:01.265 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:15:01.265 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:17.0.0-1076.gc089f21b.el8 ceph-noarch 73 k 2021-02-24T15:15:01.265 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2021-02-24T15:15:01.265 INFO:teuthology.orchestra.run.smithi152.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-02-24T15:15:01.266 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-02-24T15:15:01.266 INFO:teuthology.orchestra.run.smithi152.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-02-24T15:15:01.266 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-02-24T15:15:01.266 INFO:teuthology.orchestra.run.smithi152.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-02-24T15:15:01.267 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:01.267 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:15:01.267 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:01.267 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2021-02-24T15:15:01.274 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:01.275 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 5.8 M 2021-02-24T15:15:01.275 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 24 M 2021-02-24T15:15:01.276 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:15:01.290 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:15:01.293 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:15:01.370 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 5.1 MB/s | 538 kB 00:00 2021-02-24T15:15:01.522 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2021-02-24T15:15:01.529 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 133 kB/s | 21 kB 00:00 2021-02-24T15:15:01.535 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): ceph-mgr-cephadm-17.0.0-1076.gc089f21b.e 272 kB/s | 73 kB 00:00 2021-02-24T15:15:01.561 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:15:01.593 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): python3-remoto-1.1.4-4.el8.noarch.rpm 753 kB/s | 48 kB 00:00 2021-02-24T15:15:01.717 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.8 MB/s | 355 kB 00:00 2021-02-24T15:15:01.719 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:01.719 INFO:teuthology.orchestra.run.smithi152.stdout:Total 13 MB/s | 5.8 MB 00:00 2021-02-24T15:15:01.722 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:15:01.732 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:15:01.732 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:15:01.804 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-02-24T15:15:01.809 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:15:01.812 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:15:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-02-24T15:15:02.339 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:15:02.635 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-02-24T15:15:02.904 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-02-24T15:15:03.004 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2021-02-24T15:15:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-02-24T15:15:03.546 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-02-24T15:15:03.700 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 6/6 2021-02-24T15:15:03.871 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2021-02-24T15:15:03.936 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 6/6 2021-02-24T15:15:03.937 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/6 2021-02-24T15:15:03.937 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-02-24T15:15:03.937 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-02-24T15:15:03.937 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-02-24T15:15:03.938 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-02-24T15:15:04.210 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-02-24T15:15:04.214 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2021-02-24T15:15:04.214 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:04.215 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:15:04.215 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:15:04.215 INFO:teuthology.orchestra.run.smithi181.stdout: python3-apipkg-1.5-6.el8.noarch 2021-02-24T15:15:04.215 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.5.1-5.el8.noarch 2021-02-24T15:15:04.215 INFO:teuthology.orchestra.run.smithi181.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-02-24T15:15:04.216 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-02-24T15:15:04.216 INFO:teuthology.orchestra.run.smithi181.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-02-24T15:15:04.216 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:04.216 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:04.281 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-fuse 2021-02-24T15:15:04.420 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-02-24T15:15:04.624 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 6/6 2021-02-24T15:15:04.736 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:37 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:04.844 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 6/6 2021-02-24T15:15:04.844 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 1/6 2021-02-24T15:15:04.844 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-02-24T15:15:04.845 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-02-24T15:15:04.845 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-02-24T15:15:04.845 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-02-24T15:15:05.115 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2021-02-24T15:15:05.116 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:05.116 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:15:05.116 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:17.0.0-1076.gc089f21b.el8.noarch 2021-02-24T15:15:05.116 INFO:teuthology.orchestra.run.smithi152.stdout: python3-apipkg-1.5-6.el8.noarch 2021-02-24T15:15:05.117 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.5.1-5.el8.noarch 2021-02-24T15:15:05.117 INFO:teuthology.orchestra.run.smithi152.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-02-24T15:15:05.117 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-02-24T15:15:05.118 INFO:teuthology.orchestra.run.smithi152.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-02-24T15:15:05.118 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:05.118 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:05.188 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-fuse 2021-02-24T15:15:05.473 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:05.474 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:05.474 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2021-02-24T15:15:05.474 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:05.474 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:15:05.475 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 824 k 2021-02-24T15:15:05.475 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2021-02-24T15:15:05.475 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-02-24T15:15:05.475 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2021-02-24T15:15:05.476 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:05.476 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:15:05.476 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:05.476 INFO:teuthology.orchestra.run.smithi181.stdout:Install 3 Packages 2021-02-24T15:15:05.476 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:05.477 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 928 k 2021-02-24T15:15:05.477 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 3.2 M 2021-02-24T15:15:05.477 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:15:05.506 INFO:teuthology.orchestra.run.smithi181.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 82 kB 00:00 2021-02-24T15:15:05.509 INFO:teuthology.orchestra.run.smithi181.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 613 kB/s | 21 kB 00:00 2021-02-24T15:15:05.645 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:38 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:06.112 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:06.112 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:06.113 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2021-02-24T15:15:06.113 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:06.113 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:15:06.114 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 824 k 2021-02-24T15:15:06.114 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2021-02-24T15:15:06.114 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-02-24T15:15:06.114 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2021-02-24T15:15:06.115 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:06.115 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:15:06.115 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:06.115 INFO:teuthology.orchestra.run.smithi152.stdout:Install 3 Packages 2021-02-24T15:15:06.115 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:06.116 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 928 k 2021-02-24T15:15:06.117 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 3.2 M 2021-02-24T15:15:06.118 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:15:06.145 INFO:teuthology.orchestra.run.smithi152.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 82 kB 00:00 2021-02-24T15:15:06.149 INFO:teuthology.orchestra.run.smithi152.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 619 kB/s | 21 kB 00:00 2021-02-24T15:15:06.500 INFO:teuthology.orchestra.run.smithi181.stdout:(3/3): ceph-fuse-17.0.0-1076.gc089f21b.el8.x86_ 804 kB/s | 824 kB 00:01 2021-02-24T15:15:06.503 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:06.503 INFO:teuthology.orchestra.run.smithi181.stdout:Total 901 kB/s | 928 kB 00:01 2021-02-24T15:15:06.506 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:15:06.530 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:15:06.530 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:15:06.610 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:15:06.612 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:15:06.707 INFO:teuthology.orchestra.run.smithi152.stdout:(3/3): ceph-fuse-17.0.0-1076.gc089f21b.el8.x86_ 1.4 MB/s | 824 kB 00:00 2021-02-24T15:15:06.709 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:06.709 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.5 MB/s | 928 kB 00:00 2021-02-24T15:15:06.711 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:15:06.734 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:15:06.735 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:15:06.787 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:15:06.787 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2021-02-24T15:15:06.788 INFO:teuthology.orchestra.run.smithi181.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2021-02-24T15:15:06.788 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:06.808 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:15:06.811 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:15:07.208 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-24T15:15:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 3/3 2021-02-24T15:15:07.482 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:15:07.483 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2021-02-24T15:15:07.483 INFO:teuthology.orchestra.run.smithi152.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2021-02-24T15:15:07.483 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:07.745 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 3/3 2021-02-24T15:15:07.745 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 1/3 2021-02-24T15:15:07.746 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-24T15:15:07.948 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-24T15:15:08.076 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2021-02-24T15:15:08.076 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:08.076 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:15:08.076 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-02-24T15:15:08.077 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-common-3.2.1-12.el8.x86_64 2021-02-24T15:15:08.077 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:08.077 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:08.131 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 3/3 2021-02-24T15:15:08.232 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install librados-devel 2021-02-24T15:15:08.448 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 3/3 2021-02-24T15:15:08.448 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 1/3 2021-02-24T15:15:08.448 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-24T15:15:08.692 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:41 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:08.794 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2021-02-24T15:15:08.795 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:08.795 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:15:08.795 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-02-24T15:15:08.795 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-common-3.2.1-12.el8.x86_64 2021-02-24T15:15:08.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:08.796 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:09.006 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados-devel 2021-02-24T15:15:09.217 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:09.218 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:09.219 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2021-02-24T15:15:09.219 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:09.219 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:15:09.219 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 125 k 2021-02-24T15:15:09.220 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:09.220 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:15:09.220 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:09.220 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2021-02-24T15:15:09.220 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:09.221 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 125 k 2021-02-24T15:15:09.221 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 437 k 2021-02-24T15:15:09.221 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:15:09.389 INFO:teuthology.orchestra.run.smithi181.stdout:librados-devel-17.0.0-1076.gc089f21b.el8.x86_64 734 kB/s | 125 kB 00:00 2021-02-24T15:15:09.390 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:09.390 INFO:teuthology.orchestra.run.smithi181.stdout:Total 729 kB/s | 125 kB 00:00 2021-02-24T15:15:09.391 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:15:09.398 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:15:09.399 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:15:09.448 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:15:09.450 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:15:09.476 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:42 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:15:09.757 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:09.939 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:09.940 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:09.941 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2021-02-24T15:15:09.941 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:09.941 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:15:09.941 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 125 k 2021-02-24T15:15:09.941 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:09.942 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:15:09.942 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:09.943 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2021-02-24T15:15:09.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:09.943 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 125 k 2021-02-24T15:15:09.943 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 437 k 2021-02-24T15:15:09.945 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:15:09.995 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:10.111 INFO:teuthology.orchestra.run.smithi152.stdout:librados-devel-17.0.0-1076.gc089f21b.el8.x86_64 737 kB/s | 125 kB 00:00 2021-02-24T15:15:10.112 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:10.112 INFO:teuthology.orchestra.run.smithi152.stdout:Total 730 kB/s | 125 kB 00:00 2021-02-24T15:15:10.112 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:15:10.119 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:15:10.120 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:15:10.169 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:15:10.171 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:15:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:10.271 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:15:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:10.272 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:10.293 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:15:10.406 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install libcephfs2 2021-02-24T15:15:10.522 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:10.864 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:43 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:11.038 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:11.038 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:11.038 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:15:11.039 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:11.039 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:11.039 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:11.217 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs2 2021-02-24T15:15:11.242 INFO:teuthology.orchestra.run.smithi181.stdout:Package libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:11.360 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:11.361 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2021-02-24T15:15:11.361 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:11.424 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install libcephfs-devel 2021-02-24T15:15:11.679 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:44 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:11.877 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:44 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:12.022 INFO:teuthology.orchestra.run.smithi152.stdout:Package libcephfs2-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2021-02-24T15:15:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:12.202 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs-devel 2021-02-24T15:15:12.331 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:12.331 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:12.332 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2021-02-24T15:15:12.332 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:12.332 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:15:12.332 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 23 k 2021-02-24T15:15:12.332 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:12.333 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:15:12.333 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:12.333 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2021-02-24T15:15:12.333 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:12.334 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 23 k 2021-02-24T15:15:12.334 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 89 k 2021-02-24T15:15:12.334 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:15:12.472 INFO:teuthology.orchestra.run.smithi181.stdout:libcephfs-devel-17.0.0-1076.gc089f21b.el8.x86_6 160 kB/s | 23 kB 00:00 2021-02-24T15:15:12.472 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:12.473 INFO:teuthology.orchestra.run.smithi181.stdout:Total 159 kB/s | 23 kB 00:00 2021-02-24T15:15:12.473 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:15:12.477 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:15:12.477 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:15:12.479 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:15:12.482 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:15:12.557 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:15:12.661 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:45 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:12.722 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:12.941 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:13.132 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:13.133 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:13.133 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2021-02-24T15:15:13.133 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:13.133 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:15:13.134 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 23 k 2021-02-24T15:15:13.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:13.134 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:15:13.134 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:13.135 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2021-02-24T15:15:13.135 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:13.135 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 23 k 2021-02-24T15:15:13.135 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 89 k 2021-02-24T15:15:13.135 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:15:13.170 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:13.170 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:13.170 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:15:13.171 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:13.171 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:13.171 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:13.266 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install librados2 2021-02-24T15:15:13.319 INFO:teuthology.orchestra.run.smithi152.stdout:libcephfs-devel-17.0.0-1076.gc089f21b.el8.x86_6 124 kB/s | 23 kB 00:00 2021-02-24T15:15:13.320 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:13.320 INFO:teuthology.orchestra.run.smithi152.stdout:Total 123 kB/s | 23 kB 00:00 2021-02-24T15:15:13.321 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:15:13.325 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:15:13.325 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:15:13.327 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:15:13.330 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:15:13.394 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:15:13.571 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:13.721 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:46 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:13.788 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:14.020 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:14.021 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:14.021 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:15:14.021 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:14.021 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:14.022 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:14.064 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:14.093 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados2 2021-02-24T15:15:14.177 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:14.178 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2021-02-24T15:15:14.178 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:14.239 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install librbd1 2021-02-24T15:15:14.550 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:47 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:14.695 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:47 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:14.889 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:15.001 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:15.002 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2021-02-24T15:15:15.002 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:15.039 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:15.068 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librbd1 2021-02-24T15:15:15.155 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:15.156 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2021-02-24T15:15:15.156 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:15.223 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-rados 2021-02-24T15:15:15.523 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:48 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:15.678 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:48 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:15.888 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:16.000 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:16.001 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2021-02-24T15:15:16.002 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:16.022 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-rados-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:16.059 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rados 2021-02-24T15:15:16.139 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:16.141 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2021-02-24T15:15:16.142 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:16.206 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-rgw 2021-02-24T15:15:16.514 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:49 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:16.658 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:49 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:16.863 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rados-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2021-02-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-rgw-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:17.077 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rgw 2021-02-24T15:15:17.118 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:17.120 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2021-02-24T15:15:17.120 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:17.189 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-cephfs 2021-02-24T15:15:17.532 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:50 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:17.645 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:50 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:17.980 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-cephfs-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:18.063 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rgw-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:18.096 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:18.097 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2021-02-24T15:15:18.097 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:18.164 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-rbd 2021-02-24T15:15:18.177 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:18.178 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2021-02-24T15:15:18.178 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:18.234 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-cephfs 2021-02-24T15:15:18.621 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:51 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:18.691 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:51 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:18.963 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-rbd-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:19.038 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-cephfs-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:19.079 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:19.080 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2021-02-24T15:15:19.081 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:19.144 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install rbd-fuse 2021-02-24T15:15:19.153 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:19.154 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2021-02-24T15:15:19.155 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:19.218 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rbd 2021-02-24T15:15:19.598 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:52 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:19.679 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:52 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:20.061 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:20.062 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2021-02-24T15:15:20.062 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:20.063 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:15:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 86 k 2021-02-24T15:15:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:20.063 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:15:20.063 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:20.064 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2021-02-24T15:15:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:20.064 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 86 k 2021-02-24T15:15:20.064 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 298 k 2021-02-24T15:15:20.064 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:15:20.065 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rbd-2:17.0.0-1076.gc089f21b.el8.x86_64 is already installed. 2021-02-24T15:15:20.175 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:20.176 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2021-02-24T15:15:20.176 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:20.249 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-fuse 2021-02-24T15:15:20.541 INFO:teuthology.orchestra.run.smithi181.stdout:rbd-fuse-17.0.0-1076.gc089f21b.el8.x86_64.rpm 179 kB/s | 86 kB 00:00 2021-02-24T15:15:20.542 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:20.542 INFO:teuthology.orchestra.run.smithi181.stdout:Total 178 kB/s | 86 kB 00:00 2021-02-24T15:15:20.543 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:15:20.555 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:15:20.556 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:15:20.606 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:15:20.608 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:15:20.703 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:53 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:20.741 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:15:20.913 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:21.158 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:21.176 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:21.177 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:21.177 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2021-02-24T15:15:21.177 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:21.177 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:15:21.177 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 86 k 2021-02-24T15:15:21.178 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:21.178 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:15:21.178 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:21.178 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2021-02-24T15:15:21.178 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:21.179 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 86 k 2021-02-24T15:15:21.179 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 298 k 2021-02-24T15:15:21.179 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:15:21.361 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-fuse-17.0.0-1076.gc089f21b.el8.x86_64.rpm 467 kB/s | 86 kB 00:00 2021-02-24T15:15:21.362 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:21.362 INFO:teuthology.orchestra.run.smithi152.stdout:Total 463 kB/s | 86 kB 00:00 2021-02-24T15:15:21.362 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:15:21.376 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:15:21.376 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:15:21.424 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:15:21.427 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:15:21.572 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:15:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:21.733 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:15:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:21.734 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:21.795 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:22.028 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:22.320 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:22.320 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:22.320 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:15:22.320 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:22.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:22.321 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:22.510 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-mirror 2021-02-24T15:15:22.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install rbd-mirror 2021-02-24T15:15:22.972 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:55 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:23.401 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:56 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:23.685 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:23.686 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:23.686 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2021-02-24T15:15:23.686 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:23.686 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:15:23.687 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.4 M 2021-02-24T15:15:23.687 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:23.687 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:15:23.687 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:23.688 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2021-02-24T15:15:23.688 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:23.688 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 3.4 M 2021-02-24T15:15:23.688 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 18 M 2021-02-24T15:15:23.690 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:15:24.209 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:24.210 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:24.210 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2021-02-24T15:15:24.211 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:24.211 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:15:24.211 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 3.4 M 2021-02-24T15:15:24.211 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:24.212 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:15:24.212 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:24.212 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2021-02-24T15:15:24.212 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:24.212 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 3.4 M 2021-02-24T15:15:24.213 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 18 M 2021-02-24T15:15:24.213 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:15:24.425 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-mirror-17.0.0-1076.gc089f21b.el8.x86_64.rpm 4.6 MB/s | 3.4 MB 00:00 2021-02-24T15:15:24.426 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:24.426 INFO:teuthology.orchestra.run.smithi152.stdout:Total 4.6 MB/s | 3.4 MB 00:00 2021-02-24T15:15:24.430 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:15:24.435 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:15:24.436 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:15:24.498 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:15:24.500 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:15:25.226 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:15:25.429 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:25.786 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:26.062 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:26.063 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:26.063 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:15:26.063 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:26.063 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:26.064 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:26.085 INFO:teuthology.orchestra.run.smithi181.stdout:rbd-mirror-17.0.0-1076.gc089f21b.el8.x86_64.rpm 1.8 MB/s | 3.4 MB 00:01 2021-02-24T15:15:26.090 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:26.091 INFO:teuthology.orchestra.run.smithi181.stdout:Total 1.8 MB/s | 3.4 MB 00:01 2021-02-24T15:15:26.091 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:15:26.104 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:15:26.104 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:15:26.168 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:15:26.171 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:15:26.216 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-nbd 2021-02-24T15:15:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:15:26.686 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:59 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:27.148 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2021-02-24T15:15:27.149 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:27.149 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2021-02-24T15:15:27.149 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:27.149 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2021-02-24T15:15:27.150 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 165 k 2021-02-24T15:15:27.150 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:27.150 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2021-02-24T15:15:27.150 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2021-02-24T15:15:27.151 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2021-02-24T15:15:27.151 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:27.151 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 165 k 2021-02-24T15:15:27.151 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 649 k 2021-02-24T15:15:27.157 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2021-02-24T15:15:27.186 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:27.435 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:27.435 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:27.435 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:15:27.436 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:27.436 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:27.436 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:27.559 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-nbd-17.0.0-1076.gc089f21b.el8.x86_64.rpm 403 kB/s | 165 kB 00:00 2021-02-24T15:15:27.560 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:27.560 INFO:teuthology.orchestra.run.smithi152.stdout:Total 402 kB/s | 165 kB 00:00 2021-02-24T15:15:27.560 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2021-02-24T15:15:27.574 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2021-02-24T15:15:27.574 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2021-02-24T15:15:27.624 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2021-02-24T15:15:27.627 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2021-02-24T15:15:27.644 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install rbd-nbd 2021-02-24T15:15:27.760 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2021-02-24T15:15:27.994 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:28.109 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:02:01 ago on Wed 24 Feb 2021 03:13:27 PM UTC. 2021-02-24T15:15:28.250 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-nbd-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:28.552 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:28.553 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:28.553 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2021-02-24T15:15:28.553 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:28.553 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:28.553 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2021-02-24T15:15:28.568 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2021-02-24T15:15:28.568 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2021-02-24T15:15:28.569 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:28.569 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2021-02-24T15:15:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:17.0.0-1076.gc089f21b.el8 ceph 165 k 2021-02-24T15:15:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:28.570 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2021-02-24T15:15:28.570 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2021-02-24T15:15:28.570 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2021-02-24T15:15:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:28.571 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 165 k 2021-02-24T15:15:28.571 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 649 k 2021-02-24T15:15:28.571 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2021-02-24T15:15:28.750 DEBUG:teuthology.parallel:result is None 2021-02-24T15:15:29.049 INFO:teuthology.orchestra.run.smithi181.stdout:rbd-nbd-17.0.0-1076.gc089f21b.el8.x86_64.rpm 344 kB/s | 165 kB 00:00 2021-02-24T15:15:29.050 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2021-02-24T15:15:29.050 INFO:teuthology.orchestra.run.smithi181.stdout:Total 343 kB/s | 165 kB 00:00 2021-02-24T15:15:29.051 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2021-02-24T15:15:29.064 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2021-02-24T15:15:29.065 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2021-02-24T15:15:29.115 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2021-02-24T15:15:29.118 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2021-02-24T15:15:29.457 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2021-02-24T15:15:29.663 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:29.903 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-nbd-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:17.0.0-1076.gc089f21b.el8.x86_64 1/1 2021-02-24T15:15:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:30.189 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2021-02-24T15:15:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:17.0.0-1076.gc089f21b.el8.x86_64 2021-02-24T15:15:30.190 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:30.190 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2021-02-24T15:15:30.366 DEBUG:teuthology.parallel:result is None 2021-02-24T15:15:30.367 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2021-02-24T15:15:30.408 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS 2021-02-24T15:15:30.409 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-24T15:15:30.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c089f21ba7ed78502aadcbf90668ca79817e877e 2021-02-24T15:15:30.587 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-02-24T15:15:30.610 INFO:teuthology.orchestra.run.smithi152.stdout:17.0.0-1076.gc089f21b.el8 2021-02-24T15:15:30.611 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-1076.gc089f21b.el8 2021-02-24T15:15:30.611 INFO:teuthology.task.install:The correct ceph version 17.0.0-1076.gc089f21b is installed. 2021-02-24T15:15:30.612 DEBUG:teuthology.orchestra.run.smithi181:> sudo lsb_release -is 2021-02-24T15:15:30.647 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS 2021-02-24T15:15:30.649 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-24T15:15:30.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c089f21ba7ed78502aadcbf90668ca79817e877e 2021-02-24T15:15:30.817 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-02-24T15:15:30.837 INFO:teuthology.orchestra.run.smithi181.stdout:17.0.0-1076.gc089f21b.el8 2021-02-24T15:15:30.838 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-1076.gc089f21b.el8 2021-02-24T15:15:30.839 INFO:teuthology.task.install:The correct ceph version 17.0.0-1076.gc089f21b is installed. 2021-02-24T15:15:30.839 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-02-24T15:15:30.840 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:30.840 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-24T15:15:30.870 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:30.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-24T15:15:30.903 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-02-24T15:15:30.903 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:30.904 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2021-02-24T15:15:30.939 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-24T15:15:31.006 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:31.007 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2021-02-24T15:15:31.032 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-24T15:15:31.096 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-02-24T15:15:31.096 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:31.097 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-24T15:15:31.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-24T15:15:31.192 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:31.192 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-24T15:15:31.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-24T15:15:31.281 INFO:teuthology.run_tasks:Running task ceph... 2021-02-24T15:15:31.345 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-02-24T15:15:31.346 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2021-02-24T15:15:31.349 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2021-02-24T15:15:31.373 INFO:tasks.ceph:Disabling ceph logrotate... 2021-02-24T15:15:31.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-24T15:15:31.416 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-24T15:15:31.441 INFO:tasks.ceph:Creating extra log directories... 2021-02-24T15:15:31.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-24T15:15:31.482 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-24T15:15:31.518 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-02-24T15:15:31.518 INFO:tasks.ceph:config {'conf': {'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2021-02-24T15:15:31.518 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi/5909684', 'branch': 'wip-sage-testing-2021-02-23-1850', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '5909684', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.2', 'overrides': {'admin_socket': {'branch': 'wip-sage-testing-2021-02-23-1850'}, 'ceph': {'conf': {'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': 'c089f21ba7ed78502aadcbf90668ca79817e877e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'c089f21ba7ed78502aadcbf90668ca79817e877e'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-sage-testing-2021-02-23-1850', 'sha1': 'c089f21ba7ed78502aadcbf90668ca79817e877e'}}, 'owner': 'scheduled_sage@teuthology', 'priority': 75, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'sha1': 'c089f21ba7ed78502aadcbf90668ca79817e877e', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-sage-testing-2021-02-23-1850', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c089f21ba7ed78502aadcbf90668ca79817e877e/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c089f21ba7ed78502aadcbf90668ca79817e877e', 'targets': {'smithi152.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEM/Sqo+UCIF7nHOx9Hgh49wGGqc1LjpaWLs4EOcEs8dcGeRSeLZhJekOYFTYKTPwbSmX9/I4hvstLCcBnCl90Cq5/w5Z2Yfl3CvRPNMF+U5x3eM6pKHveRtvpH+YHGMa/h4GdXc1imp8mDwNoGMjQC4SvpPsZhJL2P8Hsp7FAYctQM9/nRUFXaI6xyaKy968hOFY8tGLwJ1wAYU3BNKr+p/xmAuuVoQ77bdIyhJZpvGiTlYzPEKp88eEJOaarmh6qZqmdGxI2XVBb/dAJQHBRP0bCioDxXzGy7wSKHDVxBoLUBKid2/cWHhfIOWS5L1tnuZgmNwbsDAVIoAsaXCnXFcbNJSdIy9IULXC8xCdn1wuyCgWVn19m0UOAO83nbNDJW9psSZkIoNe8rkhYJTMq/qoIQGojhPRggGfM7tlUmw+cC4ewPdUkWcdtPb9CCckJDj+XswP3q4SNoI5hyamYSGjUXhuOOH+Pe44bjJwFJeh6tkOzZ9HqdTmkJ8KLDfM=', 'smithi181.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwrkOlC1/JSf2lNPmzbcgZhETp/MU4goaU5jB9vCxhDx1trFgmaSGrmygc0cKm1jmLekDIzfJQHoPWYy5oeJI7Pi19Q5wLr+PEs/QRFs+SFnAMYAAJLAZhxqrOI48iTL7kxaFIAsOCVhfx0M43srqL9VqrF43pNgP82v97qnSUOidu+QJ0/bO9gzyCf/AC+3922T2Ws5A55M2PUNXKyrrJhRlb2ZTyfATp8wvKnCxEkmAJoD+reCIPlLlBIs4TUHzQ4I0+pFoVE9PVrJLDmwtSFf9LaQV3/D0umrz/2cC+f5y6dEOMJ39J+OVL4mZPaj8dF951s4kOaL+Mh1GBLNq2ATQgPlm52kueanuilo1/YF38WMCBAEGvUqHVdoh2qKkGwPJ8RBhB5WQfmDFnYWpwZ/7JfLfqZykRFhse7kZeWZtHhU+V002eStBT51YEWrDVJaMGdImxNAjdG0nCsln39/8TIIw7r7gCNOWaDuYp8lIIYXGj8hYcodJYTs1fKLs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'thrash_delay': 1, 'thrash_many': True}}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}}}], 'teuthology_branch': 'master', 'timestamp': '2021-02-24_02:51:12', 'tube': 'smithi', 'user': 'sage', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.25973'} 2021-02-24T15:15:31.519 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-24T15:15:31.549 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-24T15:15:31.563 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2021-02-24T15:15:31.604 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2021-02-24T15:15:31.628 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:31.629 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2021-02-24T15:15:31.681 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-24T15:15:31.681 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-24T15:15:31.735 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-24T15:15:31.736 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-24T15:15:31.736 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 115756 Links: 1 2021-02-24T15:15:31.736 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-24T15:15:31.736 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2021-02-24T15:15:31.737 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2021-02-24 15:15:25.594979898 +0000 2021-02-24T15:15:31.737 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2021-02-24 15:12:56.895304660 +0000 2021-02-24T15:15:31.737 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2021-02-24 15:12:56.895304660 +0000 2021-02-24T15:15:31.737 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2021-02-24T15:15:31.746 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2021-02-24T15:15:31.746 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2021-02-24T15:15:31.746 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000213065 s, 2.4 MB/s 2021-02-24T15:15:31.749 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-24T15:15:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-24T15:15:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-24T15:15:31.809 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 109358 Links: 1 2021-02-24T15:15:31.809 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-24T15:15:31.809 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2021-02-24T15:15:31.810 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2021-02-24 15:15:25.594979898 +0000 2021-02-24T15:15:31.810 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2021-02-24 15:12:57.229300589 +0000 2021-02-24T15:15:31.810 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2021-02-24 15:12:57.229300589 +0000 2021-02-24T15:15:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2021-02-24T15:15:31.813 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2021-02-24T15:15:31.814 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2021-02-24T15:15:31.814 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000209224 s, 2.4 MB/s 2021-02-24T15:15:31.816 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-24T15:15:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-24T15:15:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-24T15:15:31.872 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 113966 Links: 1 2021-02-24T15:15:31.872 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-24T15:15:31.872 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2021-02-24T15:15:31.872 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2021-02-24 15:15:25.594979898 +0000 2021-02-24T15:15:31.873 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2021-02-24 15:12:57.572296409 +0000 2021-02-24T15:15:31.873 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2021-02-24 15:12:57.572296409 +0000 2021-02-24T15:15:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2021-02-24T15:15:31.881 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2021-02-24T15:15:31.882 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2021-02-24T15:15:31.882 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000204863 s, 2.5 MB/s 2021-02-24T15:15:31.884 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-24T15:15:31.939 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-24T15:15:31.939 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-24T15:15:31.939 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 114050 Links: 1 2021-02-24T15:15:31.940 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-24T15:15:31.940 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2021-02-24T15:15:31.940 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2021-02-24 15:15:25.594979898 +0000 2021-02-24T15:15:31.940 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2021-02-24 15:12:57.912292265 +0000 2021-02-24T15:15:31.941 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2021-02-24 15:12:57.912292265 +0000 2021-02-24T15:15:31.941 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2021-02-24T15:15:31.949 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2021-02-24T15:15:31.949 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2021-02-24T15:15:31.950 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000199956 s, 2.6 MB/s 2021-02-24T15:15:31.952 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-02-24T15:15:31.952 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:31.952 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2021-02-24T15:15:31.968 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-24T15:15:31.969 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-24T15:15:32.022 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-24T15:15:32.023 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-24T15:15:32.023 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 6h/6d Inode: 113033 Links: 1 2021-02-24T15:15:32.023 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-24T15:15:32.023 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2021-02-24T15:15:32.024 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2021-02-24 15:15:26.994014689 +0000 2021-02-24T15:15:32.024 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2021-02-24 15:12:56.143333983 +0000 2021-02-24T15:15:32.024 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2021-02-24 15:12:56.143333983 +0000 2021-02-24T15:15:32.024 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2021-02-24T15:15:32.033 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2021-02-24T15:15:32.033 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2021-02-24T15:15:32.033 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000303748 s, 1.7 MB/s 2021-02-24T15:15:32.037 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-24T15:15:32.091 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-24T15:15:32.092 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-24T15:15:32.092 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 6h/6d Inode: 113086 Links: 1 2021-02-24T15:15:32.092 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-24T15:15:32.093 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2021-02-24T15:15:32.093 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2021-02-24 15:15:26.995014670 +0000 2021-02-24T15:15:32.093 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2021-02-24 15:12:56.481327286 +0000 2021-02-24T15:15:32.093 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2021-02-24 15:12:56.481327286 +0000 2021-02-24T15:15:32.093 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2021-02-24T15:15:32.102 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2021-02-24T15:15:32.102 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2021-02-24T15:15:32.102 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000219059 s, 2.3 MB/s 2021-02-24T15:15:32.104 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-24T15:15:32.159 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-24T15:15:32.160 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-24T15:15:32.160 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 6h/6d Inode: 112287 Links: 1 2021-02-24T15:15:32.160 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-24T15:15:32.160 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2021-02-24T15:15:32.161 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2021-02-24 15:15:26.995014670 +0000 2021-02-24T15:15:32.161 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2021-02-24 15:12:56.813320707 +0000 2021-02-24T15:15:32.161 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2021-02-24 15:12:56.813320707 +0000 2021-02-24T15:15:32.161 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2021-02-24T15:15:32.170 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2021-02-24T15:15:32.170 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2021-02-24T15:15:32.170 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000211532 s, 2.4 MB/s 2021-02-24T15:15:32.172 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-24T15:15:32.226 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-24T15:15:32.227 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-24T15:15:32.227 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 6h/6d Inode: 115725 Links: 1 2021-02-24T15:15:32.227 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-24T15:15:32.227 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2021-02-24T15:15:32.228 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2021-02-24 15:15:26.995014670 +0000 2021-02-24T15:15:32.228 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2021-02-24 15:12:57.142314188 +0000 2021-02-24T15:15:32.228 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2021-02-24 15:12:57.142314188 +0000 2021-02-24T15:15:32.228 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2021-02-24T15:15:32.236 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2021-02-24T15:15:32.237 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2021-02-24T15:15:32.237 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000201622 s, 2.5 MB/s 2021-02-24T15:15:32.241 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-02-24T15:15:32.241 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2021-02-24T15:15:32.242 INFO:tasks.ceph:Generating config... 2021-02-24T15:15:32.243 INFO:tasks.ceph:[global] debug ms = 1 2021-02-24T15:15:32.243 INFO:tasks.ceph:[global] debug objecter = 20 2021-02-24T15:15:32.244 INFO:tasks.ceph:[global] debug rados = 20 2021-02-24T15:15:32.244 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-02-24T15:15:32.245 INFO:tasks.ceph:[global] mon election default strategy = 1 2021-02-24T15:15:32.245 INFO:tasks.ceph:[global] ms bind msgr2 = False 2021-02-24T15:15:32.245 INFO:tasks.ceph:[global] ms inject delay max = 1 2021-02-24T15:15:32.246 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2021-02-24T15:15:32.246 INFO:tasks.ceph:[global] ms inject delay type = mon 2021-02-24T15:15:32.246 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2021-02-24T15:15:32.246 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2021-02-24T15:15:32.247 INFO:tasks.ceph:[global] ms type = async 2021-02-24T15:15:32.247 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-02-24T15:15:32.248 INFO:tasks.ceph:[mgr] debug monc = 10 2021-02-24T15:15:32.248 INFO:tasks.ceph:[mgr] debug ms = 1 2021-02-24T15:15:32.248 INFO:tasks.ceph:[mon] debug mon = 20 2021-02-24T15:15:32.249 INFO:tasks.ceph:[mon] debug ms = 1 2021-02-24T15:15:32.250 INFO:tasks.ceph:[mon] debug paxos = 20 2021-02-24T15:15:32.250 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2021-02-24T15:15:32.251 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2021-02-24T15:15:32.251 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2021-02-24T15:15:32.251 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2021-02-24T15:15:32.252 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2021-02-24T15:15:32.252 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2021-02-24T15:15:32.254 INFO:tasks.ceph:[mon] mon scrub interval = 300 2021-02-24T15:15:32.255 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2021-02-24T15:15:32.255 INFO:tasks.ceph:[mon] paxos min = 10 2021-02-24T15:15:32.255 INFO:tasks.ceph:[mon] paxos service trim min = 5 2021-02-24T15:15:32.256 INFO:tasks.ceph:[mon] paxos trim min = 10 2021-02-24T15:15:32.256 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-02-24T15:15:32.256 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2021-02-24T15:15:32.256 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-02-24T15:15:32.257 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-02-24T15:15:32.257 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-02-24T15:15:32.257 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-02-24T15:15:32.258 INFO:tasks.ceph:[osd] debug filestore = 20 2021-02-24T15:15:32.258 INFO:tasks.ceph:[osd] debug journal = 20 2021-02-24T15:15:32.259 INFO:tasks.ceph:[osd] debug ms = 20 2021-02-24T15:15:32.259 INFO:tasks.ceph:[osd] debug osd = 25 2021-02-24T15:15:32.259 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-02-24T15:15:32.260 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-02-24T15:15:32.260 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-02-24T15:15:32.260 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-02-24T15:15:32.261 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2021-02-24T15:15:32.261 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2021-02-24T15:15:32.261 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-02-24T15:15:32.261 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-02-24T15:15:32.262 INFO:tasks.ceph:[osd] osd op queue = debug_random 2021-02-24T15:15:32.262 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2021-02-24T15:15:32.262 INFO:tasks.ceph:Setting up mon.a... 2021-02-24T15:15:32.263 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-02-24T15:15:32.342 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.keyring 2021-02-24T15:15:32.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-02-24T15:15:32.383 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-24T15:15:32.450 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.152:6789]'), ('mon.c', '[v1:172.21.15.152:6790]'), ('mon.b', '[v1:172.21.15.181:6789]')] 2021-02-24T15:15:32.451 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.152:6789],[v1:172.21.15.152:6790],[v1:172.21.15.181:6789]', 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2021-02-24T15:15:32.452 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:32.452 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-02-24T15:15:32.507 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.152:6789]' --addv c '[v1:172.21.15.152:6790]' --addv b '[v1:172.21.15.181:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:32.587 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:32.588 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: generated fsid d54e238b-89a2-4d0f-9dd4-1a64625c33b0 2021-02-24T15:15:32.588 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 0 2021-02-24T15:15:32.588 INFO:teuthology.orchestra.run.smithi152.stdout:fsid d54e238b-89a2-4d0f-9dd4-1a64625c33b0 2021-02-24T15:15:32.589 INFO:teuthology.orchestra.run.smithi152.stdout:last_changed 2021-02-24T15:15:32.587177+0000 2021-02-24T15:15:32.589 INFO:teuthology.orchestra.run.smithi152.stdout:created 2021-02-24T15:15:32.587177+0000 2021-02-24T15:15:32.589 INFO:teuthology.orchestra.run.smithi152.stdout:min_mon_release 0 (unknown) 2021-02-24T15:15:32.589 INFO:teuthology.orchestra.run.smithi152.stdout:election_strategy: 1 2021-02-24T15:15:32.589 INFO:teuthology.orchestra.run.smithi152.stdout:0: v1:172.21.15.152:6789/0 mon.a 2021-02-24T15:15:32.590 INFO:teuthology.orchestra.run.smithi152.stdout:1: v1:172.21.15.181:6789/0 mon.b 2021-02-24T15:15:32.590 INFO:teuthology.orchestra.run.smithi152.stdout:2: v1:172.21.15.152:6790/0 mon.c 2021-02-24T15:15:32.590 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-02-24T15:15:32.591 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-02-24T15:15:32.647 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d54e238b-89a2-4d0f-9dd4-1a64625c33b0... 2021-02-24T15:15:32.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-24T15:15:32.690 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-24T15:15:32.732 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2021-02-24T15:15:32.733 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2021-02-24T15:15:32.733 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-24T15:15:32.733 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2021-02-24T15:15:32.733 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.734 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2021-02-24T15:15:32.734 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.734 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2021-02-24T15:15:32.734 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.735 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2021-02-24T15:15:32.735 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2021-02-24T15:15:32.735 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.735 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2021-02-24T15:15:32.735 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2021-02-24T15:15:32.736 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.736 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-24T15:15:32.736 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2021-02-24T15:15:32.736 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.737 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2021-02-24T15:15:32.737 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-24T15:15:32.737 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.737 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2021-02-24T15:15:32.738 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.738 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2021-02-24T15:15:32.741 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2021-02-24T15:15:32.741 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2021-02-24T15:15:32.741 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2021-02-24T15:15:32.741 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2021-02-24T15:15:32.742 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2021-02-24T15:15:32.742 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2021-02-24T15:15:32.742 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-24T15:15:32.742 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-24T15:15:32.749 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2021-02-24T15:15:32.750 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.750 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-24T15:15:32.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.751 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2021-02-24T15:15:32.752 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.752 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2021-02-24T15:15:32.752 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.752 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2021-02-24T15:15:32.753 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2021-02-24T15:15:32.753 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2021-02-24T15:15:32.753 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "[v1:172.21.15.152:6789],[v1:172.21.15.152:6790],[v1:172.21.15.181:6789]" 2021-02-24T15:15:32.753 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2021-02-24T15:15:32.753 INFO:teuthology.orchestra.run.smithi152.stdout: debug objecter = 20 2021-02-24T15:15:32.754 INFO:teuthology.orchestra.run.smithi152.stdout: debug rados = 20 2021-02-24T15:15:32.754 INFO:teuthology.orchestra.run.smithi152.stdout: mon client directed command retry = 5 2021-02-24T15:15:32.754 INFO:teuthology.orchestra.run.smithi152.stdout: mon election default strategy = 1 2021-02-24T15:15:32.754 INFO:teuthology.orchestra.run.smithi152.stdout: ms bind msgr2 = False 2021-02-24T15:15:32.755 INFO:teuthology.orchestra.run.smithi152.stdout: ms inject delay max = 1 2021-02-24T15:15:32.755 INFO:teuthology.orchestra.run.smithi152.stdout: ms inject delay probability = 0.005 2021-02-24T15:15:32.755 INFO:teuthology.orchestra.run.smithi152.stdout: ms inject delay type = mon 2021-02-24T15:15:32.755 INFO:teuthology.orchestra.run.smithi152.stdout: ms inject internal delays = 0.002 2021-02-24T15:15:32.755 INFO:teuthology.orchestra.run.smithi152.stdout: ms inject socket failures = 2500 2021-02-24T15:15:32.756 INFO:teuthology.orchestra.run.smithi152.stdout: ms type = async 2021-02-24T15:15:32.756 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = d54e238b-89a2-4d0f-9dd4-1a64625c33b0 2021-02-24T15:15:32.756 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.756 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2021-02-24T15:15:32.756 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2021-02-24T15:15:32.757 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.757 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2021-02-24T15:15:32.757 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2021-02-24T15:15:32.757 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.758 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2021-02-24T15:15:32.758 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2021-02-24T15:15:32.758 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.758 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2021-02-24T15:15:32.758 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2021-02-24T15:15:32.759 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2021-02-24T15:15:32.759 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.759 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2021-02-24T15:15:32.759 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2021-02-24T15:15:32.759 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.760 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2021-02-24T15:15:32.760 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.760 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2021-02-24T15:15:32.760 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.760 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2021-02-24T15:15:32.761 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.761 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2021-02-24T15:15:32.761 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2021-02-24T15:15:32.761 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.762 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2021-02-24T15:15:32.762 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2021-02-24T15:15:32.762 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2021-02-24T15:15:32.762 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore compression algorithm = zlib 2021-02-24T15:15:32.762 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore compression mode = aggressive 2021-02-24T15:15:32.763 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2021-02-24T15:15:32.763 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 20 2021-02-24T15:15:32.763 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 20 2021-02-24T15:15:32.763 INFO:teuthology.orchestra.run.smithi152.stdout: debug filestore = 20 2021-02-24T15:15:32.763 INFO:teuthology.orchestra.run.smithi152.stdout: debug journal = 20 2021-02-24T15:15:32.764 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 20 2021-02-24T15:15:32.764 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 25 2021-02-24T15:15:32.764 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 10 2021-02-24T15:15:32.764 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2021-02-24T15:15:32.765 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2021-02-24T15:15:32.765 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2021-02-24T15:15:32.765 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify cached snaps = True 2021-02-24T15:15:32.765 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify missing on start = True 2021-02-24T15:15:32.765 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2021-02-24T15:15:32.766 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2021-02-24T15:15:32.766 INFO:teuthology.orchestra.run.smithi152.stdout: osd op queue = debug_random 2021-02-24T15:15:32.766 INFO:teuthology.orchestra.run.smithi152.stdout: osd op queue cut off = debug_random 2021-02-24T15:15:32.766 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.766 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2021-02-24T15:15:32.767 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2021-02-24T15:15:32.767 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2021-02-24T15:15:32.767 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2021-02-24T15:15:32.767 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2021-02-24T15:15:32.767 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2021-02-24T15:15:32.768 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2021-02-24T15:15:32.768 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2021-02-24T15:15:32.768 INFO:teuthology.orchestra.run.smithi152.stdout: debug monc = 10 2021-02-24T15:15:32.768 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.768 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2021-02-24T15:15:32.769 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2021-02-24T15:15:32.769 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2021-02-24T15:15:32.769 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2021-02-24T15:15:32.769 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2021-02-24T15:15:32.769 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2021-02-24T15:15:32.770 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2021-02-24T15:15:32.770 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2021-02-24T15:15:32.770 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2021-02-24T15:15:32.770 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2021-02-24T15:15:32.771 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2021-02-24T15:15:32.771 INFO:teuthology.orchestra.run.smithi152.stdout: mon min osdmap epochs = 25 2021-02-24T15:15:32.771 INFO:teuthology.orchestra.run.smithi152.stdout: mon osdmap full prune interval = 2 2021-02-24T15:15:32.771 INFO:teuthology.orchestra.run.smithi152.stdout: mon osdmap full prune min = 15 2021-02-24T15:15:32.771 INFO:teuthology.orchestra.run.smithi152.stdout: mon osdmap full prune txsize = 2 2021-02-24T15:15:32.772 INFO:teuthology.orchestra.run.smithi152.stdout: mon scrub inject crc mismatch = 0.01 2021-02-24T15:15:32.772 INFO:teuthology.orchestra.run.smithi152.stdout: mon scrub inject missing keys = 0.05 2021-02-24T15:15:32.772 INFO:teuthology.orchestra.run.smithi152.stdout: mon scrub interval = 300 2021-02-24T15:15:32.772 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on pool no app = False 2021-02-24T15:15:32.772 INFO:teuthology.orchestra.run.smithi152.stdout: paxos min = 10 2021-02-24T15:15:32.773 INFO:teuthology.orchestra.run.smithi152.stdout: paxos service trim min = 5 2021-02-24T15:15:32.773 INFO:teuthology.orchestra.run.smithi152.stdout: paxos trim min = 10 2021-02-24T15:15:32.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:15:32.773 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2021-02-24T15:15:32.773 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2021-02-24T15:15:32.774 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2021-02-24T15:15:32.774 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2021-02-24T15:15:32.774 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-24T15:15:32.774 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-24T15:15:32.775 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2021-02-24T15:15:32.775 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2021-02-24T15:15:32.775 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2021-02-24T15:15:32.777 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2021-02-24T15:15:32.777 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2021-02-24T15:15:32.777 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-24T15:15:32.778 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2021-02-24T15:15:32.778 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.778 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2021-02-24T15:15:32.778 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.779 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2021-02-24T15:15:32.779 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2021-02-24T15:15:32.779 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2021-02-24T15:15:32.779 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.780 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2021-02-24T15:15:32.780 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2021-02-24T15:15:32.780 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.780 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-24T15:15:32.780 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2021-02-24T15:15:32.781 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.781 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2021-02-24T15:15:32.781 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-24T15:15:32.781 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.782 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2021-02-24T15:15:32.782 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.782 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2021-02-24T15:15:32.782 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2021-02-24T15:15:32.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2021-02-24T15:15:32.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2021-02-24T15:15:32.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2021-02-24T15:15:32.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2021-02-24T15:15:32.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2021-02-24T15:15:32.784 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-24T15:15:32.784 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-24T15:15:32.784 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2021-02-24T15:15:32.784 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.784 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-24T15:15:32.785 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.785 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2021-02-24T15:15:32.785 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.786 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2021-02-24T15:15:32.786 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.786 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2021-02-24T15:15:32.786 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2021-02-24T15:15:32.786 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2021-02-24T15:15:32.787 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "[v1:172.21.15.152:6789],[v1:172.21.15.152:6790],[v1:172.21.15.181:6789]" 2021-02-24T15:15:32.787 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2021-02-24T15:15:32.787 INFO:teuthology.orchestra.run.smithi181.stdout: debug objecter = 20 2021-02-24T15:15:32.787 INFO:teuthology.orchestra.run.smithi181.stdout: debug rados = 20 2021-02-24T15:15:32.787 INFO:teuthology.orchestra.run.smithi181.stdout: mon client directed command retry = 5 2021-02-24T15:15:32.788 INFO:teuthology.orchestra.run.smithi181.stdout: mon election default strategy = 1 2021-02-24T15:15:32.788 INFO:teuthology.orchestra.run.smithi181.stdout: ms bind msgr2 = False 2021-02-24T15:15:32.788 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay max = 1 2021-02-24T15:15:32.788 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay probability = 0.005 2021-02-24T15:15:32.788 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay type = mon 2021-02-24T15:15:32.789 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject internal delays = 0.002 2021-02-24T15:15:32.789 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject socket failures = 2500 2021-02-24T15:15:32.789 INFO:teuthology.orchestra.run.smithi181.stdout: ms type = async 2021-02-24T15:15:32.789 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = d54e238b-89a2-4d0f-9dd4-1a64625c33b0 2021-02-24T15:15:32.789 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.790 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2021-02-24T15:15:32.790 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2021-02-24T15:15:32.790 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.790 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2021-02-24T15:15:32.791 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2021-02-24T15:15:32.791 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.791 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2021-02-24T15:15:32.791 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2021-02-24T15:15:32.791 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.792 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2021-02-24T15:15:32.792 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2021-02-24T15:15:32.792 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2021-02-24T15:15:32.792 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.792 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2021-02-24T15:15:32.793 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2021-02-24T15:15:32.793 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.793 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2021-02-24T15:15:32.793 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.793 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2021-02-24T15:15:32.794 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.794 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2021-02-24T15:15:32.794 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.794 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2021-02-24T15:15:32.795 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2021-02-24T15:15:32.795 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.795 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2021-02-24T15:15:32.795 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2021-02-24T15:15:32.795 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2021-02-24T15:15:32.796 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore compression algorithm = zlib 2021-02-24T15:15:32.796 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore compression mode = aggressive 2021-02-24T15:15:32.796 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2021-02-24T15:15:32.796 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 20 2021-02-24T15:15:32.796 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 20 2021-02-24T15:15:32.797 INFO:teuthology.orchestra.run.smithi181.stdout: debug filestore = 20 2021-02-24T15:15:32.797 INFO:teuthology.orchestra.run.smithi181.stdout: debug journal = 20 2021-02-24T15:15:32.797 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 20 2021-02-24T15:15:32.797 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 25 2021-02-24T15:15:32.797 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 10 2021-02-24T15:15:32.798 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2021-02-24T15:15:32.798 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2021-02-24T15:15:32.798 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2021-02-24T15:15:32.798 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify cached snaps = True 2021-02-24T15:15:32.798 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify missing on start = True 2021-02-24T15:15:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2021-02-24T15:15:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2021-02-24T15:15:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: osd op queue = debug_random 2021-02-24T15:15:32.799 INFO:teuthology.orchestra.run.smithi181.stdout: osd op queue cut off = debug_random 2021-02-24T15:15:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.800 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2021-02-24T15:15:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2021-02-24T15:15:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2021-02-24T15:15:32.800 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2021-02-24T15:15:32.801 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2021-02-24T15:15:32.801 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2021-02-24T15:15:32.801 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2021-02-24T15:15:32.801 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2021-02-24T15:15:32.801 INFO:teuthology.orchestra.run.smithi181.stdout: debug monc = 10 2021-02-24T15:15:32.802 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.802 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2021-02-24T15:15:32.802 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2021-02-24T15:15:32.802 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2021-02-24T15:15:32.802 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2021-02-24T15:15:32.803 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2021-02-24T15:15:32.803 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2021-02-24T15:15:32.803 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2021-02-24T15:15:32.804 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2021-02-24T15:15:32.804 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2021-02-24T15:15:32.805 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2021-02-24T15:15:32.805 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2021-02-24T15:15:32.805 INFO:teuthology.orchestra.run.smithi181.stdout: mon min osdmap epochs = 25 2021-02-24T15:15:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: mon osdmap full prune interval = 2 2021-02-24T15:15:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: mon osdmap full prune min = 15 2021-02-24T15:15:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: mon osdmap full prune txsize = 2 2021-02-24T15:15:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: mon scrub inject crc mismatch = 0.01 2021-02-24T15:15:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: mon scrub inject missing keys = 0.05 2021-02-24T15:15:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon scrub interval = 300 2021-02-24T15:15:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on pool no app = False 2021-02-24T15:15:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: paxos min = 10 2021-02-24T15:15:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: paxos service trim min = 5 2021-02-24T15:15:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: paxos trim min = 10 2021-02-24T15:15:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-02-24T15:15:32.808 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2021-02-24T15:15:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2021-02-24T15:15:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2021-02-24T15:15:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2021-02-24T15:15:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-24T15:15:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-24T15:15:32.810 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2021-02-24T15:15:32.810 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2021-02-24T15:15:32.811 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2021-02-24T15:15:32.811 INFO:tasks.ceph:Creating admin key on mon.a... 2021-02-24T15:15:32.812 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-02-24T15:15:32.866 INFO:tasks.ceph:Copying monmap to all nodes... 2021-02-24T15:15:32.866 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:32.867 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2021-02-24T15:15:32.881 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:32.882 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2021-02-24T15:15:32.935 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2021-02-24T15:15:32.935 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:32.936 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-24T15:15:32.936 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-24T15:15:33.009 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:33.010 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:33.064 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2021-02-24T15:15:33.064 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:33.065 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-24T15:15:33.065 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-24T15:15:33.103 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:33.104 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:33.159 INFO:tasks.ceph:Setting up mon nodes... 2021-02-24T15:15:33.160 INFO:tasks.ceph:Setting up mgr nodes... 2021-02-24T15:15:33.160 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-02-24T15:15:33.291 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-02-24T15:15:33.293 INFO:tasks.ceph:Setting up mds nodes... 2021-02-24T15:15:33.294 INFO:tasks.ceph_client:Setting up client nodes... 2021-02-24T15:15:33.294 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-02-24T15:15:33.337 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-02-24T15:15:33.351 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-02-24T15:15:33.351 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2021-02-24T15:15:33.352 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-02-24T15:15:33.376 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-02-24T15:15:33.377 INFO:tasks.ceph:role: osd.0 2021-02-24T15:15:33.377 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2021-02-24T15:15:33.378 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-24T15:15:33.449 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-02-24T15:15:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-24T15:15:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-24T15:15:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 2021-02-24T15:15:33.450 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-24T15:15:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2021-02-24T15:15:33.450 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-24T15:15:33.450 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-24T15:15:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-24T15:15:33.451 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-24T15:15:33.814 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2021-02-24T15:15:33.815 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2021-02-24T15:15:33.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-02-24T15:15:33.957 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-02-24T15:15:33.986 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-02-24T15:15:34.050 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-02-24T15:15:34.051 INFO:tasks.ceph:role: osd.1 2021-02-24T15:15:34.051 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2021-02-24T15:15:34.052 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-24T15:15:34.123 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-02-24T15:15:34.123 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-24T15:15:34.123 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-24T15:15:34.124 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 2021-02-24T15:15:34.124 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-24T15:15:34.124 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2021-02-24T15:15:34.124 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-24T15:15:34.125 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-24T15:15:34.125 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-24T15:15:34.125 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-24T15:15:34.484 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2021-02-24T15:15:34.485 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2021-02-24T15:15:34.486 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-02-24T15:15:34.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-02-24T15:15:34.600 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-02-24T15:15:34.668 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-02-24T15:15:34.669 INFO:tasks.ceph:role: osd.2 2021-02-24T15:15:34.669 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2021-02-24T15:15:34.670 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-24T15:15:34.741 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-02-24T15:15:34.742 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-24T15:15:34.742 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-24T15:15:34.742 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 2021-02-24T15:15:34.742 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-24T15:15:34.743 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2021-02-24T15:15:34.743 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-24T15:15:34.743 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-24T15:15:34.743 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-24T15:15:34.744 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-24T15:15:35.114 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2021-02-24T15:15:35.116 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2021-02-24T15:15:35.117 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-02-24T15:15:35.223 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-02-24T15:15:35.252 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:35.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:35.580+0000 7f21d00b4200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-02-24T15:15:35.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:35.581+0000 7f21d00b4200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-02-24T15:15:35.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:35.581+0000 7f21d00b4200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-02-24T15:15:35.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:35.581+0000 7f21d00b4200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-02-24T15:15:35.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:35.581+0000 7f21d00b4200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-02-24T15:15:35.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:35.588+0000 7f21d00b4200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-02-24T15:15:38.439 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-02-24T15:15:38.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:38.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:38.554+0000 7f8054596200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-02-24T15:15:38.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:38.555+0000 7f8054596200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-02-24T15:15:38.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:38.555+0000 7f8054596200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-02-24T15:15:38.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:38.555+0000 7f8054596200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-02-24T15:15:38.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:38.555+0000 7f8054596200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-02-24T15:15:38.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:38.555+0000 7f8054596200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-02-24T15:15:41.400 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-02-24T15:15:41.431 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:41.518 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:41.516+0000 7f4c1bc21200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-02-24T15:15:41.518 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:41.516+0000 7f4c1bc21200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-02-24T15:15:41.519 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:41.516+0000 7f4c1bc21200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-02-24T15:15:41.519 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:41.516+0000 7f4c1bc21200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-02-24T15:15:41.519 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:41.516+0000 7f4c1bc21200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-02-24T15:15:41.520 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:41.517+0000 7f4c1bc21200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-02-24T15:15:44.366 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-02-24T15:15:44.395 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-02-24T15:15:44.425 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-02-24T15:15:44.426 INFO:tasks.ceph:role: osd.3 2021-02-24T15:15:44.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2021-02-24T15:15:44.427 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-24T15:15:44.502 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-02-24T15:15:44.502 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-24T15:15:44.503 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-24T15:15:44.504 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 2021-02-24T15:15:44.504 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-24T15:15:44.504 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2021-02-24T15:15:44.505 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-24T15:15:44.505 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-24T15:15:44.505 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-24T15:15:44.506 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-24T15:15:44.867 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2021-02-24T15:15:44.869 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2021-02-24T15:15:44.869 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2021-02-24T15:15:44.996 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-02-24T15:15:45.027 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-02-24T15:15:45.092 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-02-24T15:15:45.093 INFO:tasks.ceph:role: osd.4 2021-02-24T15:15:45.093 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2021-02-24T15:15:45.094 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-24T15:15:45.165 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-02-24T15:15:45.165 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-24T15:15:45.166 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-24T15:15:45.166 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 2021-02-24T15:15:45.166 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-24T15:15:45.166 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2021-02-24T15:15:45.166 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-24T15:15:45.167 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-24T15:15:45.167 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-24T15:15:45.167 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-24T15:15:45.523 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2021-02-24T15:15:45.524 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2021-02-24T15:15:45.525 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2021-02-24T15:15:45.619 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-02-24T15:15:45.647 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-02-24T15:15:45.711 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-02-24T15:15:45.712 INFO:tasks.ceph:role: osd.5 2021-02-24T15:15:45.712 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2021-02-24T15:15:45.712 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-24T15:15:45.784 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-02-24T15:15:45.784 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-24T15:15:45.785 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-24T15:15:45.785 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 2021-02-24T15:15:45.785 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-24T15:15:45.785 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2021-02-24T15:15:45.785 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-24T15:15:45.786 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-24T15:15:45.786 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-24T15:15:45.786 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-24T15:15:46.147 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2021-02-24T15:15:46.148 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2021-02-24T15:15:46.149 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2021-02-24T15:15:46.252 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-02-24T15:15:46.281 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:46.374 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:46.373+0000 7fb451d02200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-02-24T15:15:46.375 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:46.374+0000 7fb451d02200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-02-24T15:15:46.375 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:46.374+0000 7fb451d02200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-02-24T15:15:46.376 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:46.374+0000 7fb451d02200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-02-24T15:15:46.376 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:46.374+0000 7fb451d02200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-02-24T15:15:46.376 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:46.375+0000 7fb451d02200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-02-24T15:15:49.220 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-02-24T15:15:49.253 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:49.345+0000 7f3988796200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-02-24T15:15:49.347 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:49.345+0000 7f3988796200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-02-24T15:15:49.347 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:49.345+0000 7f3988796200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-02-24T15:15:49.347 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:49.345+0000 7f3988796200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-02-24T15:15:49.347 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:49.345+0000 7f3988796200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-02-24T15:15:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:49.345+0000 7f3988796200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-02-24T15:15:52.192 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-02-24T15:15:52.281 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:52.387 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:52.383+0000 7f69bffdb200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-02-24T15:15:52.388 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:52.383+0000 7f69bffdb200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-02-24T15:15:52.388 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:52.383+0000 7f69bffdb200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-02-24T15:15:52.388 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:52.383+0000 7f69bffdb200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-02-24T15:15:52.388 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:52.383+0000 7f69bffdb200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-02-24T15:15:52.388 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:15:52.384+0000 7f69bffdb200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-02-24T15:15:55.231 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-02-24T15:15:55.301 INFO:tasks.ceph:Reading keys from all nodes... 2021-02-24T15:15:55.301 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:55.302 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2021-02-24T15:15:55.332 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:55.332 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2021-02-24T15:15:55.401 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:15:55.401 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2021-02-24T15:15:55.471 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:55.471 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2021-02-24T15:15:55.502 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:55.502 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2021-02-24T15:15:55.571 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:55.572 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2021-02-24T15:15:55.639 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:55.639 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2021-02-24T15:15:55.706 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:15:55.707 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2021-02-24T15:15:55.761 INFO:tasks.ceph:Adding keys to all mons... 2021-02-24T15:15:55.762 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2021-02-24T15:15:55.767 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2021-02-24T15:15:55.806 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2021-02-24T15:15:55.807 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCXbTZgBqGyIhAAV7s9B/LUzHxB7kayqOURRA== 2021-02-24T15:15:55.807 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2021-02-24T15:15:55.808 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCabTZgQWQqIRAAORfb3wIWAku4JYXbGTIzkw== 2021-02-24T15:15:55.808 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2021-02-24T15:15:55.809 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCdbTZguWDcHhAAlcGWCoPFeCwHAPxLK88EXQ== 2021-02-24T15:15:55.809 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2021-02-24T15:15:55.810 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCVbTZgbf9ZERAApYsXo7q/BUgvFR6FjDWhrw== 2021-02-24T15:15:55.810 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2021-02-24T15:15:55.811 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCibTZgX75QFhAAGsTDGTuIwYiBCijC7qlSmg== 2021-02-24T15:15:55.815 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2021-02-24T15:15:55.816 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQClbTZgsuqeFBAAHrl9lAPQsnpTVDE1BYWNqw== 2021-02-24T15:15:55.816 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2021-02-24T15:15:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCobTZg4KPoFhAAWqRSrvSzN2zY8aTqErqQrQ== 2021-02-24T15:15:55.818 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2021-02-24T15:15:55.818 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCVbTZgsm0fFBAASlt/I03MOyKMoHozhJL3XQ== 2021-02-24T15:15:55.827 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2021-02-24T15:15:55.827 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCXbTZgBqGyIhAAV7s9B/LUzHxB7kayqOURRA== 2021-02-24T15:15:55.827 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2021-02-24T15:15:55.828 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCabTZgQWQqIRAAORfb3wIWAku4JYXbGTIzkw== 2021-02-24T15:15:55.828 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2021-02-24T15:15:55.828 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCdbTZguWDcHhAAlcGWCoPFeCwHAPxLK88EXQ== 2021-02-24T15:15:55.828 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2021-02-24T15:15:55.828 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCVbTZgbf9ZERAApYsXo7q/BUgvFR6FjDWhrw== 2021-02-24T15:15:55.829 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2021-02-24T15:15:55.829 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCibTZgX75QFhAAGsTDGTuIwYiBCijC7qlSmg== 2021-02-24T15:15:55.829 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2021-02-24T15:15:55.829 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQClbTZgsuqeFBAAHrl9lAPQsnpTVDE1BYWNqw== 2021-02-24T15:15:55.830 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2021-02-24T15:15:55.830 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCobTZg4KPoFhAAWqRSrvSzN2zY8aTqErqQrQ== 2021-02-24T15:15:55.830 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2021-02-24T15:15:55.831 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCVbTZgsm0fFBAASlt/I03MOyKMoHozhJL3XQ== 2021-02-24T15:15:55.833 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:55.863 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:55.921 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:55.923 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:55.971 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:55.975 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:56.097 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-24T15:15:56.101 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-24T15:15:56.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:56.156 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:56.204 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:56.206 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:56.254 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:56.259 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-24T15:15:56.305 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-24T15:15:56.309 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-24T15:15:56.358 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-02-24T15:15:56.359 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-02-24T15:15:56.384 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-24T15:15:56.479 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-02-24T15:15:56.505 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-02-24T15:15:56.570 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-24T15:15:56.663 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-02-24T15:15:56.689 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-02-24T15:15:56.716 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-24T15:15:56.812 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-02-24T15:15:56.837 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:56.844 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-02-24T15:15:56.891 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-02-24T15:15:56.892 INFO:tasks.ceph.mon.a:Restarting daemon 2021-02-24T15:15:56.898 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-02-24T15:15:56.901 INFO:tasks.ceph.mon.a:Started 2021-02-24T15:15:56.902 INFO:tasks.ceph.mon.c:Restarting daemon 2021-02-24T15:15:56.902 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-02-24T15:15:56.904 INFO:tasks.ceph.mon.c:Started 2021-02-24T15:15:56.905 INFO:tasks.ceph.mon.b:Restarting daemon 2021-02-24T15:15:56.905 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-02-24T15:15:56.934 INFO:tasks.ceph.mon.b:Started 2021-02-24T15:15:56.935 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-02-24T15:15:56.935 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-02-24T15:15:56.936 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-02-24T15:15:56.938 INFO:tasks.ceph.mgr.x:Started 2021-02-24T15:15:56.938 INFO:tasks.ceph:Setting crush tunables to default 2021-02-24T15:15:56.939 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd crush tunables default 2021-02-24T15:15:57.061 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.057+0000 7fa2ede44700 1 Processor -- start 2021-02-24T15:15:57.061 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.057+0000 7fa2ede44700 1 -- start start 2021-02-24T15:15:57.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.058+0000 7fa2ede44700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e8094e30 con 0x7fa2e8090040 2021-02-24T15:15:57.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.058+0000 7fa2ede44700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e80950d0 con 0x7fa2e808fc60 2021-02-24T15:15:57.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.058+0000 7fa2ede44700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e8090eb0 con 0x7fa2e8130d60 2021-02-24T15:15:57.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.058+0000 7fa2ed643700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fa2e8130d60 0x7fa2e8133150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34112/0 (socket says 172.21.15.152:34112) 2021-02-24T15:15:57.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.058+0000 7fa2ed643700 1 -- 172.21.15.152:0/3205906392 learned_addr learned my addr 172.21.15.152:0/3205906392 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:15:57.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.058+0000 7fa2e7fff700 1 --1- 172.21.15.152:0/3205906392 >> v1:172.21.15.152:6789/0 conn(0x7fa2e8090040 0x7fa2e80904d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45636/0 (socket says 172.21.15.152:45636) 2021-02-24T15:15:57.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.060+0000 7fa2ed643700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.152:6790/0 conn(0x7fa2e8130d60 legacy=0x7fa2e8133150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:15:57.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.060+0000 7fa2e7fff700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.152:6789/0 conn(0x7fa2e8090040 legacy=0x7fa2e80904d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:15:57.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:15:57.061+0000 7fa2ece42700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.181:6789/0 conn(0x7fa2e808fc60 legacy=0x7fa2e8095490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:00.060 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:00.059+0000 7fa2e67fc700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.152:6790/0 conn(0x7fa2e8130d60 legacy=0x7fa2e8133150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:00.061 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:00.059+0000 7fa2e67fc700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.181:6789/0 conn(0x7fa2e808fc60 legacy=0x7fa2e8095490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:00.061 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:00.059+0000 7fa2e67fc700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.152:6789/0 conn(0x7fa2e8090040 legacy=0x7fa2e80904d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:00.061 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:00.059+0000 7fa2e67fc700 1 -- 172.21.15.152:0/3205906392 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e8095ba0 con 0x7fa2e8090040 2021-02-24T15:16:00.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:00.059+0000 7fa2e67fc700 1 -- 172.21.15.152:0/3205906392 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d000f750 con 0x7fa2d0003540 2021-02-24T15:16:00.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:00.059+0000 7fa2e67fc700 1 -- 172.21.15.152:0/3205906392 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d0010960 con 0x7fa2d00071d0 2021-02-24T15:16:00.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:00.061+0000 7fa2e7fff700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.152:6790/0 conn(0x7fa2d00071d0 legacy=0x7fa2d0009660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:00.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:00.062+0000 7fa2ed643700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.152:6789/0 conn(0x7fa2e8090040 legacy=0x7fa2d000cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:00.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:00.062+0000 7fa2ece42700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.181:6789/0 conn(0x7fa2d0003540 legacy=0x7fa2d0005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.269+0000 7fa2e77fe700 1 -- 172.21.15.152:0/3205906392 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022826793 0 0) 0x7fa2e8095ba0 con 0x7fa2e8090040 2021-02-24T15:16:02.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.269+0000 7fa2e77fe700 1 -- 172.21.15.152:0/3205906392 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2cc003230 con 0x7fa2e8090040 2021-02-24T15:16:02.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.269+0000 7fa2e77fe700 1 -- 172.21.15.152:0/3205906392 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 762879918 0 0) 0x7fa2cc003230 con 0x7fa2e8090040 2021-02-24T15:16:02.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.269+0000 7fa2e77fe700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.152:6790/0 conn(0x7fa2d00071d0 legacy=0x7fa2d0009660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.270+0000 7fa2e77fe700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.181:6789/0 conn(0x7fa2d0003540 legacy=0x7fa2d0005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.270+0000 7fa2e77fe700 1 -- 172.21.15.152:0/3205906392 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0011b70 con 0x7fa2e8090040 2021-02-24T15:16:02.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.270+0000 7fa2e77fe700 1 -- 172.21.15.152:0/3205906392 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa2e0001c80 con 0x7fa2e8090040 2021-02-24T15:16:02.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.270+0000 7fa2e77fe700 1 -- 172.21.15.152:0/3205906392 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa2e0001f60 con 0x7fa2e8090040 2021-02-24T15:16:02.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.270+0000 7fa2e77fe700 1 -- 172.21.15.152:0/3205906392 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa2e0004ad0 con 0x7fa2e8090040 2021-02-24T15:16:02.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.270+0000 7fa2ede44700 1 -- 172.21.15.152:0/3205906392 >> v1:172.21.15.152:6789/0 conn(0x7fa2e8090040 legacy=0x7fa2d000cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.271+0000 7fa2ede44700 1 -- 172.21.15.152:0/3205906392 shutdown_connections 2021-02-24T15:16:02.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.271+0000 7fa2ede44700 1 -- 172.21.15.152:0/3205906392 >> 172.21.15.152:0/3205906392 conn(0x7fa2e8096bb0 msgr2=0x7fa2e8096fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:02.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.271+0000 7fa2ede44700 1 -- 172.21.15.152:0/3205906392 shutdown_connections 2021-02-24T15:16:02.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.271+0000 7fa2ede44700 1 -- 172.21.15.152:0/3205906392 wait complete. 2021-02-24T15:16:02.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.271+0000 7fa2ede44700 1 librados: starting msgr at 2021-02-24T15:16:02.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.271+0000 7fa2ede44700 1 librados: starting objecter 2021-02-24T15:16:02.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.272+0000 7fa2ede44700 1 Processor -- start 2021-02-24T15:16:02.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.272+0000 7fa2ede44700 1 -- start start 2021-02-24T15:16:02.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.272+0000 7fa2ede44700 1 librados: setting wanted keys 2021-02-24T15:16:02.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.272+0000 7fa2ede44700 1 librados: calling monclient init 2021-02-24T15:16:02.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.273+0000 7fa2ede44700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e811a900 con 0x7fa2e8090040 2021-02-24T15:16:02.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.273+0000 7fa2ede44700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e811aba0 con 0x7fa2d00071d0 2021-02-24T15:16:02.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.273+0000 7fa2ede44700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e811ae40 con 0x7fa2d0003540 2021-02-24T15:16:02.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.273+0000 7fa2ece42700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fa2d0003540 0x7fa2e811b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34138/0 (socket says 172.21.15.152:34138) 2021-02-24T15:16:02.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.273+0000 7fa2ece42700 1 -- 172.21.15.152:0/1441501458 learned_addr learned my addr 172.21.15.152:0/1441501458 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:02.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2ed643700 1 -- 172.21.15.152:0/1441501458 >> v1:172.21.15.152:6789/0 conn(0x7fa2e8090040 legacy=0x7fa2e813a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e4ff9700 10 client.?.objecter ms_handle_connect 0x7fa2e8090040 2021-02-24T15:16:02.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e4ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:02.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e4ff9700 10 client.?.objecter ms_handle_connect 0x7fa2d0003540 2021-02-24T15:16:02.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e4ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:02.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2ece42700 1 -- 172.21.15.152:0/1441501458 >> v1:172.21.15.152:6790/0 conn(0x7fa2d0003540 legacy=0x7fa2e811b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e4ff9700 10 client.?.objecter ms_handle_connect 0x7fa2d00071d0 2021-02-24T15:16:02.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e4ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:02.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e7fff700 1 -- 172.21.15.152:0/1441501458 >> v1:172.21.15.181:6789/0 conn(0x7fa2d00071d0 legacy=0x7fa2e813a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250708849 0 0) 0x7fa2e811a900 con 0x7fa2e8090040 2021-02-24T15:16:02.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d000f0f0 con 0x7fa2e8090040 2021-02-24T15:16:02.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.275+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3610558615 0 0) 0x7fa2d000f0f0 con 0x7fa2e8090040 2021-02-24T15:16:02.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2e811a900 con 0x7fa2e8090040 2021-02-24T15:16:02.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa2e0001c40 con 0x7fa2e8090040 2021-02-24T15:16:02.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4004446746 0 0) 0x7fa2e811a900 con 0x7fa2e8090040 2021-02-24T15:16:02.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 >> v1:172.21.15.152:6790/0 conn(0x7fa2d0003540 legacy=0x7fa2e811b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 >> v1:172.21.15.181:6789/0 conn(0x7fa2d00071d0 legacy=0x7fa2e813a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8118d40 con 0x7fa2e8090040 2021-02-24T15:16:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2ede44700 1 -- 172.21.15.152:0/1441501458 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e8119970 con 0x7fa2e8090040 2021-02-24T15:16:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2ede44700 10 client.4107.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2ede44700 1 -- 172.21.15.152:0/1441501458 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e8143600 con 0x7fa2e8090040 2021-02-24T15:16:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2ede44700 1 librados: init done 2021-02-24T15:16:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa2e0004f30 con 0x7fa2e8090040 2021-02-24T15:16:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa2e0005240 con 0x7fa2e8090040 2021-02-24T15:16:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.276+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7fa2e00056c0 con 0x7fa2e8090040 2021-02-24T15:16:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.277+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (unknown 1507596619 0 0) 0x7fa2e0006730 con 0x7fa2e8090040 2021-02-24T15:16:02.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.277+0000 7fa2e4ff9700 10 client.4107.objecter ms_dispatch 0x7fa2e8001510 osd_map(1..1 src has 1..1) v4 2021-02-24T15:16:02.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.277+0000 7fa2e4ff9700 3 client.4107.objecter handle_osd_map got epochs [1,1] > 0 2021-02-24T15:16:02.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.277+0000 7fa2e4ff9700 3 client.4107.objecter handle_osd_map decoding full epoch 1 2021-02-24T15:16:02.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.277+0000 7fa2e4ff9700 20 client.4107.objecter dump_active .. 0 homeless 2021-02-24T15:16:02.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.277+0000 7fa2ede44700 1 -- 172.21.15.152:0/1441501458 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c4004d60 con 0x7fa2e8090040 2021-02-24T15:16:02.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.280+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (unknown 1092875540 0 742114027) 0x7fa2e0005aa0 con 0x7fa2e8090040 2021-02-24T15:16:02.364 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.363+0000 7fa2ede44700 1 -- 172.21.15.152:0/1441501458 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa2c4005010 con 0x7fa2e8090040 2021-02-24T15:16:02.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.365+0000 7fa2e4ff9700 1 -- 172.21.15.152:0/1441501458 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (unknown 2277712955 0 0) 0x7fa2e0005db0 con 0x7fa2e8090040 2021-02-24T15:16:02.367 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 10 librados: watch_flush enter 2021-02-24T15:16:02.367 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 10 librados: watch_flush exit 2021-02-24T15:16:02.368 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 20 client.4107.objecter shutdown clearing up homeless session... 2021-02-24T15:16:02.368 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 10 client.4107.objecter successfully canceled tick 2021-02-24T15:16:02.368 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 1 -- 172.21.15.152:0/1441501458 >> v1:172.21.15.152:6789/0 conn(0x7fa2e8090040 legacy=0x7fa2e813a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.368 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 1 -- 172.21.15.152:0/1441501458 shutdown_connections 2021-02-24T15:16:02.369 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 1 -- 172.21.15.152:0/1441501458 >> 172.21.15.152:0/1441501458 conn(0x7fa2e8096bb0 msgr2=0x7fa2e8092f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:02.369 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 1 -- 172.21.15.152:0/1441501458 shutdown_connections 2021-02-24T15:16:02.369 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 1 -- 172.21.15.152:0/1441501458 wait complete. 2021-02-24T15:16:02.369 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:02.366+0000 7fa2ede44700 1 librados: shutdown 2021-02-24T15:16:02.370 INFO:teuthology.orchestra.run.smithi152.stderr:adjusted tunables profile to default 2021-02-24T15:16:02.379 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-02-24T15:16:02.379 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:16:02.380 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2021-02-24T15:16:02.405 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:16:02.406 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2021-02-24T15:16:02.470 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2021-02-24T15:16:02.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2021-02-24T15:16:02.533 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:16:02.534 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2021-02-24T15:16:02.569 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:16:02.570 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2021-02-24T15:16:02.640 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:16:02.641 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2021-02-24T15:16:02.706 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new a72c3535-e891-4444-bf97-dc6fae0ad363 0 2021-02-24T15:16:02.870 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.868+0000 7fb77efcf700 1 Processor -- start 2021-02-24T15:16:02.870 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.868+0000 7fb77efcf700 1 -- start start 2021-02-24T15:16:02.870 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.868+0000 7fb77efcf700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb778096740 con 0x7fb77812b490 2021-02-24T15:16:02.871 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.868+0000 7fb77efcf700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77812b870 con 0x7fb778095b70 2021-02-24T15:16:02.871 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.868+0000 7fb77efcf700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb778094070 con 0x7fb7781313f0 2021-02-24T15:16:02.871 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.869+0000 7fb777fff700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb778095b70 0x7fb77812fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49696/0 (socket says 172.21.15.181:49696) 2021-02-24T15:16:02.872 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.869+0000 7fb777fff700 1 -- 172.21.15.181:0/3352571805 learned_addr learned my addr 172.21.15.181:0/3352571805 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:02.884 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb777fff700 1 -- 172.21.15.181:0/3352571805 >> v1:172.21.15.181:6789/0 conn(0x7fb778095b70 legacy=0x7fb77812fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.885 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb77cd6b700 1 -- 172.21.15.181:0/3352571805 >> v1:172.21.15.152:6789/0 conn(0x7fb77812b490 legacy=0x7fb778093960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.885 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb77d56c700 1 -- 172.21.15.181:0/3352571805 >> v1:172.21.15.152:6790/0 conn(0x7fb7781313f0 legacy=0x7fb7781337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.885 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776461651 0 0) 0x7fb77812b870 con 0x7fb778095b70 2021-02-24T15:16:02.886 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb75c003230 con 0x7fb778095b70 2021-02-24T15:16:02.887 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047885058 0 0) 0x7fb778096740 con 0x7fb77812b490 2021-02-24T15:16:02.887 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb77812b870 con 0x7fb77812b490 2021-02-24T15:16:02.887 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550182582 0 0) 0x7fb778094070 con 0x7fb7781313f0 2021-02-24T15:16:02.889 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb778096740 con 0x7fb7781313f0 2021-02-24T15:16:02.889 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3749161785 0 0) 0x7fb75c003230 con 0x7fb778095b70 2021-02-24T15:16:02.889 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 >> v1:172.21.15.152:6790/0 conn(0x7fb7781313f0 legacy=0x7fb7781337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.889 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 >> v1:172.21.15.152:6789/0 conn(0x7fb77812b490 legacy=0x7fb778093960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.890 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778095090 con 0x7fb778095b70 2021-02-24T15:16:02.890 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb764001930 con 0x7fb778095b70 2021-02-24T15:16:02.890 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb764001c40 con 0x7fb778095b70 2021-02-24T15:16:02.890 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.871+0000 7fb7777fe700 1 -- 172.21.15.181:0/3352571805 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb764004750 con 0x7fb778095b70 2021-02-24T15:16:02.891 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.872+0000 7fb77efcf700 1 -- 172.21.15.181:0/3352571805 >> v1:172.21.15.181:6789/0 conn(0x7fb778095b70 legacy=0x7fb77812fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.891 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.872+0000 7fb77efcf700 1 -- 172.21.15.181:0/3352571805 shutdown_connections 2021-02-24T15:16:02.891 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.872+0000 7fb77efcf700 1 -- 172.21.15.181:0/3352571805 >> 172.21.15.181:0/3352571805 conn(0x7fb77809a240 msgr2=0x7fb77809a650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:02.892 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.872+0000 7fb77efcf700 1 -- 172.21.15.181:0/3352571805 shutdown_connections 2021-02-24T15:16:02.892 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.872+0000 7fb77efcf700 1 -- 172.21.15.181:0/3352571805 wait complete. 2021-02-24T15:16:02.892 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.873+0000 7fb77efcf700 1 librados: starting msgr at 2021-02-24T15:16:02.893 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.873+0000 7fb77efcf700 1 librados: starting objecter 2021-02-24T15:16:02.893 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.873+0000 7fb77efcf700 1 Processor -- start 2021-02-24T15:16:02.893 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.873+0000 7fb77efcf700 1 -- start start 2021-02-24T15:16:02.894 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.873+0000 7fb77efcf700 1 librados: setting wanted keys 2021-02-24T15:16:02.894 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.873+0000 7fb77efcf700 1 librados: calling monclient init 2021-02-24T15:16:02.894 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.874+0000 7fb77efcf700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb778130fc0 con 0x7fb778095b70 2021-02-24T15:16:02.895 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.874+0000 7fb77efcf700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb778120b80 con 0x7fb7781313f0 2021-02-24T15:16:02.895 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.874+0000 7fb77efcf700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb778122270 con 0x7fb77812b490 2021-02-24T15:16:02.895 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.874+0000 7fb77d56c700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb7781313f0 0x7fb7781428b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49704/0 (socket says 172.21.15.181:49704) 2021-02-24T15:16:02.896 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.874+0000 7fb77d56c700 1 -- 172.21.15.181:0/2835826461 learned_addr learned my addr 172.21.15.181:0/2835826461 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:02.896 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb77d56c700 1 -- 172.21.15.181:0/2835826461 >> v1:172.21.15.181:6789/0 conn(0x7fb7781313f0 legacy=0x7fb7781428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.897 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 10 client.?.objecter ms_handle_connect 0x7fb7781313f0 2021-02-24T15:16:02.897 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:02.897 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 10 client.?.objecter ms_handle_connect 0x7fb778095b70 2021-02-24T15:16:02.897 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:02.898 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb77cd6b700 1 -- 172.21.15.181:0/2835826461 >> v1:172.21.15.152:6789/0 conn(0x7fb778095b70 legacy=0x7fb77811f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.898 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 10 client.?.objecter ms_handle_connect 0x7fb77812b490 2021-02-24T15:16:02.898 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:02.898 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb777fff700 1 -- 172.21.15.181:0/2835826461 >> v1:172.21.15.152:6790/0 conn(0x7fb77812b490 legacy=0x7fb77811fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:02.899 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031535626 0 0) 0x7fb778120b80 con 0x7fb7781313f0 2021-02-24T15:16:02.899 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb758004bd0 con 0x7fb7781313f0 2021-02-24T15:16:02.899 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751726193 0 0) 0x7fb778130fc0 con 0x7fb778095b70 2021-02-24T15:16:02.899 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb778120b80 con 0x7fb778095b70 2021-02-24T15:16:02.899 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478138930 0 0) 0x7fb778122270 con 0x7fb77812b490 2021-02-24T15:16:02.900 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb778130fc0 con 0x7fb77812b490 2021-02-24T15:16:02.900 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4026160942 0 0) 0x7fb758004bd0 con 0x7fb7781313f0 2021-02-24T15:16:02.900 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb778122270 con 0x7fb7781313f0 2021-02-24T15:16:02.901 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb770002020 con 0x7fb7781313f0 2021-02-24T15:16:02.901 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3421186065 0 0) 0x7fb778120b80 con 0x7fb778095b70 2021-02-24T15:16:02.902 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb758004bd0 con 0x7fb778095b70 2021-02-24T15:16:02.902 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb76c001c40 con 0x7fb778095b70 2021-02-24T15:16:02.902 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1194500008 0 0) 0x7fb778130fc0 con 0x7fb77812b490 2021-02-24T15:16:02.902 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb778120b80 con 0x7fb77812b490 2021-02-24T15:16:02.903 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb7640018f0 con 0x7fb77812b490 2021-02-24T15:16:02.903 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3133618328 0 0) 0x7fb778122270 con 0x7fb7781313f0 2021-02-24T15:16:02.903 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 >> v1:172.21.15.152:6790/0 conn(0x7fb77812b490 legacy=0x7fb77811fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.903 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 >> v1:172.21.15.152:6789/0 conn(0x7fb778095b70 legacy=0x7fb77811f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.904 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778122d10 con 0x7fb7781313f0 2021-02-24T15:16:02.904 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.876+0000 7fb77efcf700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb778121720 con 0x7fb7781313f0 2021-02-24T15:16:02.904 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb77efcf700 10 client.4102.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:02.904 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb77efcf700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb778123840 con 0x7fb7781313f0 2021-02-24T15:16:02.905 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb77efcf700 1 librados: init done 2021-02-24T15:16:02.905 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb770002690 con 0x7fb7781313f0 2021-02-24T15:16:02.905 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb7700029a0 con 0x7fb7781313f0 2021-02-24T15:16:02.905 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7fb770002e60 con 0x7fb7781313f0 2021-02-24T15:16:02.906 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (unknown 524261823 0 0) 0x7fb7700065b0 con 0x7fb7781313f0 2021-02-24T15:16:02.906 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb774ff9700 10 client.4102.objecter ms_dispatch 0x7fb778001510 osd_map(2..2 src has 1..2) v4 2021-02-24T15:16:02.906 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb774ff9700 3 client.4102.objecter handle_osd_map got epochs [2,2] > 0 2021-02-24T15:16:02.907 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb774ff9700 3 client.4102.objecter handle_osd_map decoding full epoch 2 2021-02-24T15:16:02.907 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb774ff9700 20 client.4102.objecter dump_active .. 0 homeless 2021-02-24T15:16:02.908 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.877+0000 7fb77efcf700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb750004d60 con 0x7fb7781313f0 2021-02-24T15:16:02.908 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.880+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (unknown 1092875540 0 742114027) 0x7fb770005a00 con 0x7fb7781313f0 2021-02-24T15:16:02.971 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.970+0000 7fb77efcf700 1 -- 172.21.15.181:0/2835826461 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "osd new", "uuid": "a72c3535-e891-4444-bf97-dc6fae0ad363", "id": 0} v 0) v1 -- 0x7fb750005590 con 0x7fb7781313f0 2021-02-24T15:16:02.977 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.975+0000 7fb774ff9700 1 -- 172.21.15.181:0/2835826461 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a72c3535-e891-4444-bf97-dc6fae0ad363", "id": 0}]=0 v3) v1 ==== 112+0+2 (unknown 969067892 0 732707515) 0x7fb770005c80 con 0x7fb7781313f0 2021-02-24T15:16:02.977 INFO:teuthology.orchestra.run.smithi181.stdout:0 2021-02-24T15:16:02.978 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.976+0000 7fb77efcf700 10 librados: watch_flush enter 2021-02-24T15:16:02.979 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.976+0000 7fb77efcf700 10 librados: watch_flush exit 2021-02-24T15:16:02.979 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.976+0000 7fb77efcf700 20 client.4102.objecter shutdown clearing up homeless session... 2021-02-24T15:16:02.979 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.976+0000 7fb77efcf700 10 client.4102.objecter successfully canceled tick 2021-02-24T15:16:02.979 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.976+0000 7fb77efcf700 1 -- 172.21.15.181:0/2835826461 >> v1:172.21.15.181:6789/0 conn(0x7fb7781313f0 legacy=0x7fb7781428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:02.980 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.977+0000 7fb77efcf700 1 -- 172.21.15.181:0/2835826461 shutdown_connections 2021-02-24T15:16:02.980 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.977+0000 7fb77efcf700 1 -- 172.21.15.181:0/2835826461 >> 172.21.15.181:0/2835826461 conn(0x7fb77809a240 msgr2=0x7fb778128e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:02.980 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.977+0000 7fb77efcf700 1 -- 172.21.15.181:0/2835826461 shutdown_connections 2021-02-24T15:16:02.980 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.977+0000 7fb77efcf700 1 -- 172.21.15.181:0/2835826461 wait complete. 2021-02-24T15:16:02.981 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:02.977+0000 7fb77efcf700 1 librados: shutdown 2021-02-24T15:16:02.999 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 008b3230-90b6-4bee-8218-c422a983151c 1 2021-02-24T15:16:03.118 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.116+0000 7f48abd25700 1 Processor -- start 2021-02-24T15:16:03.119 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.117+0000 7f48abd25700 1 -- start start 2021-02-24T15:16:03.119 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.117+0000 7f48abd25700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a4068460 con 0x7f48a4098770 2021-02-24T15:16:03.120 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.117+0000 7f48abd25700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a4093640 con 0x7f48a40678e0 2021-02-24T15:16:03.120 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.117+0000 7f48abd25700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40938e0 con 0x7f48a4092270 2021-02-24T15:16:03.120 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.117+0000 7f48aa2c2700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f48a40678e0 0x7f48a4131130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49710/0 (socket says 172.21.15.181:49710) 2021-02-24T15:16:03.121 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.117+0000 7f48aa2c2700 1 -- 172.21.15.181:0/545987431 learned_addr learned my addr 172.21.15.181:0/545987431 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:03.124 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.119+0000 7f48aa2c2700 1 -- 172.21.15.181:0/545987431 >> v1:172.21.15.181:6789/0 conn(0x7f48a40678e0 legacy=0x7f48a4131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.124 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a92c0700 1 -- 172.21.15.181:0/545987431 >> v1:172.21.15.152:6789/0 conn(0x7f48a4098770 legacy=0x7f48a412da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.125 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a9ac1700 1 -- 172.21.15.181:0/545987431 >> v1:172.21.15.152:6790/0 conn(0x7f48a4092270 legacy=0x7f48a4128a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.125 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967831614 0 0) 0x7f48a4093640 con 0x7f48a40678e0 2021-02-24T15:16:03.125 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f488c003230 con 0x7f48a40678e0 2021-02-24T15:16:03.126 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207572359 0 0) 0x7f48a4068460 con 0x7f48a4098770 2021-02-24T15:16:03.126 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a4093640 con 0x7f48a4098770 2021-02-24T15:16:03.126 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032929284 0 0) 0x7f48a40938e0 con 0x7f48a4092270 2021-02-24T15:16:03.127 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a4068460 con 0x7f48a4092270 2021-02-24T15:16:03.127 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2054732227 0 0) 0x7f48a4093640 con 0x7f48a4098770 2021-02-24T15:16:03.127 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 >> v1:172.21.15.152:6790/0 conn(0x7f48a4092270 legacy=0x7f48a4128a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.127 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 >> v1:172.21.15.181:6789/0 conn(0x7f48a40678e0 legacy=0x7f48a4131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.128 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4067d50 con 0x7f48a4098770 2021-02-24T15:16:03.128 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4894001980 con 0x7f48a4098770 2021-02-24T15:16:03.128 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4894001c90 con 0x7f48a4098770 2021-02-24T15:16:03.129 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.120+0000 7f48a8abf700 1 -- 172.21.15.181:0/545987431 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4894002060 con 0x7f48a4098770 2021-02-24T15:16:03.129 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.121+0000 7f48abd25700 1 -- 172.21.15.181:0/545987431 >> v1:172.21.15.152:6789/0 conn(0x7f48a4098770 legacy=0x7f48a412da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.129 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.121+0000 7f48abd25700 1 -- 172.21.15.181:0/545987431 shutdown_connections 2021-02-24T15:16:03.129 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.121+0000 7f48abd25700 1 -- 172.21.15.181:0/545987431 >> 172.21.15.181:0/545987431 conn(0x7f48a4099860 msgr2=0x7f48a4099c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:03.130 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.121+0000 7f48abd25700 1 -- 172.21.15.181:0/545987431 shutdown_connections 2021-02-24T15:16:03.130 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.121+0000 7f48abd25700 1 -- 172.21.15.181:0/545987431 wait complete. 2021-02-24T15:16:03.130 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.121+0000 7f48abd25700 1 librados: starting msgr at 2021-02-24T15:16:03.131 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.121+0000 7f48abd25700 1 librados: starting objecter 2021-02-24T15:16:03.131 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.122+0000 7f48abd25700 1 Processor -- start 2021-02-24T15:16:03.131 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.122+0000 7f48abd25700 1 -- start start 2021-02-24T15:16:03.131 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.122+0000 7f48abd25700 1 librados: setting wanted keys 2021-02-24T15:16:03.132 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.122+0000 7f48abd25700 1 librados: calling monclient init 2021-02-24T15:16:03.132 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.122+0000 7f48abd25700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a413a960 con 0x7f48a40678e0 2021-02-24T15:16:03.132 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.122+0000 7f48abd25700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40927a0 con 0x7f48a4098770 2021-02-24T15:16:03.132 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.122+0000 7f48abd25700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40671d0 con 0x7f48a4092270 2021-02-24T15:16:03.133 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.122+0000 7f48aa2c2700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f48a4098770 0x7f48a4141fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49716/0 (socket says 172.21.15.181:49716) 2021-02-24T15:16:03.133 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.122+0000 7f48aa2c2700 1 -- 172.21.15.181:0/2898379827 learned_addr learned my addr 172.21.15.181:0/2898379827 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:03.159 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.124+0000 7f48aa2c2700 1 -- 172.21.15.181:0/2898379827 >> v1:172.21.15.181:6789/0 conn(0x7f48a4098770 legacy=0x7f48a4141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.159 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.124+0000 7f4891ffb700 10 client.?.objecter ms_handle_connect 0x7f48a4098770 2021-02-24T15:16:03.159 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.124+0000 7f4891ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.160 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.124+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558249712 0 0) 0x7f48a40927a0 con 0x7f48a4098770 2021-02-24T15:16:03.160 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.124+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4884004bd0 con 0x7f48a4098770 2021-02-24T15:16:03.160 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 10 client.?.objecter ms_handle_connect 0x7f48a40678e0 2021-02-24T15:16:03.160 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.161 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f48a9ac1700 1 -- 172.21.15.181:0/2898379827 >> v1:172.21.15.152:6789/0 conn(0x7f48a40678e0 legacy=0x7f48a413a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.161 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 10 client.?.objecter ms_handle_connect 0x7f48a4092270 2021-02-24T15:16:03.161 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.162 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f48a92c0700 1 -- 172.21.15.181:0/2898379827 >> v1:172.21.15.152:6790/0 conn(0x7f48a4092270 legacy=0x7f48a4090fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.162 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095039194 0 0) 0x7f48a413a960 con 0x7f48a40678e0 2021-02-24T15:16:03.162 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a40927a0 con 0x7f48a40678e0 2021-02-24T15:16:03.162 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1615549609 0 0) 0x7f4884004bd0 con 0x7f48a4098770 2021-02-24T15:16:03.163 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f48a413a960 con 0x7f48a4098770 2021-02-24T15:16:03.163 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f489c001d10 con 0x7f48a4098770 2021-02-24T15:16:03.163 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469130200 0 0) 0x7f48a40671d0 con 0x7f48a4092270 2021-02-24T15:16:03.163 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4884004bd0 con 0x7f48a4092270 2021-02-24T15:16:03.163 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1449374142 0 0) 0x7f48a40927a0 con 0x7f48a40678e0 2021-02-24T15:16:03.164 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f48a40671d0 con 0x7f48a40678e0 2021-02-24T15:16:03.164 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f48a0001be0 con 0x7f48a40678e0 2021-02-24T15:16:03.164 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 277184755 0 0) 0x7f48a413a960 con 0x7f48a4098770 2021-02-24T15:16:03.164 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 >> v1:172.21.15.152:6790/0 conn(0x7f48a4092270 legacy=0x7f48a4090fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.165 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 >> v1:172.21.15.152:6789/0 conn(0x7f48a40678e0 legacy=0x7f48a413a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.165 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4067470 con 0x7f48a4098770 2021-02-24T15:16:03.165 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f48abd25700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a40658f0 con 0x7f48a4098770 2021-02-24T15:16:03.165 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f489c004bb0 con 0x7f48a4098770 2021-02-24T15:16:03.165 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f489c004ec0 con 0x7f48a4098770 2021-02-24T15:16:03.166 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f489c005440 con 0x7f48a4098770 2021-02-24T15:16:03.166 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f48abd25700 10 client.4108.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:03.166 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f48abd25700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a40916b0 con 0x7f48a4098770 2021-02-24T15:16:03.166 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f48abd25700 1 librados: init done 2021-02-24T15:16:03.166 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (unknown 2514359706 0 0) 0x7f489c0059b0 con 0x7f48a4098770 2021-02-24T15:16:03.167 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 10 client.4108.objecter ms_dispatch 0x7f48a4001510 osd_map(3..3 src has 1..3) v4 2021-02-24T15:16:03.167 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 3 client.4108.objecter handle_osd_map got epochs [3,3] > 0 2021-02-24T15:16:03.167 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 3 client.4108.objecter handle_osd_map decoding full epoch 3 2021-02-24T15:16:03.167 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.125+0000 7f4891ffb700 20 client.4108.objecter dump_active .. 0 homeless 2021-02-24T15:16:03.167 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.126+0000 7f48abd25700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a4058400 con 0x7f48a4098770 2021-02-24T15:16:03.168 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.128+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (unknown 1092875540 0 742114027) 0x7f489c005d30 con 0x7f48a4098770 2021-02-24T15:16:03.222 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.219+0000 7f48abd25700 1 -- 172.21.15.181:0/2898379827 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "osd new", "uuid": "008b3230-90b6-4bee-8218-c422a983151c", "id": 1} v 0) v1 -- 0x7f48a4044c90 con 0x7f48a4098770 2021-02-24T15:16:03.228 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.227+0000 7f4891ffb700 1 -- 172.21.15.181:0/2898379827 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "008b3230-90b6-4bee-8218-c422a983151c", "id": 1}]=0 v4) v1 ==== 112+0+2 (unknown 1076434992 0 940483276) 0x7f489c006a60 con 0x7f48a4098770 2021-02-24T15:16:03.228 INFO:teuthology.orchestra.run.smithi181.stdout:1 2021-02-24T15:16:03.229 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 10 librados: watch_flush enter 2021-02-24T15:16:03.230 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 10 librados: watch_flush exit 2021-02-24T15:16:03.230 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 20 client.4108.objecter shutdown clearing up homeless session... 2021-02-24T15:16:03.230 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 10 client.4108.objecter successfully canceled tick 2021-02-24T15:16:03.230 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 1 -- 172.21.15.181:0/2898379827 >> v1:172.21.15.181:6789/0 conn(0x7f48a4098770 legacy=0x7f48a4141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.231 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 1 -- 172.21.15.181:0/2898379827 shutdown_connections 2021-02-24T15:16:03.231 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 1 -- 172.21.15.181:0/2898379827 >> 172.21.15.181:0/2898379827 conn(0x7f48a4099860 msgr2=0x7f48a4127500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:03.231 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 1 -- 172.21.15.181:0/2898379827 shutdown_connections 2021-02-24T15:16:03.231 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 1 -- 172.21.15.181:0/2898379827 wait complete. 2021-02-24T15:16:03.231 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.228+0000 7f48abd25700 1 librados: shutdown 2021-02-24T15:16:03.240 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new b91de7c8-a67a-45d6-8643-8578d6b60c8e 2 2021-02-24T15:16:03.358 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.357+0000 7fea2d919700 1 Processor -- start 2021-02-24T15:16:03.359 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.357+0000 7fea2d919700 1 -- start start 2021-02-24T15:16:03.359 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.357+0000 7fea2d919700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea28095660 con 0x7fea2812e980 2021-02-24T15:16:03.359 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.357+0000 7fea2d919700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea28095900 con 0x7fea280901f0 2021-02-24T15:16:03.360 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.357+0000 7fea2d919700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea28095ba0 con 0x7fea2808fe10 2021-02-24T15:16:03.360 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.357+0000 7fea27fff700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fea280901f0 0x7fea280906a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49720/0 (socket says 172.21.15.181:49720) 2021-02-24T15:16:03.360 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.357+0000 7fea27fff700 1 -- 172.21.15.181:0/302915125 learned_addr learned my addr 172.21.15.181:0/302915125 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:03.363 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea27fff700 1 -- 172.21.15.181:0/302915125 >> v1:172.21.15.181:6789/0 conn(0x7fea280901f0 legacy=0x7fea280906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.363 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea2c917700 1 -- 172.21.15.181:0/302915125 >> v1:172.21.15.152:6790/0 conn(0x7fea2808fe10 legacy=0x7fea28095f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.363 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea2d118700 1 -- 172.21.15.181:0/302915125 >> v1:172.21.15.152:6789/0 conn(0x7fea2812e980 legacy=0x7fea28130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.364 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656154654 0 0) 0x7fea28095900 con 0x7fea280901f0 2021-02-24T15:16:03.364 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea0c003230 con 0x7fea280901f0 2021-02-24T15:16:03.364 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302829717 0 0) 0x7fea28095ba0 con 0x7fea2808fe10 2021-02-24T15:16:03.364 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea28095900 con 0x7fea2808fe10 2021-02-24T15:16:03.364 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610110264 0 0) 0x7fea28095660 con 0x7fea2812e980 2021-02-24T15:16:03.365 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea28095ba0 con 0x7fea2812e980 2021-02-24T15:16:03.365 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2981265400 0 0) 0x7fea0c003230 con 0x7fea280901f0 2021-02-24T15:16:03.365 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 >> v1:172.21.15.152:6790/0 conn(0x7fea2808fe10 legacy=0x7fea28095f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.365 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 >> v1:172.21.15.152:6789/0 conn(0x7fea2812e980 legacy=0x7fea28130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.365 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28094110 con 0x7fea280901f0 2021-02-24T15:16:03.366 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fea14001930 con 0x7fea280901f0 2021-02-24T15:16:03.366 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fea14001c40 con 0x7fea280901f0 2021-02-24T15:16:03.366 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.360+0000 7fea277fe700 1 -- 172.21.15.181:0/302915125 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fea14004750 con 0x7fea280901f0 2021-02-24T15:16:03.366 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.361+0000 7fea2d919700 1 -- 172.21.15.181:0/302915125 >> v1:172.21.15.181:6789/0 conn(0x7fea280901f0 legacy=0x7fea280906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.367 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.361+0000 7fea2d919700 1 -- 172.21.15.181:0/302915125 shutdown_connections 2021-02-24T15:16:03.367 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.361+0000 7fea2d919700 1 -- 172.21.15.181:0/302915125 >> 172.21.15.181:0/302915125 conn(0x7fea28096bb0 msgr2=0x7fea28096fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:03.367 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.361+0000 7fea2d919700 1 -- 172.21.15.181:0/302915125 shutdown_connections 2021-02-24T15:16:03.367 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.361+0000 7fea2d919700 1 -- 172.21.15.181:0/302915125 wait complete. 2021-02-24T15:16:03.367 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2d919700 1 librados: starting msgr at 2021-02-24T15:16:03.368 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2d919700 1 librados: starting objecter 2021-02-24T15:16:03.368 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2d919700 1 Processor -- start 2021-02-24T15:16:03.368 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2d919700 1 -- start start 2021-02-24T15:16:03.368 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2d919700 1 librados: setting wanted keys 2021-02-24T15:16:03.368 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2d919700 1 librados: calling monclient init 2021-02-24T15:16:03.372 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2d919700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea280922e0 con 0x7fea2812e980 2021-02-24T15:16:03.373 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2d919700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea281175c0 con 0x7fea2808fe10 2021-02-24T15:16:03.373 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2d919700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea28117860 con 0x7fea280901f0 2021-02-24T15:16:03.373 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2c917700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fea2808fe10 0x7fea280914c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49724/0 (socket says 172.21.15.181:49724) 2021-02-24T15:16:03.373 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.362+0000 7fea2c917700 1 -- 172.21.15.181:0/1815369189 learned_addr learned my addr 172.21.15.181:0/1815369189 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:03.374 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea2c917700 1 -- 172.21.15.181:0/1815369189 >> v1:172.21.15.181:6789/0 conn(0x7fea2808fe10 legacy=0x7fea280914c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.374 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 10 client.?.objecter ms_handle_connect 0x7fea2808fe10 2021-02-24T15:16:03.374 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.374 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 10 client.?.objecter ms_handle_connect 0x7fea280901f0 2021-02-24T15:16:03.375 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea27fff700 1 -- 172.21.15.181:0/1815369189 >> v1:172.21.15.152:6790/0 conn(0x7fea280901f0 legacy=0x7fea28091bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.375 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.375 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 10 client.?.objecter ms_handle_connect 0x7fea2812e980 2021-02-24T15:16:03.375 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea2d118700 1 -- 172.21.15.181:0/1815369189 >> v1:172.21.15.152:6789/0 conn(0x7fea2812e980 legacy=0x7fea28142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.375 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.376 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071171372 0 0) 0x7fea281175c0 con 0x7fea2808fe10 2021-02-24T15:16:03.376 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea08004bd0 con 0x7fea2808fe10 2021-02-24T15:16:03.376 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312002878 0 0) 0x7fea28117860 con 0x7fea280901f0 2021-02-24T15:16:03.376 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea281175c0 con 0x7fea280901f0 2021-02-24T15:16:03.376 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183914416 0 0) 0x7fea280922e0 con 0x7fea2812e980 2021-02-24T15:16:03.377 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea28117860 con 0x7fea2812e980 2021-02-24T15:16:03.377 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 502558720 0 0) 0x7fea08004bd0 con 0x7fea2808fe10 2021-02-24T15:16:03.377 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea280922e0 con 0x7fea2808fe10 2021-02-24T15:16:03.377 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fea1c001cd0 con 0x7fea2808fe10 2021-02-24T15:16:03.377 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2634873823 0 0) 0x7fea281175c0 con 0x7fea280901f0 2021-02-24T15:16:03.385 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea08004bd0 con 0x7fea280901f0 2021-02-24T15:16:03.385 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2458820287 0 0) 0x7fea28117860 con 0x7fea2812e980 2021-02-24T15:16:03.385 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea281175c0 con 0x7fea2812e980 2021-02-24T15:16:03.386 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fea140018f0 con 0x7fea280901f0 2021-02-24T15:16:03.386 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fea20001f60 con 0x7fea2812e980 2021-02-24T15:16:03.386 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 173701725 0 0) 0x7fea280922e0 con 0x7fea2808fe10 2021-02-24T15:16:03.386 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 >> v1:172.21.15.152:6790/0 conn(0x7fea280901f0 legacy=0x7fea28091bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.387 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 >> v1:172.21.15.152:6789/0 conn(0x7fea2812e980 legacy=0x7fea28142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.387 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28117b00 con 0x7fea2808fe10 2021-02-24T15:16:03.387 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea2d919700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea28116470 con 0x7fea2808fe10 2021-02-24T15:16:03.387 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea2d919700 10 client.4114.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:03.387 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea2d919700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2812e5b0 con 0x7fea2808fe10 2021-02-24T15:16:03.388 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea2d919700 1 librados: init done 2021-02-24T15:16:03.388 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fea1c002430 con 0x7fea2808fe10 2021-02-24T15:16:03.388 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fea1c002740 con 0x7fea2808fe10 2021-02-24T15:16:03.388 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7fea1c002c00 con 0x7fea2808fe10 2021-02-24T15:16:03.389 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (unknown 4125259178 0 0) 0x7fea1c005910 con 0x7fea2808fe10 2021-02-24T15:16:03.389 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 10 client.4114.objecter ms_dispatch 0x7fea28001510 osd_map(4..4 src has 1..4) v4 2021-02-24T15:16:03.389 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 3 client.4114.objecter handle_osd_map got epochs [4,4] > 0 2021-02-24T15:16:03.389 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.365+0000 7fea24ff9700 3 client.4114.objecter handle_osd_map decoding full epoch 4 2021-02-24T15:16:03.389 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.366+0000 7fea24ff9700 20 client.4114.objecter dump_active .. 0 homeless 2021-02-24T15:16:03.390 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.366+0000 7fea2d919700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea00004d60 con 0x7fea2808fe10 2021-02-24T15:16:03.390 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.368+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (unknown 1092875540 0 742114027) 0x7fea1c0054d0 con 0x7fea2808fe10 2021-02-24T15:16:03.461 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.460+0000 7fea2d919700 1 -- 172.21.15.181:0/1815369189 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b91de7c8-a67a-45d6-8643-8578d6b60c8e", "id": 2} v 0) v1 -- 0x7fea00005010 con 0x7fea2808fe10 2021-02-24T15:16:03.469 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.467+0000 7fea24ff9700 1 -- 172.21.15.181:0/1815369189 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b91de7c8-a67a-45d6-8643-8578d6b60c8e", "id": 2}]=0 v5) v1 ==== 112+0+2 (unknown 2325140380 0 216599125) 0x7fea1c005770 con 0x7fea2808fe10 2021-02-24T15:16:03.469 INFO:teuthology.orchestra.run.smithi181.stdout:2 2021-02-24T15:16:03.470 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.468+0000 7fea2d919700 10 librados: watch_flush enter 2021-02-24T15:16:03.470 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.468+0000 7fea2d919700 10 librados: watch_flush exit 2021-02-24T15:16:03.471 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.468+0000 7fea2d919700 20 client.4114.objecter shutdown clearing up homeless session... 2021-02-24T15:16:03.471 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.468+0000 7fea2d919700 10 client.4114.objecter successfully canceled tick 2021-02-24T15:16:03.471 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.468+0000 7fea2d919700 1 -- 172.21.15.181:0/1815369189 >> v1:172.21.15.181:6789/0 conn(0x7fea2808fe10 legacy=0x7fea280914c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.471 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.469+0000 7fea2d919700 1 -- 172.21.15.181:0/1815369189 shutdown_connections 2021-02-24T15:16:03.472 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.469+0000 7fea2d919700 1 -- 172.21.15.181:0/1815369189 >> 172.21.15.181:0/1815369189 conn(0x7fea28096bb0 msgr2=0x7fea281310d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:03.472 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.469+0000 7fea2d919700 1 -- 172.21.15.181:0/1815369189 shutdown_connections 2021-02-24T15:16:03.472 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.469+0000 7fea2d919700 1 -- 172.21.15.181:0/1815369189 wait complete. 2021-02-24T15:16:03.472 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.469+0000 7fea2d919700 1 librados: shutdown 2021-02-24T15:16:03.482 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new cc030322-1a40-4f32-9ea3-48d755deaca6 3 2021-02-24T15:16:03.627 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.624+0000 7f4fcc8d6700 1 Processor -- start 2021-02-24T15:16:03.627 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.624+0000 7f4fcc8d6700 1 -- start start 2021-02-24T15:16:03.627 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.625+0000 7f4fcc8d6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc80916f0 con 0x7f4fc812cfa0 2021-02-24T15:16:03.627 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.625+0000 7f4fcc8d6700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc8095730 con 0x7f4fc8090550 2021-02-24T15:16:03.628 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.625+0000 7f4fcc8d6700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc8091920 con 0x7f4fc8091f80 2021-02-24T15:16:03.628 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.625+0000 7f4fc659c700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4fc8090550 0x7f4fc8094910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49730/0 (socket says 172.21.15.181:49730) 2021-02-24T15:16:03.628 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.625+0000 7f4fc659c700 1 -- 172.21.15.181:0/952454401 learned_addr learned my addr 172.21.15.181:0/952454401 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:03.629 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.627+0000 7f4fc659c700 1 -- 172.21.15.181:0/952454401 >> v1:172.21.15.181:6789/0 conn(0x7f4fc8090550 legacy=0x7f4fc8094910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.629 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.627+0000 7f4fc5d9b700 1 -- 172.21.15.181:0/952454401 >> v1:172.21.15.152:6790/0 conn(0x7f4fc8091f80 legacy=0x7f4fc8095020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.630 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.627+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242584442 0 0) 0x7f4fc8095730 con 0x7f4fc8090550 2021-02-24T15:16:03.630 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.627+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fac003230 con 0x7f4fc8090550 2021-02-24T15:16:03.630 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc6d9d700 1 -- 172.21.15.181:0/952454401 >> v1:172.21.15.152:6789/0 conn(0x7f4fc812cfa0 legacy=0x7f4fc812f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.630 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153257741 0 0) 0x7f4fc8091920 con 0x7f4fc8091f80 2021-02-24T15:16:03.631 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc8095730 con 0x7f4fc8091f80 2021-02-24T15:16:03.631 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2301219470 0 0) 0x7f4fac003230 con 0x7f4fc8090550 2021-02-24T15:16:03.631 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 >> v1:172.21.15.152:6790/0 conn(0x7f4fc8091f80 legacy=0x7f4fc8095020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.631 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 >> v1:172.21.15.152:6789/0 conn(0x7f4fc812cfa0 legacy=0x7f4fc812f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.632 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8091bc0 con 0x7f4fc8090550 2021-02-24T15:16:03.632 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4fb8001cb0 con 0x7f4fc8090550 2021-02-24T15:16:03.633 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4fb8001fc0 con 0x7f4fc8090550 2021-02-24T15:16:03.633 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.628+0000 7f4fc559a700 1 -- 172.21.15.181:0/952454401 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4fb8005360 con 0x7f4fc8090550 2021-02-24T15:16:03.634 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.629+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/952454401 >> v1:172.21.15.181:6789/0 conn(0x7f4fc8090550 legacy=0x7f4fc8094910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.634 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.629+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/952454401 shutdown_connections 2021-02-24T15:16:03.634 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.629+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/952454401 >> 172.21.15.181:0/952454401 conn(0x7f4fc8099790 msgr2=0x7f4fc8099ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:03.634 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.629+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/952454401 shutdown_connections 2021-02-24T15:16:03.635 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.629+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/952454401 wait complete. 2021-02-24T15:16:03.635 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.630+0000 7f4fcc8d6700 1 librados: starting msgr at 2021-02-24T15:16:03.635 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.630+0000 7f4fcc8d6700 1 librados: starting objecter 2021-02-24T15:16:03.635 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.630+0000 7f4fcc8d6700 1 Processor -- start 2021-02-24T15:16:03.635 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.630+0000 7f4fcc8d6700 1 -- start start 2021-02-24T15:16:03.636 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.630+0000 7f4fcc8d6700 1 librados: setting wanted keys 2021-02-24T15:16:03.636 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.630+0000 7f4fcc8d6700 1 librados: calling monclient init 2021-02-24T15:16:03.636 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.631+0000 7f4fcc8d6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc811bd70 con 0x7f4fc8090550 2021-02-24T15:16:03.637 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.631+0000 7f4fcc8d6700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc811c010 con 0x7f4fc812cfa0 2021-02-24T15:16:03.637 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.631+0000 7f4fcc8d6700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc811c2b0 con 0x7f4fc8091f80 2021-02-24T15:16:03.637 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.631+0000 7f4fc6d9d700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4fc812cfa0 0x7f4fc8146be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49738/0 (socket says 172.21.15.181:49738) 2021-02-24T15:16:03.637 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.631+0000 7f4fc6d9d700 1 -- 172.21.15.181:0/2742049744 learned_addr learned my addr 172.21.15.181:0/2742049744 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:03.639 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fc6d9d700 1 -- 172.21.15.181:0/2742049744 >> v1:172.21.15.181:6789/0 conn(0x7f4fc812cfa0 legacy=0x7f4fc8146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.642 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fc659c700 1 -- 172.21.15.181:0/2742049744 >> v1:172.21.15.152:6789/0 conn(0x7f4fc8090550 legacy=0x7f4fc8118600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.642 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fb67fc700 10 client.?.objecter ms_handle_connect 0x7f4fc812cfa0 2021-02-24T15:16:03.643 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fb67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.643 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fb67fc700 10 client.?.objecter ms_handle_connect 0x7f4fc8090550 2021-02-24T15:16:03.643 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fb67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.643 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852639970 0 0) 0x7f4fc811c010 con 0x7f4fc812cfa0 2021-02-24T15:16:03.643 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa4004bd0 con 0x7f4fc812cfa0 2021-02-24T15:16:03.644 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358028303 0 0) 0x7f4fc811bd70 con 0x7f4fc8090550 2021-02-24T15:16:03.644 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.633+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc811c010 con 0x7f4fc8090550 2021-02-24T15:16:03.644 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fc659c700 1 --1- 172.21.15.181:0/2742049744 >> v1:172.21.15.152:6789/0 conn(0x7f4fc8090550 0x7f4fc8118600 :-1 s=OPENED pgs=30 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f4fc811c010 auth_reply(proto 2 0 (0) Success) v1 2021-02-24T15:16:03.644 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3238916599 0 0) 0x7f4fa4004bd0 con 0x7f4fc812cfa0 2021-02-24T15:16:03.644 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fc5d9b700 1 -- 172.21.15.181:0/2742049744 >> v1:172.21.15.152:6790/0 conn(0x7f4fc8091f80 legacy=0x7f4fc8118d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.645 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4fa4005250 con 0x7f4fc812cfa0 2021-02-24T15:16:03.655 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 10 client.?.objecter ms_handle_connect 0x7f4fc8091f80 2021-02-24T15:16:03.656 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.656 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4fc0001c70 con 0x7f4fc812cfa0 2021-02-24T15:16:03.656 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2731723004 0 0) 0x7f4fc811c010 con 0x7f4fc8090550 2021-02-24T15:16:03.656 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4fa4004bd0 con 0x7f4fc8090550 2021-02-24T15:16:03.656 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3510142861 0 0) 0x7f4fa4005250 con 0x7f4fc812cfa0 2021-02-24T15:16:03.657 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 >> v1:172.21.15.152:6790/0 conn(0x7f4fc8091f80 legacy=0x7f4fc8118d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.657 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 >> v1:172.21.15.152:6789/0 conn(0x7f4fc8090550 legacy=0x7f4fc8118600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.657 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc811a140 con 0x7f4fc812cfa0 2021-02-24T15:16:03.657 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/2742049744 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc812cc30 con 0x7f4fc812cfa0 2021-02-24T15:16:03.657 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fcc8d6700 10 client.4120.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:03.658 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/2742049744 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc811c830 con 0x7f4fc812cfa0 2021-02-24T15:16:03.658 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fcc8d6700 1 librados: init done 2021-02-24T15:16:03.658 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4fb8001c70 con 0x7f4fc8090550 2021-02-24T15:16:03.658 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4fc00023f0 con 0x7f4fc812cfa0 2021-02-24T15:16:03.659 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4fc0002700 con 0x7f4fc812cfa0 2021-02-24T15:16:03.664 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f4fc0002b40 con 0x7f4fc812cfa0 2021-02-24T15:16:03.664 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (unknown 111877461 0 0) 0x7f4fc0005990 con 0x7f4fc812cfa0 2021-02-24T15:16:03.665 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 10 client.4120.objecter ms_dispatch 0x7f4fc8001510 osd_map(5..5 src has 1..5) v4 2021-02-24T15:16:03.665 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 3 client.4120.objecter handle_osd_map got epochs [5,5] > 0 2021-02-24T15:16:03.665 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 3 client.4120.objecter handle_osd_map decoding full epoch 5 2021-02-24T15:16:03.665 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.634+0000 7f4fb67fc700 20 client.4120.objecter dump_active .. 0 homeless 2021-02-24T15:16:03.666 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.636+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/2742049744 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa8004d60 con 0x7f4fc812cfa0 2021-02-24T15:16:03.666 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.638+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (unknown 1092875540 0 742114027) 0x7f4fc00054d0 con 0x7f4fc812cfa0 2021-02-24T15:16:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.729+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/2742049744 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "osd new", "uuid": "cc030322-1a40-4f32-9ea3-48d755deaca6", "id": 3} v 0) v1 -- 0x7f4fa8005010 con 0x7f4fc812cfa0 2021-02-24T15:16:03.738 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.737+0000 7f4fb67fc700 1 -- 172.21.15.181:0/2742049744 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc030322-1a40-4f32-9ea3-48d755deaca6", "id": 3}]=0 v6) v1 ==== 112+0+2 (unknown 1311870249 0 525046306) 0x7f4fc00056b0 con 0x7f4fc812cfa0 2021-02-24T15:16:03.738 INFO:teuthology.orchestra.run.smithi181.stdout:3 2021-02-24T15:16:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 10 librados: watch_flush enter 2021-02-24T15:16:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 10 librados: watch_flush exit 2021-02-24T15:16:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 20 client.4120.objecter shutdown clearing up homeless session... 2021-02-24T15:16:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 10 client.4120.objecter successfully canceled tick 2021-02-24T15:16:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/2742049744 >> v1:172.21.15.181:6789/0 conn(0x7f4fc812cfa0 legacy=0x7f4fc8146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/2742049744 shutdown_connections 2021-02-24T15:16:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/2742049744 >> 172.21.15.181:0/2742049744 conn(0x7f4fc8099790 msgr2=0x7f4fc812f390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/2742049744 shutdown_connections 2021-02-24T15:16:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 1 -- 172.21.15.181:0/2742049744 wait complete. 2021-02-24T15:16:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.738+0000 7f4fcc8d6700 1 librados: shutdown 2021-02-24T15:16:03.751 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 3022f9f3-8ca8-403a-863a-41c661302f24 4 2021-02-24T15:16:03.877 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.871+0000 7f1f0adc9700 1 Processor -- start 2021-02-24T15:16:03.879 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.871+0000 7f1f0adc9700 1 -- start start 2021-02-24T15:16:03.879 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.871+0000 7f1f0adc9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f04068460 con 0x7f1f040678e0 2021-02-24T15:16:03.879 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.871+0000 7f1f0adc9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f04093640 con 0x7f1f04092270 2021-02-24T15:16:03.879 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.871+0000 7f1f0adc9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f040938e0 con 0x7f1f04098770 2021-02-24T15:16:03.880 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.872+0000 7f1f08b65700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1f04092270 0x7f1f04128a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49742/0 (socket says 172.21.15.181:49742) 2021-02-24T15:16:03.880 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.872+0000 7f1f08b65700 1 -- 172.21.15.181:0/2800486721 learned_addr learned my addr 172.21.15.181:0/2800486721 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:03.880 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f08b65700 1 -- 172.21.15.181:0/2800486721 >> v1:172.21.15.181:6789/0 conn(0x7f1f04092270 legacy=0x7f1f04128a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.880 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f03fff700 1 -- 172.21.15.181:0/2800486721 >> v1:172.21.15.152:6790/0 conn(0x7f1f04098770 legacy=0x7f1f0412da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.881 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f09366700 1 -- 172.21.15.181:0/2800486721 >> v1:172.21.15.152:6789/0 conn(0x7f1f040678e0 legacy=0x7f1f04131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.881 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608983267 0 0) 0x7f1f04093640 con 0x7f1f04092270 2021-02-24T15:16:03.881 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee8003230 con 0x7f1f04092270 2021-02-24T15:16:03.882 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451340828 0 0) 0x7f1f040938e0 con 0x7f1f04098770 2021-02-24T15:16:03.882 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f04093640 con 0x7f1f04098770 2021-02-24T15:16:03.882 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136199240 0 0) 0x7f1f04068460 con 0x7f1f040678e0 2021-02-24T15:16:03.883 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f040938e0 con 0x7f1f040678e0 2021-02-24T15:16:03.884 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1247728592 0 0) 0x7f1ee8003230 con 0x7f1f04092270 2021-02-24T15:16:03.885 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 >> v1:172.21.15.152:6790/0 conn(0x7f1f04098770 legacy=0x7f1f0412da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.885 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 >> v1:172.21.15.152:6789/0 conn(0x7f1f040678e0 legacy=0x7f1f04131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.885 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04067d50 con 0x7f1f04092270 2021-02-24T15:16:03.885 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1ef8001970 con 0x7f1f04092270 2021-02-24T15:16:03.886 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1ef8001c80 con 0x7f1f04092270 2021-02-24T15:16:03.886 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.874+0000 7f1f037fe700 1 -- 172.21.15.181:0/2800486721 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1ef8004750 con 0x7f1f04092270 2021-02-24T15:16:03.886 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.875+0000 7f1f0adc9700 1 -- 172.21.15.181:0/2800486721 >> v1:172.21.15.181:6789/0 conn(0x7f1f04092270 legacy=0x7f1f04128a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.887 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.875+0000 7f1f0adc9700 1 -- 172.21.15.181:0/2800486721 shutdown_connections 2021-02-24T15:16:03.887 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.875+0000 7f1f0adc9700 1 -- 172.21.15.181:0/2800486721 >> 172.21.15.181:0/2800486721 conn(0x7f1f04099860 msgr2=0x7f1f04099c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:03.887 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.875+0000 7f1f0adc9700 1 -- 172.21.15.181:0/2800486721 shutdown_connections 2021-02-24T15:16:03.887 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.875+0000 7f1f0adc9700 1 -- 172.21.15.181:0/2800486721 wait complete. 2021-02-24T15:16:03.888 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.876+0000 7f1f0adc9700 1 librados: starting msgr at 2021-02-24T15:16:03.888 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.876+0000 7f1f0adc9700 1 librados: starting objecter 2021-02-24T15:16:03.889 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.876+0000 7f1f0adc9700 1 Processor -- start 2021-02-24T15:16:03.904 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.877+0000 7f1f0adc9700 1 -- start start 2021-02-24T15:16:03.905 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.877+0000 7f1f0adc9700 1 librados: setting wanted keys 2021-02-24T15:16:03.906 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.877+0000 7f1f0adc9700 1 librados: calling monclient init 2021-02-24T15:16:03.906 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.878+0000 7f1f0adc9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f04125f20 con 0x7f1f04092270 2021-02-24T15:16:03.907 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.878+0000 7f1f0adc9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f041230b0 con 0x7f1f04098770 2021-02-24T15:16:03.907 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.878+0000 7f1f0adc9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f04123350 con 0x7f1f040678e0 2021-02-24T15:16:03.907 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.878+0000 7f1f09366700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1f04098770 0x7f1f04140a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49752/0 (socket says 172.21.15.181:49752) 2021-02-24T15:16:03.908 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.878+0000 7f1f09366700 1 -- 172.21.15.181:0/1792890869 learned_addr learned my addr 172.21.15.181:0/1792890869 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:03.908 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f09366700 1 -- 172.21.15.181:0/1792890869 >> v1:172.21.15.181:6789/0 conn(0x7f1f04098770 legacy=0x7f1f04140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.908 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 10 client.?.objecter ms_handle_connect 0x7f1f04098770 2021-02-24T15:16:03.908 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.909 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 10 client.?.objecter ms_handle_connect 0x7f1f04092270 2021-02-24T15:16:03.909 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.909 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f03fff700 1 -- 172.21.15.181:0/1792890869 >> v1:172.21.15.152:6789/0 conn(0x7f1f04092270 legacy=0x7f1f0413d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.909 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 10 client.?.objecter ms_handle_connect 0x7f1f040678e0 2021-02-24T15:16:03.910 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:03.910 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f08b65700 1 -- 172.21.15.181:0/1792890869 >> v1:172.21.15.152:6790/0 conn(0x7f1f040678e0 legacy=0x7f1f04125810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:03.910 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440432027 0 0) 0x7f1f041230b0 con 0x7f1f04098770 2021-02-24T15:16:03.910 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee4004bd0 con 0x7f1f04098770 2021-02-24T15:16:03.910 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889425371 0 0) 0x7f1f04125f20 con 0x7f1f04092270 2021-02-24T15:16:03.912 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f041230b0 con 0x7f1f04092270 2021-02-24T15:16:03.913 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361739274 0 0) 0x7f1f04123350 con 0x7f1f040678e0 2021-02-24T15:16:03.913 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f04125f20 con 0x7f1f040678e0 2021-02-24T15:16:03.913 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1169438899 0 0) 0x7f1ee4004bd0 con 0x7f1f04098770 2021-02-24T15:16:03.913 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f04123350 con 0x7f1f04098770 2021-02-24T15:16:03.914 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1efc002070 con 0x7f1f04098770 2021-02-24T15:16:03.914 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1263051701 0 0) 0x7f1f041230b0 con 0x7f1f04092270 2021-02-24T15:16:03.914 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ee4004bd0 con 0x7f1f04092270 2021-02-24T15:16:03.930 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1ef0001c40 con 0x7f1f04092270 2021-02-24T15:16:03.930 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 536481931 0 0) 0x7f1f04125f20 con 0x7f1f040678e0 2021-02-24T15:16:03.930 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f041230b0 con 0x7f1f040678e0 2021-02-24T15:16:03.931 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1ef8001790 con 0x7f1f040678e0 2021-02-24T15:16:03.931 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2043376092 0 0) 0x7f1f04123350 con 0x7f1f04098770 2021-02-24T15:16:03.931 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.880+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 >> v1:172.21.15.152:6790/0 conn(0x7f1f040678e0 legacy=0x7f1f04125810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.931 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 >> v1:172.21.15.152:6789/0 conn(0x7f1f04092270 legacy=0x7f1f0413d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.931 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04138100 con 0x7f1f04098770 2021-02-24T15:16:03.932 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f0adc9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f04121cc0 con 0x7f1f04098770 2021-02-24T15:16:03.932 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f0adc9700 10 client.4126.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:03.932 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f0adc9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f04138b40 con 0x7f1f04098770 2021-02-24T15:16:03.932 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f0adc9700 1 librados: init done 2021-02-24T15:16:03.932 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1efc002730 con 0x7f1f04098770 2021-02-24T15:16:03.933 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1efc002a40 con 0x7f1f04098770 2021-02-24T15:16:03.933 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f1efc002ef0 con 0x7f1f04098770 2021-02-24T15:16:03.934 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (unknown 2839745138 0 0) 0x7f1efc005d80 con 0x7f1f04098770 2021-02-24T15:16:03.934 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 10 client.4126.objecter ms_dispatch 0x7f1f04001510 osd_map(6..6 src has 1..6) v4 2021-02-24T15:16:03.934 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 3 client.4126.objecter handle_osd_map got epochs [6,6] > 0 2021-02-24T15:16:03.935 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 3 client.4126.objecter handle_osd_map decoding full epoch 6 2021-02-24T15:16:03.935 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.881+0000 7f1f00ff9700 20 client.4126.objecter dump_active .. 0 homeless 2021-02-24T15:16:03.935 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.882+0000 7f1f0adc9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc004d60 con 0x7f1f04098770 2021-02-24T15:16:03.937 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.884+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (unknown 1092875540 0 742114027) 0x7f1efc005960 con 0x7f1f04098770 2021-02-24T15:16:03.977 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.976+0000 7f1f0adc9700 1 -- 172.21.15.181:0/1792890869 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "osd new", "uuid": "3022f9f3-8ca8-403a-863a-41c661302f24", "id": 4} v 0) v1 -- 0x7f1edc005590 con 0x7f1f04098770 2021-02-24T15:16:03.985 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.984+0000 7f1f00ff9700 1 -- 172.21.15.181:0/1792890869 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3022f9f3-8ca8-403a-863a-41c661302f24", "id": 4}]=0 v7) v1 ==== 112+0+2 (unknown 2332761779 0 1697012583) 0x7f1efc006370 con 0x7f1f04098770 2021-02-24T15:16:03.986 INFO:teuthology.orchestra.run.smithi181.stdout:4 2021-02-24T15:16:03.987 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 10 librados: watch_flush enter 2021-02-24T15:16:03.988 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 10 librados: watch_flush exit 2021-02-24T15:16:03.988 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 20 client.4126.objecter shutdown clearing up homeless session... 2021-02-24T15:16:03.988 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 10 client.4126.objecter successfully canceled tick 2021-02-24T15:16:03.988 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 1 -- 172.21.15.181:0/1792890869 >> v1:172.21.15.181:6789/0 conn(0x7f1f04098770 legacy=0x7f1f04140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:03.989 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 1 -- 172.21.15.181:0/1792890869 shutdown_connections 2021-02-24T15:16:03.989 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 1 -- 172.21.15.181:0/1792890869 >> 172.21.15.181:0/1792890869 conn(0x7f1f04099860 msgr2=0x7f1f040942f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:03.989 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 1 -- 172.21.15.181:0/1792890869 shutdown_connections 2021-02-24T15:16:03.989 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 1 -- 172.21.15.181:0/1792890869 wait complete. 2021-02-24T15:16:04.001 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:03.985+0000 7f1f0adc9700 1 librados: shutdown 2021-02-24T15:16:04.002 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new a6762546-97f4-409d-bebb-411eb5fba3db 5 2021-02-24T15:16:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.119+0000 7f52efa86700 1 Processor -- start 2021-02-24T15:16:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.119+0000 7f52efa86700 1 -- start start 2021-02-24T15:16:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.120+0000 7f52efa86700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e8093f50 con 0x7f52e80983d0 2021-02-24T15:16:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.120+0000 7f52efa86700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e8091780 con 0x7f52e8097ff0 2021-02-24T15:16:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.120+0000 7f52efa86700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e8091a20 con 0x7f52e812d280 2021-02-24T15:16:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.120+0000 7f52ed822700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f52e8097ff0 0x7f52e8092320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49754/0 (socket says 172.21.15.181:49754) 2021-02-24T15:16:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.120+0000 7f52ed822700 1 -- 172.21.15.181:0/646638303 learned_addr learned my addr 172.21.15.181:0/646638303 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ed822700 1 -- 172.21.15.181:0/646638303 >> v1:172.21.15.181:6789/0 conn(0x7f52e8097ff0 legacy=0x7f52e8092320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598394542 0 0) 0x7f52e8091780 con 0x7f52e8097ff0 2021-02-24T15:16:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ee023700 1 -- 172.21.15.181:0/646638303 >> v1:172.21.15.152:6790/0 conn(0x7f52e812d280 legacy=0x7f52e812f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d0003230 con 0x7f52e8097ff0 2021-02-24T15:16:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ed021700 1 -- 172.21.15.181:0/646638303 >> v1:172.21.15.152:6789/0 conn(0x7f52e80983d0 legacy=0x7f52e8098880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:04.129 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060935989 0 0) 0x7f52e8091a20 con 0x7f52e812d280 2021-02-24T15:16:04.129 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e8091780 con 0x7f52e812d280 2021-02-24T15:16:04.129 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2792945682 0 0) 0x7f52d0003230 con 0x7f52e8097ff0 2021-02-24T15:16:04.129 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 >> v1:172.21.15.152:6790/0 conn(0x7f52e812d280 legacy=0x7f52e812f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:04.129 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 >> v1:172.21.15.152:6789/0 conn(0x7f52e80983d0 legacy=0x7f52e8098880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8091cc0 con 0x7f52e8097ff0 2021-02-24T15:16:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52d8001930 con 0x7f52e8097ff0 2021-02-24T15:16:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f52d8001c40 con 0x7f52e8097ff0 2021-02-24T15:16:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.122+0000 7f52ec820700 1 -- 172.21.15.181:0/646638303 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52d8004750 con 0x7f52e8097ff0 2021-02-24T15:16:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.123+0000 7f52efa86700 1 -- 172.21.15.181:0/646638303 >> v1:172.21.15.181:6789/0 conn(0x7f52e8097ff0 legacy=0x7f52e8092320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.123+0000 7f52efa86700 1 -- 172.21.15.181:0/646638303 shutdown_connections 2021-02-24T15:16:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.123+0000 7f52efa86700 1 -- 172.21.15.181:0/646638303 >> 172.21.15.181:0/646638303 conn(0x7f52e8099860 msgr2=0x7f52e8099c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.123+0000 7f52efa86700 1 -- 172.21.15.181:0/646638303 shutdown_connections 2021-02-24T15:16:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.123+0000 7f52efa86700 1 -- 172.21.15.181:0/646638303 wait complete. 2021-02-24T15:16:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52efa86700 1 librados: starting msgr at 2021-02-24T15:16:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52efa86700 1 librados: starting objecter 2021-02-24T15:16:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52efa86700 1 Processor -- start 2021-02-24T15:16:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52efa86700 1 -- start start 2021-02-24T15:16:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52efa86700 1 librados: setting wanted keys 2021-02-24T15:16:04.133 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52efa86700 1 librados: calling monclient init 2021-02-24T15:16:04.133 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52efa86700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e8133560 con 0x7f52e8097ff0 2021-02-24T15:16:04.133 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52efa86700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e8114b50 con 0x7f52e812d280 2021-02-24T15:16:04.134 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52efa86700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e80911b0 con 0x7f52e80983d0 2021-02-24T15:16:04.135 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52ee023700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f52e812d280 0x7f52e8142880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49760/0 (socket says 172.21.15.181:49760) 2021-02-24T15:16:04.135 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.124+0000 7f52ee023700 1 -- 172.21.15.181:0/2075609180 learned_addr learned my addr 172.21.15.181:0/2075609180 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:16:04.139 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52ee023700 1 -- 172.21.15.181:0/2075609180 >> v1:172.21.15.181:6789/0 conn(0x7f52e812d280 legacy=0x7f52e8142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:04.139 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 10 client.?.objecter ms_handle_connect 0x7f52e812d280 2021-02-24T15:16:04.139 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:04.140 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 10 client.?.objecter ms_handle_connect 0x7f52e8097ff0 2021-02-24T15:16:04.140 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:04.140 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52ed822700 1 -- 172.21.15.181:0/2075609180 >> v1:172.21.15.152:6789/0 conn(0x7f52e8097ff0 legacy=0x7f52e813a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:04.140 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 10 client.?.objecter ms_handle_connect 0x7f52e80983d0 2021-02-24T15:16:04.140 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:04.141 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52ed021700 1 -- 172.21.15.181:0/2075609180 >> v1:172.21.15.152:6790/0 conn(0x7f52e80983d0 legacy=0x7f52e813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:04.141 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138144905 0 0) 0x7f52e8114b50 con 0x7f52e812d280 2021-02-24T15:16:04.141 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c8004bd0 con 0x7f52e812d280 2021-02-24T15:16:04.141 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495169796 0 0) 0x7f52e8133560 con 0x7f52e8097ff0 2021-02-24T15:16:04.142 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e8114b50 con 0x7f52e8097ff0 2021-02-24T15:16:04.142 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592826460 0 0) 0x7f52e80911b0 con 0x7f52e80983d0 2021-02-24T15:16:04.142 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e8133560 con 0x7f52e80983d0 2021-02-24T15:16:04.143 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1600130069 0 0) 0x7f52c8004bd0 con 0x7f52e812d280 2021-02-24T15:16:04.143 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52e80911b0 con 0x7f52e812d280 2021-02-24T15:16:04.143 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52e0002010 con 0x7f52e812d280 2021-02-24T15:16:04.144 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2222235327 0 0) 0x7f52e80911b0 con 0x7f52e812d280 2021-02-24T15:16:04.145 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 >> v1:172.21.15.152:6790/0 conn(0x7f52e80983d0 legacy=0x7f52e813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:04.145 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 >> v1:172.21.15.152:6789/0 conn(0x7f52e8097ff0 legacy=0x7f52e813a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:04.156 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8095d30 con 0x7f52e812d280 2021-02-24T15:16:04.156 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52efa86700 1 -- 172.21.15.181:0/2075609180 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e813ac20 con 0x7f52e812d280 2021-02-24T15:16:04.156 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f52e00026a0 con 0x7f52e812d280 2021-02-24T15:16:04.157 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52e00029b0 con 0x7f52e812d280 2021-02-24T15:16:04.157 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f52e0002e30 con 0x7f52e812d280 2021-02-24T15:16:04.157 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52efa86700 10 client.4132.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:04.157 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52efa86700 1 -- 172.21.15.181:0/2075609180 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e812c430 con 0x7f52e812d280 2021-02-24T15:16:04.158 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.127+0000 7f52efa86700 1 librados: init done 2021-02-24T15:16:04.158 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.128+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (unknown 1734936149 0 0) 0x7f52e00063d0 con 0x7f52e812d280 2021-02-24T15:16:04.158 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.128+0000 7f52d5ffb700 10 client.4132.objecter ms_dispatch 0x7f52e8001510 osd_map(7..7 src has 1..7) v4 2021-02-24T15:16:04.158 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.128+0000 7f52d5ffb700 3 client.4132.objecter handle_osd_map got epochs [7,7] > 0 2021-02-24T15:16:04.159 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.128+0000 7f52d5ffb700 3 client.4132.objecter handle_osd_map decoding full epoch 7 2021-02-24T15:16:04.159 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.128+0000 7f52d5ffb700 20 client.4132.objecter dump_active .. 0 homeless 2021-02-24T15:16:04.159 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.129+0000 7f52efa86700 1 -- 172.21.15.181:0/2075609180 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e8131fa0 con 0x7f52e812d280 2021-02-24T15:16:04.159 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.131+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (unknown 1092875540 0 742114027) 0x7f52e00059f0 con 0x7f52e812d280 2021-02-24T15:16:04.237 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.236+0000 7f52efa86700 1 -- 172.21.15.181:0/2075609180 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "osd new", "uuid": "a6762546-97f4-409d-bebb-411eb5fba3db", "id": 5} v 0) v1 -- 0x7f52e8058400 con 0x7f52e812d280 2021-02-24T15:16:04.245 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.244+0000 7f52d5ffb700 1 -- 172.21.15.181:0/2075609180 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6762546-97f4-409d-bebb-411eb5fba3db", "id": 5}]=0 v8) v1 ==== 112+0+2 (unknown 3569564182 0 1988412176) 0x7f52e0005cf0 con 0x7f52e812d280 2021-02-24T15:16:04.246 INFO:teuthology.orchestra.run.smithi181.stdout:5 2021-02-24T15:16:04.247 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 10 librados: watch_flush enter 2021-02-24T15:16:04.247 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 10 librados: watch_flush exit 2021-02-24T15:16:04.248 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 20 client.4132.objecter shutdown clearing up homeless session... 2021-02-24T15:16:04.248 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 10 client.4132.objecter successfully canceled tick 2021-02-24T15:16:04.248 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 1 -- 172.21.15.181:0/2075609180 >> v1:172.21.15.181:6789/0 conn(0x7f52e812d280 legacy=0x7f52e8142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:04.248 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 1 -- 172.21.15.181:0/2075609180 shutdown_connections 2021-02-24T15:16:04.248 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 1 -- 172.21.15.181:0/2075609180 >> 172.21.15.181:0/2075609180 conn(0x7f52e8099860 msgr2=0x7f52e8064780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:04.249 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 1 -- 172.21.15.181:0/2075609180 shutdown_connections 2021-02-24T15:16:04.249 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 1 -- 172.21.15.181:0/2075609180 wait complete. 2021-02-24T15:16:04.249 INFO:teuthology.orchestra.run.smithi181.stderr:2021-02-24T15:16:04.245+0000 7f52efa86700 1 librados: shutdown 2021-02-24T15:16:04.259 INFO:tasks.ceph.osd.0:Restarting daemon 2021-02-24T15:16:04.259 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-02-24T15:16:04.262 INFO:tasks.ceph.osd.0:Started 2021-02-24T15:16:04.262 INFO:tasks.ceph.osd.1:Restarting daemon 2021-02-24T15:16:04.263 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-02-24T15:16:04.265 INFO:tasks.ceph.osd.1:Started 2021-02-24T15:16:04.266 INFO:tasks.ceph.osd.2:Restarting daemon 2021-02-24T15:16:04.266 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-02-24T15:16:04.269 INFO:tasks.ceph.osd.2:Started 2021-02-24T15:16:04.270 INFO:tasks.ceph.osd.3:Restarting daemon 2021-02-24T15:16:04.271 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-02-24T15:16:04.274 INFO:tasks.ceph.osd.3:Started 2021-02-24T15:16:04.274 INFO:tasks.ceph.osd.4:Restarting daemon 2021-02-24T15:16:04.275 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-02-24T15:16:04.291 INFO:tasks.ceph.osd.4:Started 2021-02-24T15:16:04.291 INFO:tasks.ceph.osd.5:Restarting daemon 2021-02-24T15:16:04.292 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-02-24T15:16:04.294 INFO:tasks.ceph.osd.5:Started 2021-02-24T15:16:04.294 INFO:tasks.ceph:Waiting for OSDs to come up 2021-02-24T15:16:04.864 INFO:tasks.ceph.osd.0.smithi152.stderr:2021-02-24T15:16:04.863+0000 7f7c000c1200 -1 Falling back to public interface 2021-02-24T15:16:04.865 INFO:tasks.ceph.osd.1.smithi152.stderr:2021-02-24T15:16:04.863+0000 7fbbd5a2f200 -1 Falling back to public interface 2021-02-24T15:16:04.870 INFO:tasks.ceph.osd.3.smithi181.stderr:2021-02-24T15:16:04.869+0000 7f68224b1200 -1 Falling back to public interface 2021-02-24T15:16:04.871 INFO:tasks.ceph.osd.3.smithi181.stderr:2021-02-24T15:16:04.869+0000 7f681c440700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6800/0: (98) Address already in use 2021-02-24T15:16:04.871 INFO:tasks.ceph.osd.4.smithi181.stderr:2021-02-24T15:16:04.869+0000 7f1c4e43a200 -1 Falling back to public interface 2021-02-24T15:16:04.877 INFO:tasks.ceph.osd.2.smithi152.stderr:2021-02-24T15:16:04.877+0000 7fe1fbd30200 -1 Falling back to public interface 2021-02-24T15:16:04.889 INFO:tasks.ceph.osd.5.smithi181.stderr:2021-02-24T15:16:04.887+0000 7f19778c2200 -1 Falling back to public interface 2021-02-24T15:16:04.900 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-24T15:16:05.012 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.011+0000 7f431f7e3700 1 Processor -- start 2021-02-24T15:16:05.013 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.012+0000 7f431f7e3700 1 -- start start 2021-02-24T15:16:05.014 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.012+0000 7f431f7e3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4318092e60 con 0x7f4318094e40 2021-02-24T15:16:05.016 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.012+0000 7f431f7e3700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4318091f30 con 0x7f4318091110 2021-02-24T15:16:05.016 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.012+0000 7f431f7e3700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43180921d0 con 0x7f4318095930 2021-02-24T15:16:05.017 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.012+0000 7f431dd80700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f4318095930 0x7f431812f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34166/0 (socket says 172.21.15.152:34166) 2021-02-24T15:16:05.017 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.012+0000 7f431dd80700 1 -- 172.21.15.152:0/2931859126 learned_addr learned my addr 172.21.15.152:0/2931859126 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:05.017 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.012+0000 7f431d57f700 1 --1- 172.21.15.152:0/2931859126 >> v1:172.21.15.152:6789/0 conn(0x7f4318094e40 0x7f4318092750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45690/0 (socket says 172.21.15.152:45690) 2021-02-24T15:16:05.024 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.014+0000 7f431d57f700 1 -- 172.21.15.152:0/2931859126 >> v1:172.21.15.152:6789/0 conn(0x7f4318094e40 legacy=0x7f4318092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:05.024 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.014+0000 7f431dd80700 1 -- 172.21.15.152:0/2931859126 >> v1:172.21.15.152:6790/0 conn(0x7f4318095930 legacy=0x7f431812f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:05.024 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.014+0000 7f431cd7e700 1 -- 172.21.15.152:0/2931859126 >> v1:172.21.15.181:6789/0 conn(0x7f4318091110 legacy=0x7f4318095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:05.025 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.014+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995771310 0 0) 0x7f4318092e60 con 0x7f4318094e40 2021-02-24T15:16:05.025 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4300003230 con 0x7f4318094e40 2021-02-24T15:16:05.025 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972907105 0 0) 0x7f43180921d0 con 0x7f4318095930 2021-02-24T15:16:05.026 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4318092e60 con 0x7f4318095930 2021-02-24T15:16:05.038 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372791640 0 0) 0x7f4318091f30 con 0x7f4318091110 2021-02-24T15:16:05.038 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43180921d0 con 0x7f4318091110 2021-02-24T15:16:05.038 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1369157297 0 0) 0x7f4318092e60 con 0x7f4318095930 2021-02-24T15:16:05.039 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 >> v1:172.21.15.181:6789/0 conn(0x7f4318091110 legacy=0x7f4318095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:05.039 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 >> v1:172.21.15.152:6789/0 conn(0x7f4318094e40 legacy=0x7f4318092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:05.039 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318091590 con 0x7f4318095930 2021-02-24T15:16:05.039 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4310001d70 con 0x7f4318095930 2021-02-24T15:16:05.040 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4310001fd0 con 0x7f4318095930 2021-02-24T15:16:05.040 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f4307fff700 1 -- 172.21.15.152:0/2931859126 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4310004ad0 con 0x7f4318095930 2021-02-24T15:16:05.040 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f431f7e3700 1 -- 172.21.15.152:0/2931859126 >> v1:172.21.15.152:6790/0 conn(0x7f4318095930 legacy=0x7f431812f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:05.041 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f431f7e3700 1 -- 172.21.15.152:0/2931859126 shutdown_connections 2021-02-24T15:16:05.041 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f431f7e3700 1 -- 172.21.15.152:0/2931859126 >> 172.21.15.152:0/2931859126 conn(0x7f43180999a0 msgr2=0x7f4318099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:05.041 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f431f7e3700 1 -- 172.21.15.152:0/2931859126 shutdown_connections 2021-02-24T15:16:05.041 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.015+0000 7f431f7e3700 1 -- 172.21.15.152:0/2931859126 wait complete. 2021-02-24T15:16:05.042 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.016+0000 7f431f7e3700 1 librados: starting msgr at 2021-02-24T15:16:05.042 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.016+0000 7f431f7e3700 1 librados: starting objecter 2021-02-24T15:16:05.042 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.016+0000 7f431f7e3700 1 Processor -- start 2021-02-24T15:16:05.043 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.016+0000 7f431f7e3700 1 -- start start 2021-02-24T15:16:05.043 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.016+0000 7f431f7e3700 1 librados: setting wanted keys 2021-02-24T15:16:05.043 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.016+0000 7f431f7e3700 1 librados: calling monclient init 2021-02-24T15:16:05.044 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.017+0000 7f431f7e3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431812ed20 con 0x7f4318094e40 2021-02-24T15:16:05.044 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.017+0000 7f431f7e3700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431812ef50 con 0x7f4318091110 2021-02-24T15:16:05.044 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.017+0000 7f431f7e3700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431812f1f0 con 0x7f4318095930 2021-02-24T15:16:05.044 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.017+0000 7f431cd7e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4318094e40 0x7f431813f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45698/0 (socket says 172.21.15.152:45698) 2021-02-24T15:16:05.045 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.017+0000 7f431cd7e700 1 -- 172.21.15.152:0/43954428 learned_addr learned my addr 172.21.15.152:0/43954428 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:05.045 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f431cd7e700 1 -- 172.21.15.152:0/43954428 >> v1:172.21.15.152:6789/0 conn(0x7f4318094e40 legacy=0x7f431813f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:05.054 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 10 client.?.objecter ms_handle_connect 0x7f4318094e40 2021-02-24T15:16:05.054 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:05.055 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f431dd80700 1 -- 172.21.15.152:0/43954428 >> v1:172.21.15.152:6790/0 conn(0x7f4318095930 legacy=0x7f43181428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:05.055 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 10 client.?.objecter ms_handle_connect 0x7f4318095930 2021-02-24T15:16:05.055 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:05.055 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 10 client.?.objecter ms_handle_connect 0x7f4318091110 2021-02-24T15:16:05.056 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:05.056 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f431d57f700 1 -- 172.21.15.152:0/43954428 >> v1:172.21.15.181:6789/0 conn(0x7f4318091110 legacy=0x7f4318127750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:05.056 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373294831 0 0) 0x7f431812ed20 con 0x7f4318094e40 2021-02-24T15:16:05.056 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f8004bd0 con 0x7f4318094e40 2021-02-24T15:16:05.056 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083992055 0 0) 0x7f431812ef50 con 0x7f4318091110 2021-02-24T15:16:05.057 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f431812ed20 con 0x7f4318091110 2021-02-24T15:16:05.057 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571687305 0 0) 0x7f431812f1f0 con 0x7f4318095930 2021-02-24T15:16:05.058 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f431812ef50 con 0x7f4318095930 2021-02-24T15:16:05.058 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3981186933 0 0) 0x7f431812ed20 con 0x7f4318091110 2021-02-24T15:16:05.058 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f431812f1f0 con 0x7f4318091110 2021-02-24T15:16:05.058 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.019+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4314001c60 con 0x7f4318091110 2021-02-24T15:16:05.059 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1157764914 0 0) 0x7f42f8004bd0 con 0x7f4318094e40 2021-02-24T15:16:05.059 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f431812ed20 con 0x7f4318094e40 2021-02-24T15:16:05.059 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4308001c60 con 0x7f4318094e40 2021-02-24T15:16:05.059 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3370794210 0 0) 0x7f431812ef50 con 0x7f4318095930 2021-02-24T15:16:05.059 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f42f8004bd0 con 0x7f4318095930 2021-02-24T15:16:05.060 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4310004a10 con 0x7f4318095930 2021-02-24T15:16:05.060 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 809906510 0 0) 0x7f431812f1f0 con 0x7f4318091110 2021-02-24T15:16:05.060 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 >> v1:172.21.15.152:6790/0 conn(0x7f4318095930 legacy=0x7f43181428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:05.060 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 >> v1:172.21.15.152:6789/0 conn(0x7f4318094e40 legacy=0x7f431813f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:05.060 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431812f490 con 0x7f4318091110 2021-02-24T15:16:05.061 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f43140047a0 con 0x7f4318091110 2021-02-24T15:16:05.061 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f431f7e3700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43180932c0 con 0x7f4318091110 2021-02-24T15:16:05.061 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4314004ab0 con 0x7f4318091110 2021-02-24T15:16:05.062 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f431f7e3700 10 client.4156.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:05.062 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f431f7e3700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f43180928f0 con 0x7f4318091110 2021-02-24T15:16:05.062 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f431f7e3700 1 librados: init done 2021-02-24T15:16:05.063 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f4314004ef0 con 0x7f4318091110 2021-02-24T15:16:05.063 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (unknown 583651184 0 0) 0x7f4314005790 con 0x7f4318091110 2021-02-24T15:16:05.063 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 10 client.4156.objecter ms_dispatch 0x7f4318001510 osd_map(8..8 src has 1..8) v4 2021-02-24T15:16:05.063 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 3 client.4156.objecter handle_osd_map got epochs [8,8] > 0 2021-02-24T15:16:05.063 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 3 client.4156.objecter handle_osd_map decoding full epoch 8 2021-02-24T15:16:05.064 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.020+0000 7f43057fa700 20 client.4156.objecter dump_active .. 0 homeless 2021-02-24T15:16:05.064 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.021+0000 7f431f7e3700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f431812b4b0 con 0x7f4318091110 2021-02-24T15:16:05.064 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.023+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (unknown 1092875540 0 742114027) 0x7f4314005290 con 0x7f4318091110 2021-02-24T15:16:05.096 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.095+0000 7f431f7e3700 1 -- 172.21.15.152:0/43954428 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4318058400 con 0x7f4318091110 2021-02-24T15:16:05.096 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.095+0000 7f43057fa700 1 -- 172.21.15.152:0/43954428 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+5547 (unknown 150273500 0 983437441) 0x7f4314005590 con 0x7f4318091110 2021-02-24T15:16:05.097 INFO:teuthology.misc.health.smithi152.stdout: 2021-02-24T15:16:05.098 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":8,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","created":"2021-02-24T15:16:02.232967+0000","modified":"2021-02-24T15:16:04.238122+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"a72c3535-e891-4444-bf97-dc6fae0ad363","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"008b3230-90b6-4bee-8218-c422a983151c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b91de7c8-a67a-45d6-8643-8578d6b60c8e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc030322-1a40-4f32-9ea3-48d755deaca6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3022f9f3-8ca8-403a-863a-41c661302f24","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a6762546-97f4-409d-bebb-411eb5fba3db","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-24T15:16:05.098 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.096+0000 7f431f7e3700 10 librados: watch_flush enter 2021-02-24T15:16:05.098 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.096+0000 7f431f7e3700 10 librados: watch_flush exit 2021-02-24T15:16:05.099 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.096+0000 7f431f7e3700 20 client.4156.objecter shutdown clearing up homeless session... 2021-02-24T15:16:05.099 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.096+0000 7f431f7e3700 10 client.4156.objecter successfully canceled tick 2021-02-24T15:16:05.099 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.096+0000 7f431f7e3700 1 -- 172.21.15.152:0/43954428 >> v1:172.21.15.181:6789/0 conn(0x7f4318091110 legacy=0x7f4318127750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:05.099 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.097+0000 7f431f7e3700 1 -- 172.21.15.152:0/43954428 shutdown_connections 2021-02-24T15:16:05.100 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.097+0000 7f431f7e3700 1 -- 172.21.15.152:0/43954428 >> 172.21.15.152:0/43954428 conn(0x7f43180999a0 msgr2=0x7f431812a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:05.100 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.097+0000 7f431f7e3700 1 -- 172.21.15.152:0/43954428 shutdown_connections 2021-02-24T15:16:05.100 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.097+0000 7f431f7e3700 1 -- 172.21.15.152:0/43954428 wait complete. 2021-02-24T15:16:05.100 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:05.097+0000 7f431f7e3700 1 librados: shutdown 2021-02-24T15:16:05.107 DEBUG:teuthology.misc:0 of 6 OSDs are up 2021-02-24T15:16:08.317 INFO:tasks.ceph.osd.1.smithi152.stderr:2021-02-24T15:16:08.316+0000 7fbbd5a2f200 -1 osd.1 0 log_to_monitors {default=true} 2021-02-24T15:16:08.318 INFO:tasks.ceph.osd.3.smithi181.stderr:2021-02-24T15:16:08.317+0000 7f68224b1200 -1 osd.3 0 log_to_monitors {default=true} 2021-02-24T15:16:08.331 INFO:tasks.ceph.osd.0.smithi152.stderr:2021-02-24T15:16:08.328+0000 7f7c000c1200 -1 osd.0 0 log_to_monitors {default=true} 2021-02-24T15:16:08.345 INFO:tasks.ceph.osd.4.smithi181.stderr:2021-02-24T15:16:08.343+0000 7f1c4e43a200 -1 osd.4 0 log_to_monitors {default=true} 2021-02-24T15:16:08.358 INFO:tasks.ceph.osd.2.smithi152.stderr:2021-02-24T15:16:08.357+0000 7fe1fbd30200 -1 osd.2 0 log_to_monitors {default=true} 2021-02-24T15:16:08.360 INFO:tasks.ceph.osd.5.smithi181.stderr:2021-02-24T15:16:08.359+0000 7f19778c2200 -1 osd.5 0 log_to_monitors {default=true} 2021-02-24T15:16:10.113 INFO:tasks.ceph.osd.3.smithi181.stderr:2021-02-24T15:16:10.111+0000 7f6818c39700 -1 osd.3 0 waiting for initial osdmap 2021-02-24T15:16:10.118 INFO:tasks.ceph.osd.5.smithi181.stderr:2021-02-24T15:16:10.115+0000 7f196e04a700 -1 osd.5 0 waiting for initial osdmap 2021-02-24T15:16:10.118 INFO:tasks.ceph.osd.4.smithi181.stderr:2021-02-24T15:16:10.115+0000 7f1c44bc2700 -1 osd.4 0 waiting for initial osdmap 2021-02-24T15:16:10.119 INFO:tasks.ceph.osd.2.smithi152.stderr:2021-02-24T15:16:10.115+0000 7fe1f24b8700 -1 osd.2 0 waiting for initial osdmap 2021-02-24T15:16:10.119 INFO:tasks.ceph.osd.0.smithi152.stderr:2021-02-24T15:16:10.115+0000 7f7bf6849700 -1 osd.0 0 waiting for initial osdmap 2021-02-24T15:16:10.119 INFO:tasks.ceph.osd.1.smithi152.stderr:2021-02-24T15:16:10.115+0000 7fbbcd9ba700 -1 osd.1 0 waiting for initial osdmap 2021-02-24T15:16:11.713 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-24T15:16:11.834 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.832+0000 7fae6827a700 1 Processor -- start 2021-02-24T15:16:11.835 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.832+0000 7fae6827a700 1 -- start start 2021-02-24T15:16:11.835 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.833+0000 7fae6827a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae60062660 con 0x7fae600966a0 2021-02-24T15:16:11.835 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.833+0000 7fae6827a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae60063af0 con 0x7fae60095bb0 2021-02-24T15:16:11.835 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.833+0000 7fae6827a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae60063d90 con 0x7fae60068410 2021-02-24T15:16:11.836 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.833+0000 7fae66817700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fae60068410 0x7fae60133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34314/0 (socket says 172.21.15.152:34314) 2021-02-24T15:16:11.836 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.833+0000 7fae66817700 1 -- 172.21.15.152:0/1380603725 learned_addr learned my addr 172.21.15.152:0/1380603725 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:11.836 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.833+0000 7fae66016700 1 --1- 172.21.15.152:0/1380603725 >> v1:172.21.15.152:6789/0 conn(0x7fae600966a0 0x7fae60096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45834/0 (socket says 172.21.15.152:45834) 2021-02-24T15:16:11.846 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.835+0000 7fae66016700 1 -- 172.21.15.152:0/1380603725 >> v1:172.21.15.152:6789/0 conn(0x7fae600966a0 legacy=0x7fae60096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:11.847 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae66817700 1 -- 172.21.15.152:0/1380603725 >> v1:172.21.15.152:6790/0 conn(0x7fae60068410 legacy=0x7fae60133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:11.847 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65815700 1 -- 172.21.15.152:0/1380603725 >> v1:172.21.15.181:6789/0 conn(0x7fae60095bb0 legacy=0x7fae60130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:11.847 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251112231 0 0) 0x7fae60063d90 con 0x7fae60068410 2021-02-24T15:16:11.847 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae48003230 con 0x7fae60068410 2021-02-24T15:16:11.848 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373262757 0 0) 0x7fae60062660 con 0x7fae600966a0 2021-02-24T15:16:11.848 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae60063d90 con 0x7fae600966a0 2021-02-24T15:16:11.848 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711030554 0 0) 0x7fae60063af0 con 0x7fae60095bb0 2021-02-24T15:16:11.848 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae60062660 con 0x7fae60095bb0 2021-02-24T15:16:11.848 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 388996376 0 0) 0x7fae48003230 con 0x7fae60068410 2021-02-24T15:16:11.849 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 >> v1:172.21.15.181:6789/0 conn(0x7fae60095bb0 legacy=0x7fae60130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:11.849 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 >> v1:172.21.15.152:6789/0 conn(0x7fae600966a0 legacy=0x7fae60096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:11.849 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60064030 con 0x7fae60068410 2021-02-24T15:16:11.850 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fae58001d70 con 0x7fae60068410 2021-02-24T15:16:11.852 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fae58002090 con 0x7fae60068410 2021-02-24T15:16:11.853 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.836+0000 7fae65014700 1 -- 172.21.15.152:0/1380603725 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fae58004ad0 con 0x7fae60068410 2021-02-24T15:16:11.853 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.837+0000 7fae6827a700 1 -- 172.21.15.152:0/1380603725 >> v1:172.21.15.152:6790/0 conn(0x7fae60068410 legacy=0x7fae60133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:11.855 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.837+0000 7fae6827a700 1 -- 172.21.15.152:0/1380603725 shutdown_connections 2021-02-24T15:16:11.855 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.837+0000 7fae6827a700 1 -- 172.21.15.152:0/1380603725 >> 172.21.15.152:0/1380603725 conn(0x7fae6009ba40 msgr2=0x7fae6009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:11.855 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.837+0000 7fae6827a700 1 -- 172.21.15.152:0/1380603725 shutdown_connections 2021-02-24T15:16:11.855 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.837+0000 7fae6827a700 1 -- 172.21.15.152:0/1380603725 wait complete. 2021-02-24T15:16:11.856 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.837+0000 7fae6827a700 1 librados: starting msgr at 2021-02-24T15:16:11.856 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.837+0000 7fae6827a700 1 librados: starting objecter 2021-02-24T15:16:11.856 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae6827a700 1 Processor -- start 2021-02-24T15:16:11.856 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae6827a700 1 -- start start 2021-02-24T15:16:11.857 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae6827a700 1 librados: setting wanted keys 2021-02-24T15:16:11.857 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae6827a700 1 librados: calling monclient init 2021-02-24T15:16:11.857 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae6827a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae60063010 con 0x7fae60095bb0 2021-02-24T15:16:11.857 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae6827a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae600676b0 con 0x7fae600966a0 2021-02-24T15:16:11.857 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae6827a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6013aac0 con 0x7fae60068410 2021-02-24T15:16:11.858 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae66016700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fae60068410 0x7fae60133ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34316/0 (socket says 172.21.15.152:34316) 2021-02-24T15:16:11.858 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae66016700 1 -- 172.21.15.152:0/253850215 learned_addr learned my addr 172.21.15.152:0/253850215 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:11.858 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.838+0000 7fae65815700 1 --1- 172.21.15.152:0/253850215 >> v1:172.21.15.152:6789/0 conn(0x7fae60095bb0 0x7fae6013a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45842/0 (socket says 172.21.15.152:45842) 2021-02-24T15:16:11.858 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae66016700 1 -- 172.21.15.152:0/253850215 >> v1:172.21.15.152:6790/0 conn(0x7fae60068410 legacy=0x7fae60133ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:11.859 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae65815700 1 -- 172.21.15.152:0/253850215 >> v1:172.21.15.152:6789/0 conn(0x7fae60095bb0 legacy=0x7fae6013a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:11.859 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 10 client.?.objecter ms_handle_connect 0x7fae60068410 2021-02-24T15:16:11.859 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:11.859 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 10 client.?.objecter ms_handle_connect 0x7fae60095bb0 2021-02-24T15:16:11.860 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:11.860 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291209372 0 0) 0x7fae6013aac0 con 0x7fae60068410 2021-02-24T15:16:11.860 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae40004bd0 con 0x7fae60068410 2021-02-24T15:16:11.872 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037027457 0 0) 0x7fae60063010 con 0x7fae60095bb0 2021-02-24T15:16:11.874 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae66817700 1 -- 172.21.15.152:0/253850215 >> v1:172.21.15.181:6789/0 conn(0x7fae600966a0 legacy=0x7fae60142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:11.874 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6013aac0 con 0x7fae60095bb0 2021-02-24T15:16:11.874 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 10 client.?.objecter ms_handle_connect 0x7fae600966a0 2021-02-24T15:16:11.875 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.840+0000 7fae4e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:11.875 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1113029000 0 0) 0x7fae40004bd0 con 0x7fae60068410 2021-02-24T15:16:11.875 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae60063010 con 0x7fae60068410 2021-02-24T15:16:11.875 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fae5c001b70 con 0x7fae60068410 2021-02-24T15:16:11.876 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2996472939 0 0) 0x7fae6013aac0 con 0x7fae60095bb0 2021-02-24T15:16:11.876 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae40004bd0 con 0x7fae60095bb0 2021-02-24T15:16:11.876 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fae50001c20 con 0x7fae60095bb0 2021-02-24T15:16:11.876 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930083554 0 0) 0x7fae600676b0 con 0x7fae600966a0 2021-02-24T15:16:11.877 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6013aac0 con 0x7fae600966a0 2021-02-24T15:16:11.877 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 642146333 0 0) 0x7fae60063010 con 0x7fae60068410 2021-02-24T15:16:11.877 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 >> v1:172.21.15.181:6789/0 conn(0x7fae600966a0 legacy=0x7fae60142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:11.877 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 >> v1:172.21.15.152:6789/0 conn(0x7fae60095bb0 legacy=0x7fae6013a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:11.877 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60119020 con 0x7fae60068410 2021-02-24T15:16:11.878 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6011b8d0 con 0x7fae60068410 2021-02-24T15:16:11.878 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae6827a700 10 client.4193.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:11.878 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6011a400 con 0x7fae60068410 2021-02-24T15:16:11.878 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae6827a700 1 librados: init done 2021-02-24T15:16:11.878 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fae5c0048a0 con 0x7fae60068410 2021-02-24T15:16:11.879 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.841+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fae5c004bb0 con 0x7fae60068410 2021-02-24T15:16:11.879 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.842+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fae5c004d90 con 0x7fae60068410 2021-02-24T15:16:11.879 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.842+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2796+0+0 (unknown 1315198385 0 0) 0x7fae5c03a720 con 0x7fae60068410 2021-02-24T15:16:11.879 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.842+0000 7fae4e7fc700 10 client.4193.objecter ms_dispatch 0x7fae60001510 osd_map(11..11 src has 1..11) v4 2021-02-24T15:16:11.882 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.842+0000 7fae4e7fc700 3 client.4193.objecter handle_osd_map got epochs [11,11] > 0 2021-02-24T15:16:11.883 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.842+0000 7fae4e7fc700 3 client.4193.objecter handle_osd_map decoding full epoch 11 2021-02-24T15:16:11.885 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.842+0000 7fae4e7fc700 20 client.4193.objecter dump_active .. 0 homeless 2021-02-24T15:16:11.885 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.842+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae44004d60 con 0x7fae60068410 2021-02-24T15:16:11.885 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.844+0000 7fae4e7fc700 10 client.4193.objecter ms_handle_connect 0x7fae40031750 2021-02-24T15:16:11.886 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:11.846+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fae5c006360 con 0x7fae60068410 2021-02-24T15:16:12.021 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.019+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae44005010 con 0x7fae60068410 2021-02-24T15:16:12.022 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.020+0000 7fae4e7fc700 1 -- 172.21.15.152:0/253850215 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+6806 (unknown 238102980 0 1975641178) 0x7fae5c0125c0 con 0x7fae60068410 2021-02-24T15:16:12.022 INFO:teuthology.misc.health.smithi152.stdout: 2021-02-24T15:16:12.022 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":11,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","created":"2021-02-24T15:16:02.232967+0000","modified":"2021-02-24T15:16:11.121140+0000","last_up_change":"2021-02-24T15:16:11.121140+0000","last_in_change":"2021-02-24T15:16:11.121140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"a72c3535-e891-4444-bf97-dc6fae0ad363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6801","nonce":33735}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6803","nonce":33735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6807","nonce":33735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6805","nonce":33735}]},"public_addr":"172.21.15.152:6801/33735","cluster_addr":"172.21.15.152:6803/33735","heartbeat_back_addr":"172.21.15.152:6807/33735","heartbeat_front_addr":"172.21.15.152:6805/33735","state":["exists","up"]},{"osd":1,"uuid":"008b3230-90b6-4bee-8218-c422a983151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6800","nonce":33736}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6802","nonce":33736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6806","nonce":33736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6804","nonce":33736}]},"public_addr":"172.21.15.152:6800/33736","cluster_addr":"172.21.15.152:6802/33736","heartbeat_back_addr":"172.21.15.152:6806/33736","heartbeat_front_addr":"172.21.15.152:6804/33736","state":["exists","up"]},{"osd":2,"uuid":"b91de7c8-a67a-45d6-8643-8578d6b60c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6808","nonce":33737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6809","nonce":33737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6811","nonce":33737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6810","nonce":33737}]},"public_addr":"172.21.15.152:6808/33737","cluster_addr":"172.21.15.152:6809/33737","heartbeat_back_addr":"172.21.15.152:6811/33737","heartbeat_front_addr":"172.21.15.152:6810/33737","state":["exists","up"]},{"osd":3,"uuid":"cc030322-1a40-4f32-9ea3-48d755deaca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":33937}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":33937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":33937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":33937}]},"public_addr":"172.21.15.181:6801/33937","cluster_addr":"172.21.15.181:6803/33937","heartbeat_back_addr":"172.21.15.181:6807/33937","heartbeat_front_addr":"172.21.15.181:6805/33937","state":["exists","up"]},{"osd":4,"uuid":"3022f9f3-8ca8-403a-863a-41c661302f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":33938}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":33938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":33938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":33938}]},"public_addr":"172.21.15.181:6800/33938","cluster_addr":"172.21.15.181:6802/33938","heartbeat_back_addr":"172.21.15.181:6806/33938","heartbeat_front_addr":"172.21.15.181:6804/33938","state":["exists","up"]},{"osd":5,"uuid":"a6762546-97f4-409d-bebb-411eb5fba3db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":33963}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":33963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":33963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":33963}]},"public_addr":"172.21.15.181:6808/33963","cluster_addr":"172.21.15.181:6809/33963","heartbeat_back_addr":"172.21.15.181:6811/33963","heartbeat_front_addr":"172.21.15.181:6810/33963","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-24T15:16:12.023 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 10 librados: watch_flush enter 2021-02-24T15:16:12.024 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 10 librados: watch_flush exit 2021-02-24T15:16:12.024 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 20 client.4193.objecter shutdown clearing up homeless session... 2021-02-24T15:16:12.024 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 10 client.4193.objecter successfully canceled tick 2021-02-24T15:16:12.024 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 >> v1:172.21.15.181:6812/33484 conn(0x7fae40031750 legacy=0x7fae40033c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:12.024 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 >> v1:172.21.15.152:6790/0 conn(0x7fae60068410 legacy=0x7fae60133ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:12.025 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 shutdown_connections 2021-02-24T15:16:12.025 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 >> 172.21.15.152:0/253850215 conn(0x7fae6009ba40 msgr2=0x7fae6009a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:12.025 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 shutdown_connections 2021-02-24T15:16:12.025 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 1 -- 172.21.15.152:0/253850215 wait complete. 2021-02-24T15:16:12.026 INFO:teuthology.misc.health.smithi152.stderr:2021-02-24T15:16:12.021+0000 7fae6827a700 1 librados: shutdown 2021-02-24T15:16:12.032 DEBUG:teuthology.misc:6 of 6 OSDs are up 2021-02-24T15:16:12.033 INFO:tasks.ceph:Creating RBD pool 2021-02-24T15:16:12.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd pool create rbd 8 2021-02-24T15:16:12.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.153+0000 7ff5d5ef8700 1 Processor -- start 2021-02-24T15:16:12.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.153+0000 7ff5d5ef8700 1 -- start start 2021-02-24T15:16:12.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.153+0000 7ff5d5ef8700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d009a430 con 0x7ff5d012b3a0 2021-02-24T15:16:12.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.153+0000 7ff5d5ef8700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00636f0 con 0x7ff5d012a960 2021-02-24T15:16:12.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.153+0000 7ff5d5ef8700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00951c0 con 0x7ff5d01313d0 2021-02-24T15:16:12.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.153+0000 7ff5ceffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff5d012b3a0 0x7ff5d012fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45856/0 (socket says 172.21.15.152:45856) 2021-02-24T15:16:12.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.153+0000 7ff5ceffd700 1 -- 172.21.15.152:0/2157646642 learned_addr learned my addr 172.21.15.152:0/2157646642 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:12.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.153+0000 7ff5cffff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff5d01313d0 0x7ff5d01337c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34332/0 (socket says 172.21.15.152:34332) 2021-02-24T15:16:12.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.155+0000 7ff5cffff700 1 -- 172.21.15.152:0/2157646642 >> v1:172.21.15.152:6790/0 conn(0x7ff5d01313d0 legacy=0x7ff5d01337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:12.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.155+0000 7ff5ceffd700 1 -- 172.21.15.152:0/2157646642 >> v1:172.21.15.152:6789/0 conn(0x7ff5d012b3a0 legacy=0x7ff5d012fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:12.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041014009 0 0) 0x7ff5d009a430 con 0x7ff5d012b3a0 2021-02-24T15:16:12.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5bc003230 con 0x7ff5d012b3a0 2021-02-24T15:16:12.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598948571 0 0) 0x7ff5d00951c0 con 0x7ff5d01313d0 2021-02-24T15:16:12.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5cf7fe700 1 -- 172.21.15.152:0/2157646642 >> v1:172.21.15.181:6789/0 conn(0x7ff5d012a960 legacy=0x7ff5d0097920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:12.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d009a430 con 0x7ff5d01313d0 2021-02-24T15:16:12.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839016693 0 0) 0x7ff5d00636f0 con 0x7ff5d012a960 2021-02-24T15:16:12.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d00951c0 con 0x7ff5d012a960 2021-02-24T15:16:12.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4022945239 0 0) 0x7ff5d009a430 con 0x7ff5d01313d0 2021-02-24T15:16:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 >> v1:172.21.15.181:6789/0 conn(0x7ff5d012a960 legacy=0x7ff5d0097920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 >> v1:172.21.15.152:6789/0 conn(0x7ff5d012b3a0 legacy=0x7ff5d012fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0095460 con 0x7ff5d01313d0 2021-02-24T15:16:12.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff5c8001cf0 con 0x7ff5d01313d0 2021-02-24T15:16:12.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff5c8001f10 con 0x7ff5d01313d0 2021-02-24T15:16:12.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5ce7fc700 1 -- 172.21.15.152:0/2157646642 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff5c8004870 con 0x7ff5d01313d0 2021-02-24T15:16:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/2157646642 >> v1:172.21.15.152:6790/0 conn(0x7ff5d01313d0 legacy=0x7ff5d01337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.156+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/2157646642 shutdown_connections 2021-02-24T15:16:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.157+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/2157646642 >> 172.21.15.152:0/2157646642 conn(0x7ff5d006a630 msgr2=0x7ff5d009dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.157+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/2157646642 shutdown_connections 2021-02-24T15:16:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.157+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/2157646642 wait complete. 2021-02-24T15:16:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.157+0000 7ff5d5ef8700 1 librados: starting msgr at 2021-02-24T15:16:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.157+0000 7ff5d5ef8700 1 librados: starting objecter 2021-02-24T15:16:12.169 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5d5ef8700 1 Processor -- start 2021-02-24T15:16:12.170 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5d5ef8700 1 -- start start 2021-02-24T15:16:12.170 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5d5ef8700 1 librados: setting wanted keys 2021-02-24T15:16:12.170 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5d5ef8700 1 librados: calling monclient init 2021-02-24T15:16:12.171 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5d5ef8700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d0064eb0 con 0x7ff5d012b3a0 2021-02-24T15:16:12.171 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5d5ef8700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00663c0 con 0x7ff5d01313d0 2021-02-24T15:16:12.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5d5ef8700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d0066660 con 0x7ff5d012a960 2021-02-24T15:16:12.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5ceffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff5d012b3a0 0x7ff5d00938d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45860/0 (socket says 172.21.15.152:45860) 2021-02-24T15:16:12.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5cf7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff5d012a960 0x7ff5d00931c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34334/0 (socket says 172.21.15.152:34334) 2021-02-24T15:16:12.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.158+0000 7ff5ceffd700 1 -- 172.21.15.152:0/1144537926 learned_addr learned my addr 172.21.15.152:0/1144537926 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:12.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5ceffd700 1 -- 172.21.15.152:0/1144537926 >> v1:172.21.15.152:6789/0 conn(0x7ff5d012b3a0 legacy=0x7ff5d00938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:12.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5cf7fe700 1 -- 172.21.15.152:0/1144537926 >> v1:172.21.15.152:6790/0 conn(0x7ff5d012a960 legacy=0x7ff5d00931c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:12.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 10 client.?.objecter ms_handle_connect 0x7ff5d012b3a0 2021-02-24T15:16:12.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:12.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 10 client.?.objecter ms_handle_connect 0x7ff5d012a960 2021-02-24T15:16:12.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:12.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540163242 0 0) 0x7ff5d0064eb0 con 0x7ff5d012b3a0 2021-02-24T15:16:12.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b0004bd0 con 0x7ff5d012b3a0 2021-02-24T15:16:12.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993983949 0 0) 0x7ff5d0066660 con 0x7ff5d012a960 2021-02-24T15:16:12.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d0064eb0 con 0x7ff5d012a960 2021-02-24T15:16:12.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 10 client.?.objecter ms_handle_connect 0x7ff5d01313d0 2021-02-24T15:16:12.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5b77fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:12.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.160+0000 7ff5cffff700 1 -- 172.21.15.152:0/1144537926 >> v1:172.21.15.181:6789/0 conn(0x7ff5d01313d0 legacy=0x7ff5d01468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:12.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 152716240 0 0) 0x7ff5b0004bd0 con 0x7ff5d012b3a0 2021-02-24T15:16:12.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff5d0066660 con 0x7ff5d012b3a0 2021-02-24T15:16:12.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff5c4001d60 con 0x7ff5d012b3a0 2021-02-24T15:16:12.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 892224339 0 0) 0x7ff5d0064eb0 con 0x7ff5d012a960 2021-02-24T15:16:12.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff5b0004bd0 con 0x7ff5d012a960 2021-02-24T15:16:12.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff5c0001ba0 con 0x7ff5d012a960 2021-02-24T15:16:12.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059745606 0 0) 0x7ff5d00663c0 con 0x7ff5d01313d0 2021-02-24T15:16:12.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d0064eb0 con 0x7ff5d01313d0 2021-02-24T15:16:12.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2381465512 0 0) 0x7ff5d0066660 con 0x7ff5d012b3a0 2021-02-24T15:16:12.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 >> v1:172.21.15.152:6790/0 conn(0x7ff5d012a960 legacy=0x7ff5d00931c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:12.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 >> v1:172.21.15.181:6789/0 conn(0x7ff5d01313d0 legacy=0x7ff5d01468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:12.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0066900 con 0x7ff5d012b3a0 2021-02-24T15:16:12.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d00647b0 con 0x7ff5d012b3a0 2021-02-24T15:16:12.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5d5ef8700 10 client.4203.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:12.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d0065de0 con 0x7ff5d012b3a0 2021-02-24T15:16:12.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5d5ef8700 1 librados: init done 2021-02-24T15:16:12.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff5c40049d0 con 0x7ff5d012b3a0 2021-02-24T15:16:12.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.161+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff5c4004ce0 con 0x7ff5d012b3a0 2021-02-24T15:16:12.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.162+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff5c4004e40 con 0x7ff5d012b3a0 2021-02-24T15:16:12.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.162+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(12..12 src has 1..12) v4 ==== 3172+0+0 (unknown 2180053888 0 0) 0x7ff5c403a820 con 0x7ff5d012b3a0 2021-02-24T15:16:12.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.162+0000 7ff5b77fe700 10 client.4203.objecter ms_dispatch 0x7ff5d0001510 osd_map(12..12 src has 1..12) v4 2021-02-24T15:16:12.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.162+0000 7ff5b77fe700 3 client.4203.objecter handle_osd_map got epochs [12,12] > 0 2021-02-24T15:16:12.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.162+0000 7ff5b77fe700 3 client.4203.objecter handle_osd_map decoding full epoch 12 2021-02-24T15:16:12.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.162+0000 7ff5b77fe700 20 client.4203.objecter dump_active .. 0 homeless 2021-02-24T15:16:12.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.162+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a8004d60 con 0x7ff5d012b3a0 2021-02-24T15:16:12.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.164+0000 7ff5b77fe700 10 client.4203.objecter ms_handle_connect 0x7ff5b0031870 2021-02-24T15:16:12.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.166+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7ff5c4012780 con 0x7ff5d012b3a0 2021-02-24T15:16:12.336 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:12.335+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7ff5a8005590 con 0x7ff5d012b3a0 2021-02-24T15:16:13.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.133+0000 7ff5b77fe700 1 -- 172.21.15.152:0/1144537926 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (unknown 2984082091 0 0) 0x7ff5c4012370 con 0x7ff5d012b3a0 2021-02-24T15:16:13.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 10 librados: watch_flush enter 2021-02-24T15:16:13.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 10 librados: watch_flush exit 2021-02-24T15:16:13.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 20 client.4203.objecter shutdown clearing up homeless session... 2021-02-24T15:16:13.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 10 client.4203.objecter successfully canceled tick 2021-02-24T15:16:13.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 >> v1:172.21.15.181:6812/33484 conn(0x7ff5b0031870 legacy=0x7ff5b0033d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:13.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 >> v1:172.21.15.152:6789/0 conn(0x7ff5d012b3a0 legacy=0x7ff5d00938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:13.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 shutdown_connections 2021-02-24T15:16:13.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 >> 172.21.15.152:0/1144537926 conn(0x7ff5d006a630 msgr2=0x7ff5d0097910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:13.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 shutdown_connections 2021-02-24T15:16:13.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 1 -- 172.21.15.152:0/1144537926 wait complete. 2021-02-24T15:16:13.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.137+0000 7ff5d5ef8700 1 librados: shutdown 2021-02-24T15:16:13.142 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'rbd' created 2021-02-24T15:16:13.152 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-02-24T15:16:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.277+0000 7f6e2fe8d700 1 Processor -- start 2021-02-24T15:16:13.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.277+0000 7f6e2fe8d700 1 -- start start 2021-02-24T15:16:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.278+0000 7f6e2fe8d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2809a430 con 0x7f6e2812a960 2021-02-24T15:16:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.278+0000 7f6e2fe8d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e280636f0 con 0x7f6e2812b3a0 2021-02-24T15:16:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.278+0000 7f6e2fe8d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e280951c0 con 0x7f6e281313d0 2021-02-24T15:16:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.278+0000 7f6e2dc29700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6e2812a960 0x7f6e28097920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45872/0 (socket says 172.21.15.152:45872) 2021-02-24T15:16:13.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.278+0000 7f6e2dc29700 1 -- 172.21.15.152:0/2703016327 learned_addr learned my addr 172.21.15.152:0/2703016327 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:13.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.278+0000 7f6e2e42a700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f6e281313d0 0x7f6e281337c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34348/0 (socket says 172.21.15.152:34348) 2021-02-24T15:16:13.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.280+0000 7f6e2dc29700 1 -- 172.21.15.152:0/2703016327 >> v1:172.21.15.152:6789/0 conn(0x7f6e2812a960 legacy=0x7f6e28097920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:13.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.280+0000 7f6e2e42a700 1 -- 172.21.15.152:0/2703016327 >> v1:172.21.15.152:6790/0 conn(0x7f6e281313d0 legacy=0x7f6e281337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:13.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.280+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644562830 0 0) 0x7f6e2809a430 con 0x7f6e2812a960 2021-02-24T15:16:13.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.280+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e10003230 con 0x7f6e2812a960 2021-02-24T15:16:13.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.280+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652945745 0 0) 0x7f6e280951c0 con 0x7f6e281313d0 2021-02-24T15:16:13.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.280+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e2809a430 con 0x7f6e281313d0 2021-02-24T15:16:13.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.280+0000 7f6e2d428700 1 -- 172.21.15.152:0/2703016327 >> v1:172.21.15.181:6789/0 conn(0x7f6e2812b3a0 legacy=0x7f6e2812fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 692710456 0 0) 0x7f6e10003230 con 0x7f6e2812a960 2021-02-24T15:16:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 >> v1:172.21.15.152:6790/0 conn(0x7f6e281313d0 legacy=0x7f6e281337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 >> v1:172.21.15.181:6789/0 conn(0x7f6e2812b3a0 legacy=0x7f6e2812fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e28095460 con 0x7f6e2812a960 2021-02-24T15:16:13.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6e18001930 con 0x7f6e2812a960 2021-02-24T15:16:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2dc29700 1 --1- 172.21.15.152:0/2703016327 >> v1:172.21.15.152:6789/0 conn(0x7f6e2812a960 0x7f6e28097920 :-1 s=OPENED pgs=67 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f6e18004750 mon_map magic: 0 v1 2021-02-24T15:16:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6e18001c40 con 0x7f6e2812a960 2021-02-24T15:16:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/2703016327 >> v1:172.21.15.152:6789/0 conn(0x7f6e2812a960 legacy=0x7f6e28097920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2cc27700 1 -- 172.21.15.152:0/2703016327 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6e18004750 con 0x7f6e2812a960 2021-02-24T15:16:13.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/2703016327 shutdown_connections 2021-02-24T15:16:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/2703016327 >> 172.21.15.152:0/2703016327 conn(0x7f6e2806a630 msgr2=0x7f6e2809dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/2703016327 shutdown_connections 2021-02-24T15:16:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.281+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/2703016327 wait complete. 2021-02-24T15:16:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.282+0000 7f6e2fe8d700 1 librados: starting msgr at 2021-02-24T15:16:13.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.282+0000 7f6e2fe8d700 1 librados: starting objecter 2021-02-24T15:16:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.282+0000 7f6e2fe8d700 1 Processor -- start 2021-02-24T15:16:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.282+0000 7f6e2fe8d700 1 -- start start 2021-02-24T15:16:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.282+0000 7f6e2fe8d700 1 librados: setting wanted keys 2021-02-24T15:16:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.282+0000 7f6e2fe8d700 1 librados: calling monclient init 2021-02-24T15:16:13.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.283+0000 7f6e2fe8d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e28130530 con 0x7f6e2812b3a0 2021-02-24T15:16:13.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.283+0000 7f6e2fe8d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e28091e30 con 0x7f6e2812a960 2021-02-24T15:16:13.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.283+0000 7f6e2fe8d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e28099810 con 0x7f6e281313d0 2021-02-24T15:16:13.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.283+0000 7f6e2d428700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6e2812b3a0 0x7f6e2813f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45878/0 (socket says 172.21.15.152:45878) 2021-02-24T15:16:13.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.283+0000 7f6e2d428700 1 -- 172.21.15.152:0/798934863 learned_addr learned my addr 172.21.15.152:0/798934863 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:13.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e2e42a700 1 -- 172.21.15.152:0/798934863 >> v1:172.21.15.152:6790/0 conn(0x7f6e281313d0 legacy=0x7f6e281428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:13.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e2d428700 1 -- 172.21.15.152:0/798934863 >> v1:172.21.15.152:6789/0 conn(0x7f6e2812b3a0 legacy=0x7f6e2813f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:13.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 10 client.?.objecter ms_handle_connect 0x7f6e281313d0 2021-02-24T15:16:13.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:13.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 10 client.?.objecter ms_handle_connect 0x7f6e2812b3a0 2021-02-24T15:16:13.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:13.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 10 client.?.objecter ms_handle_connect 0x7f6e2812a960 2021-02-24T15:16:13.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:13.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e2dc29700 1 -- 172.21.15.152:0/798934863 >> v1:172.21.15.181:6789/0 conn(0x7f6e2812a960 legacy=0x7f6e280942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:13.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867526944 0 0) 0x7f6e28099810 con 0x7f6e281313d0 2021-02-24T15:16:13.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e08004bd0 con 0x7f6e281313d0 2021-02-24T15:16:13.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182631710 0 0) 0x7f6e28130530 con 0x7f6e2812b3a0 2021-02-24T15:16:13.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e28099810 con 0x7f6e2812b3a0 2021-02-24T15:16:13.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059561860 0 0) 0x7f6e28091e30 con 0x7f6e2812a960 2021-02-24T15:16:13.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e28130530 con 0x7f6e2812a960 2021-02-24T15:16:13.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2004304596 0 0) 0x7f6e28099810 con 0x7f6e2812b3a0 2021-02-24T15:16:13.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6e28091e30 con 0x7f6e2812b3a0 2021-02-24T15:16:13.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6e24001cc0 con 0x7f6e2812b3a0 2021-02-24T15:16:13.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3185873649 0 0) 0x7f6e08004bd0 con 0x7f6e281313d0 2021-02-24T15:16:13.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6e28099810 con 0x7f6e281313d0 2021-02-24T15:16:13.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6e20001f10 con 0x7f6e281313d0 2021-02-24T15:16:13.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 290343793 0 0) 0x7f6e28130530 con 0x7f6e2812a960 2021-02-24T15:16:13.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6e08004bd0 con 0x7f6e2812a960 2021-02-24T15:16:13.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.285+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6e18004690 con 0x7f6e2812a960 2021-02-24T15:16:13.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 899296669 0 0) 0x7f6e28091e30 con 0x7f6e2812b3a0 2021-02-24T15:16:13.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 >> v1:172.21.15.152:6790/0 conn(0x7f6e281313d0 legacy=0x7f6e281428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:13.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 >> v1:172.21.15.181:6789/0 conn(0x7f6e2812a960 legacy=0x7f6e280942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:13.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e28130eb0 con 0x7f6e2812b3a0 2021-02-24T15:16:13.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e28094a00 con 0x7f6e2812b3a0 2021-02-24T15:16:13.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6e24002400 con 0x7f6e2812b3a0 2021-02-24T15:16:13.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6e24002710 con 0x7f6e2812b3a0 2021-02-24T15:16:13.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e2fe8d700 10 client.4209.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:13.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e280909d0 con 0x7f6e2812b3a0 2021-02-24T15:16:13.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e2fe8d700 1 librados: init done 2021-02-24T15:16:13.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.286+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f6e24002920 con 0x7f6e2812b3a0 2021-02-24T15:16:13.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.287+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(13..13 src has 1..13) v4 ==== 3538+0+0 (unknown 2616112972 0 0) 0x7f6e2403a9d0 con 0x7f6e2812b3a0 2021-02-24T15:16:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.287+0000 7f6e15ffb700 10 client.4209.objecter ms_dispatch 0x7f6e28001510 osd_map(13..13 src has 1..13) v4 2021-02-24T15:16:13.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.287+0000 7f6e15ffb700 3 client.4209.objecter handle_osd_map got epochs [13,13] > 0 2021-02-24T15:16:13.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.287+0000 7f6e15ffb700 3 client.4209.objecter handle_osd_map decoding full epoch 13 2021-02-24T15:16:13.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.287+0000 7f6e15ffb700 20 client.4209.objecter dump_active .. 0 homeless 2021-02-24T15:16:13.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.287+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e28099490 con 0x7f6e2812b3a0 2021-02-24T15:16:13.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.289+0000 7f6e15ffb700 10 client.4209.objecter ms_handle_connect 0x7f6e08031730 2021-02-24T15:16:13.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.291+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f6e24012820 con 0x7f6e2812b3a0 2021-02-24T15:16:13.462 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:13.461+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6e28058400 con 0x7f6e2812b3a0 2021-02-24T15:16:14.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.135+0000 7f6e15ffb700 1 -- 172.21.15.152:0/798934863 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (unknown 3289125425 0 0) 0x7f6e24012410 con 0x7f6e2812b3a0 2021-02-24T15:16:14.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.139+0000 7f6e2fe8d700 10 librados: watch_flush enter 2021-02-24T15:16:14.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.139+0000 7f6e2fe8d700 10 librados: watch_flush exit 2021-02-24T15:16:14.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.139+0000 7f6e2fe8d700 20 client.4209.objecter shutdown clearing up homeless session... 2021-02-24T15:16:14.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.139+0000 7f6e2fe8d700 10 client.4209.objecter successfully canceled tick 2021-02-24T15:16:14.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.139+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 >> v1:172.21.15.181:6812/33484 conn(0x7f6e08031730 legacy=0x7f6e08033bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.139+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 >> v1:172.21.15.152:6789/0 conn(0x7f6e2812b3a0 legacy=0x7f6e2813f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.143 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.140+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 shutdown_connections 2021-02-24T15:16:14.143 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.140+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 >> 172.21.15.152:0/798934863 conn(0x7f6e2806a630 msgr2=0x7f6e28097040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:14.143 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.141+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 shutdown_connections 2021-02-24T15:16:14.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.141+0000 7f6e2fe8d700 1 -- 172.21.15.152:0/798934863 wait complete. 2021-02-24T15:16:14.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.141+0000 7f6e2fe8d700 1 librados: shutdown 2021-02-24T15:16:14.144 INFO:teuthology.orchestra.run.smithi152.stderr:enabled application 'rbd' on pool 'rbd' 2021-02-24T15:16:14.159 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-02-24T15:16:14.162 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-24T15:16:14.162 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-02-24T15:16:14.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.284+0000 7f3de3d64700 1 Processor -- start 2021-02-24T15:16:14.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.284+0000 7f3de3d64700 1 -- start start 2021-02-24T15:16:14.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.285+0000 7f3de3d64700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc062660 con 0x7f3ddc095bb0 2021-02-24T15:16:14.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.285+0000 7f3de3d64700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc063af0 con 0x7f3ddc0966a0 2021-02-24T15:16:14.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.285+0000 7f3de3d64700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc063d90 con 0x7f3ddc068410 2021-02-24T15:16:14.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.285+0000 7f3de2301700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f3ddc068410 0x7f3ddc133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34364/0 (socket says 172.21.15.152:34364) 2021-02-24T15:16:14.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.285+0000 7f3de12ff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3ddc095bb0 0x7f3ddc130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45886/0 (socket says 172.21.15.152:45886) 2021-02-24T15:16:14.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.285+0000 7f3de2301700 1 -- 172.21.15.152:0/4056774281 learned_addr learned my addr 172.21.15.152:0/4056774281 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:14.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de12ff700 1 -- 172.21.15.152:0/4056774281 >> v1:172.21.15.152:6789/0 conn(0x7f3ddc095bb0 legacy=0x7f3ddc130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de2301700 1 -- 172.21.15.152:0/4056774281 >> v1:172.21.15.152:6790/0 conn(0x7f3ddc068410 legacy=0x7f3ddc133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de1b00700 1 -- 172.21.15.152:0/4056774281 >> v1:172.21.15.181:6789/0 conn(0x7f3ddc0966a0 legacy=0x7f3ddc096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165984754 0 0) 0x7f3ddc063d90 con 0x7f3ddc068410 2021-02-24T15:16:14.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc4003230 con 0x7f3ddc068410 2021-02-24T15:16:14.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295447008 0 0) 0x7f3ddc062660 con 0x7f3ddc095bb0 2021-02-24T15:16:14.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ddc063d90 con 0x7f3ddc095bb0 2021-02-24T15:16:14.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1836771926 0 0) 0x7f3dc4003230 con 0x7f3ddc068410 2021-02-24T15:16:14.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 >> v1:172.21.15.181:6789/0 conn(0x7f3ddc0966a0 legacy=0x7f3ddc096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 >> v1:172.21.15.152:6789/0 conn(0x7f3ddc095bb0 legacy=0x7f3ddc130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc064030 con 0x7f3ddc068410 2021-02-24T15:16:14.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3dd4001d70 con 0x7f3ddc068410 2021-02-24T15:16:14.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.287+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3dd4002090 con 0x7f3ddc068410 2021-02-24T15:16:14.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.288+0000 7f3de0afe700 1 -- 172.21.15.152:0/4056774281 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3dd4004ad0 con 0x7f3ddc068410 2021-02-24T15:16:14.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.288+0000 7f3de3d64700 1 -- 172.21.15.152:0/4056774281 >> v1:172.21.15.152:6790/0 conn(0x7f3ddc068410 legacy=0x7f3ddc133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.288+0000 7f3de3d64700 1 -- 172.21.15.152:0/4056774281 shutdown_connections 2021-02-24T15:16:14.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.288+0000 7f3de3d64700 1 -- 172.21.15.152:0/4056774281 >> 172.21.15.152:0/4056774281 conn(0x7f3ddc09ba40 msgr2=0x7f3ddc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:14.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.288+0000 7f3de3d64700 1 -- 172.21.15.152:0/4056774281 shutdown_connections 2021-02-24T15:16:14.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.288+0000 7f3de3d64700 1 -- 172.21.15.152:0/4056774281 wait complete. 2021-02-24T15:16:14.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de3d64700 1 librados: starting msgr at 2021-02-24T15:16:14.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de3d64700 1 librados: starting objecter 2021-02-24T15:16:14.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de3d64700 1 Processor -- start 2021-02-24T15:16:14.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de3d64700 1 -- start start 2021-02-24T15:16:14.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de3d64700 1 librados: setting wanted keys 2021-02-24T15:16:14.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de3d64700 1 librados: calling monclient init 2021-02-24T15:16:14.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de3d64700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc134660 con 0x7f3ddc068410 2021-02-24T15:16:14.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de3d64700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc11b930 con 0x7f3ddc095bb0 2021-02-24T15:16:14.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de3d64700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc11ae60 con 0x7f3ddc0966a0 2021-02-24T15:16:14.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de2301700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f3ddc0966a0 0x7f3ddc142360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34368/0 (socket says 172.21.15.152:34368) 2021-02-24T15:16:14.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.289+0000 7f3de2301700 1 -- 172.21.15.152:0/1385358828 learned_addr learned my addr 172.21.15.152:0/1385358828 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:14.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3de1b00700 1 -- 172.21.15.152:0/1385358828 >> v1:172.21.15.152:6789/0 conn(0x7f3ddc068410 legacy=0x7f3ddc13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3de2301700 1 -- 172.21.15.152:0/1385358828 >> v1:172.21.15.152:6790/0 conn(0x7f3ddc0966a0 legacy=0x7f3ddc142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 10 client.?.objecter ms_handle_connect 0x7f3ddc068410 2021-02-24T15:16:14.302 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:14.302 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 10 client.?.objecter ms_handle_connect 0x7f3ddc0966a0 2021-02-24T15:16:14.302 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:14.302 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027581131 0 0) 0x7f3ddc134660 con 0x7f3ddc068410 2021-02-24T15:16:14.303 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dbc004bd0 con 0x7f3ddc068410 2021-02-24T15:16:14.303 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 10 client.?.objecter ms_handle_connect 0x7f3ddc095bb0 2021-02-24T15:16:14.303 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:14.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3de12ff700 1 -- 172.21.15.152:0/1385358828 >> v1:172.21.15.181:6789/0 conn(0x7f3ddc095bb0 legacy=0x7f3ddc133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218591772 0 0) 0x7f3ddc11ae60 con 0x7f3ddc0966a0 2021-02-24T15:16:14.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ddc134660 con 0x7f3ddc0966a0 2021-02-24T15:16:14.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 368699162 0 0) 0x7f3dbc004bd0 con 0x7f3ddc068410 2021-02-24T15:16:14.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ddc11ae60 con 0x7f3ddc068410 2021-02-24T15:16:14.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3dd8001b60 con 0x7f3ddc068410 2021-02-24T15:16:14.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061925262 0 0) 0x7f3ddc11b930 con 0x7f3ddc095bb0 2021-02-24T15:16:14.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dbc004bd0 con 0x7f3ddc095bb0 2021-02-24T15:16:14.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 547209885 0 0) 0x7f3ddc134660 con 0x7f3ddc0966a0 2021-02-24T15:16:14.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ddc11b930 con 0x7f3ddc0966a0 2021-02-24T15:16:14.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3dd4004a10 con 0x7f3ddc0966a0 2021-02-24T15:16:14.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1416580126 0 0) 0x7f3ddc11ae60 con 0x7f3ddc068410 2021-02-24T15:16:14.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 >> v1:172.21.15.152:6790/0 conn(0x7f3ddc0966a0 legacy=0x7f3ddc142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 >> v1:172.21.15.181:6789/0 conn(0x7f3ddc095bb0 legacy=0x7f3ddc133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc067350 con 0x7f3ddc068410 2021-02-24T15:16:14.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc11a460 con 0x7f3ddc068410 2021-02-24T15:16:14.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3dd8002230 con 0x7f3ddc068410 2021-02-24T15:16:14.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3dd8002540 con 0x7f3ddc068410 2021-02-24T15:16:14.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3de3d64700 10 client.4215.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:14.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc118dc0 con 0x7f3ddc068410 2021-02-24T15:16:14.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.292+0000 7f3de3d64700 1 librados: init done 2021-02-24T15:16:14.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.293+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f3dd80026e0 con 0x7f3ddc068410 2021-02-24T15:16:14.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.293+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 3549+0+0 (unknown 1424957426 0 0) 0x7f3dd803a890 con 0x7f3ddc068410 2021-02-24T15:16:14.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.293+0000 7f3dcdffb700 10 client.4215.objecter ms_dispatch 0x7f3ddc001510 osd_map(14..14 src has 1..14) v4 2021-02-24T15:16:14.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.293+0000 7f3dcdffb700 3 client.4215.objecter handle_osd_map got epochs [14,14] > 0 2021-02-24T15:16:14.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.293+0000 7f3dcdffb700 3 client.4215.objecter handle_osd_map decoding full epoch 14 2021-02-24T15:16:14.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.293+0000 7f3dcdffb700 20 client.4215.objecter dump_active .. 0 homeless 2021-02-24T15:16:14.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.293+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc09b130 con 0x7f3ddc068410 2021-02-24T15:16:14.310 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.296+0000 7f3dcdffb700 10 client.4215.objecter ms_handle_connect 0x7f3dbc031750 2021-02-24T15:16:14.310 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.297+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f3dd8002ca0 con 0x7f3ddc068410 2021-02-24T15:16:14.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.465+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ddc09c180 con 0x7f3ddc068410 2021-02-24T15:16:14.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.466+0000 7f3dcdffb700 1 -- 172.21.15.152:0/1385358828 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10039 (unknown 92231148 0 1297951932) 0x7f3dd8012270 con 0x7f3ddc068410 2021-02-24T15:16:14.467 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:14.468 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":14,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","created":"2021-02-24T15:16:02.232967+0000","modified":"2021-02-24T15:16:14.131797+0000","last_up_change":"2021-02-24T15:16:11.121140+0000","last_in_change":"2021-02-24T15:16:11.121140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-24T15:16:11.157287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-24T15:16:12.361586+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a72c3535-e891-4444-bf97-dc6fae0ad363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6801","nonce":33735}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6803","nonce":33735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6807","nonce":33735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6805","nonce":33735}]},"public_addr":"172.21.15.152:6801/33735","cluster_addr":"172.21.15.152:6803/33735","heartbeat_back_addr":"172.21.15.152:6807/33735","heartbeat_front_addr":"172.21.15.152:6805/33735","state":["exists","up"]},{"osd":1,"uuid":"008b3230-90b6-4bee-8218-c422a983151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6800","nonce":33736}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6802","nonce":33736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6806","nonce":33736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6804","nonce":33736}]},"public_addr":"172.21.15.152:6800/33736","cluster_addr":"172.21.15.152:6802/33736","heartbeat_back_addr":"172.21.15.152:6806/33736","heartbeat_front_addr":"172.21.15.152:6804/33736","state":["exists","up"]},{"osd":2,"uuid":"b91de7c8-a67a-45d6-8643-8578d6b60c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6808","nonce":33737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6809","nonce":33737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6811","nonce":33737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6810","nonce":33737}]},"public_addr":"172.21.15.152:6808/33737","cluster_addr":"172.21.15.152:6809/33737","heartbeat_back_addr":"172.21.15.152:6811/33737","heartbeat_front_addr":"172.21.15.152:6810/33737","state":["exists","up"]},{"osd":3,"uuid":"cc030322-1a40-4f32-9ea3-48d755deaca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":33937}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":33937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":33937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":33937}]},"public_addr":"172.21.15.181:6801/33937","cluster_addr":"172.21.15.181:6803/33937","heartbeat_back_addr":"172.21.15.181:6807/33937","heartbeat_front_addr":"172.21.15.181:6805/33937","state":["exists","up"]},{"osd":4,"uuid":"3022f9f3-8ca8-403a-863a-41c661302f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":33938}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":33938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":33938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":33938}]},"public_addr":"172.21.15.181:6800/33938","cluster_addr":"172.21.15.181:6802/33938","heartbeat_back_addr":"172.21.15.181:6806/33938","heartbeat_front_addr":"172.21.15.181:6804/33938","state":["exists","up"]},{"osd":5,"uuid":"a6762546-97f4-409d-bebb-411eb5fba3db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":33963}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":33963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":33963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":33963}]},"public_addr":"172.21.15.181:6808/33963","cluster_addr":"172.21.15.181:6809/33963","heartbeat_back_addr":"172.21.15.181:6811/33963","heartbeat_front_addr":"172.21.15.181:6810/33963","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.364038+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.333681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.341529+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.302404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.368253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.356384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-24T15:16:14.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 10 librados: watch_flush enter 2021-02-24T15:16:14.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 10 librados: watch_flush exit 2021-02-24T15:16:14.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 20 client.4215.objecter shutdown clearing up homeless session... 2021-02-24T15:16:14.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 10 client.4215.objecter successfully canceled tick 2021-02-24T15:16:14.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 >> v1:172.21.15.181:6812/33484 conn(0x7f3dbc031750 legacy=0x7f3dbc033c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 >> v1:172.21.15.152:6789/0 conn(0x7f3ddc068410 legacy=0x7f3ddc13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 shutdown_connections 2021-02-24T15:16:14.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 >> 172.21.15.152:0/1385358828 conn(0x7f3ddc09ba40 msgr2=0x7f3ddc09a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:14.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 shutdown_connections 2021-02-24T15:16:14.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 1 -- 172.21.15.152:0/1385358828 wait complete. 2021-02-24T15:16:14.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.468+0000 7f3de3d64700 1 librados: shutdown 2021-02-24T15:16:14.480 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-24T15:16:11.157287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-24T15:16:12.361586+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-24T15:16:14.481 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-24T15:16:14.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.599+0000 7f6b4d462700 1 Processor -- start 2021-02-24T15:16:14.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.599+0000 7f6b4d462700 1 -- start start 2021-02-24T15:16:14.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.599+0000 7f6b4d462700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b48091ac0 con 0x7f6b48090be0 2021-02-24T15:16:14.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.599+0000 7f6b4d462700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b48091d60 con 0x7f6b48094b80 2021-02-24T15:16:14.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.599+0000 7f6b4d462700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b48092000 con 0x7f6b48095670 2021-02-24T15:16:14.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.599+0000 7f6b477fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f6b48095670 0x7f6b4812f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34374/0 (socket says 172.21.15.152:34374) 2021-02-24T15:16:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.599+0000 7f6b477fe700 1 -- 172.21.15.152:0/2094803506 learned_addr learned my addr 172.21.15.152:0/2094803506 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b477fe700 1 -- 172.21.15.152:0/2094803506 >> v1:172.21.15.152:6790/0 conn(0x7f6b48095670 legacy=0x7f6b4812f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b467fc700 1 -- 172.21.15.152:0/2094803506 >> v1:172.21.15.152:6789/0 conn(0x7f6b48090be0 legacy=0x7f6b48094f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835010623 0 0) 0x7f6b48092000 con 0x7f6b48095670 2021-02-24T15:16:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b34003230 con 0x7f6b48095670 2021-02-24T15:16:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b46ffd700 1 -- 172.21.15.152:0/2094803506 >> v1:172.21.15.181:6789/0 conn(0x7f6b48094b80 legacy=0x7f6b480923c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350826510 0 0) 0x7f6b48091ac0 con 0x7f6b48090be0 2021-02-24T15:16:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b48092000 con 0x7f6b48090be0 2021-02-24T15:16:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2062260229 0 0) 0x7f6b48092000 con 0x7f6b48090be0 2021-02-24T15:16:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 >> v1:172.21.15.152:6790/0 conn(0x7f6b48095670 legacy=0x7f6b4812f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 >> v1:172.21.15.181:6789/0 conn(0x7f6b48094b80 legacy=0x7f6b480923c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b48092ad0 con 0x7f6b48090be0 2021-02-24T15:16:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6b38001a40 con 0x7f6b48090be0 2021-02-24T15:16:14.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6b38001ca0 con 0x7f6b48090be0 2021-02-24T15:16:14.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.602+0000 7f6b45ffb700 1 -- 172.21.15.152:0/2094803506 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6b38002060 con 0x7f6b48090be0 2021-02-24T15:16:14.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.603+0000 7f6b4d462700 1 -- 172.21.15.152:0/2094803506 >> v1:172.21.15.152:6789/0 conn(0x7f6b48090be0 legacy=0x7f6b48094f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.603+0000 7f6b4d462700 1 -- 172.21.15.152:0/2094803506 shutdown_connections 2021-02-24T15:16:14.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.603+0000 7f6b4d462700 1 -- 172.21.15.152:0/2094803506 >> 172.21.15.152:0/2094803506 conn(0x7f6b480998d0 msgr2=0x7f6b48099ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:14.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.603+0000 7f6b4d462700 1 -- 172.21.15.152:0/2094803506 shutdown_connections 2021-02-24T15:16:14.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.603+0000 7f6b4d462700 1 -- 172.21.15.152:0/2094803506 wait complete. 2021-02-24T15:16:14.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.603+0000 7f6b4d462700 1 librados: starting msgr at 2021-02-24T15:16:14.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.603+0000 7f6b4d462700 1 librados: starting objecter 2021-02-24T15:16:14.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b4d462700 1 Processor -- start 2021-02-24T15:16:14.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b4d462700 1 -- start start 2021-02-24T15:16:14.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b4d462700 1 librados: setting wanted keys 2021-02-24T15:16:14.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b4d462700 1 librados: calling monclient init 2021-02-24T15:16:14.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b4d462700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b48091250 con 0x7f6b48090be0 2021-02-24T15:16:14.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b4d462700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b481187a0 con 0x7f6b48094b80 2021-02-24T15:16:14.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b4d462700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b48066f90 con 0x7f6b48095670 2021-02-24T15:16:14.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b46ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6b48090be0 0x7f6b48137dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45904/0 (socket says 172.21.15.152:45904) 2021-02-24T15:16:14.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b477fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f6b48095670 0x7f6b4813fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34384/0 (socket says 172.21.15.152:34384) 2021-02-24T15:16:14.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.604+0000 7f6b46ffd700 1 -- 172.21.15.152:0/3859410305 learned_addr learned my addr 172.21.15.152:0/3859410305 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:14.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b477fe700 1 -- 172.21.15.152:0/3859410305 >> v1:172.21.15.152:6790/0 conn(0x7f6b48095670 legacy=0x7f6b4813fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b2effd700 10 client.?.objecter ms_handle_connect 0x7f6b48095670 2021-02-24T15:16:14.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b2effd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:14.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b2effd700 10 client.?.objecter ms_handle_connect 0x7f6b48090be0 2021-02-24T15:16:14.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b2effd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:14.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b46ffd700 1 -- 172.21.15.152:0/3859410305 >> v1:172.21.15.152:6789/0 conn(0x7f6b48090be0 legacy=0x7f6b48137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b477fe700 1 --1- 172.21.15.152:0/3859410305 >> v1:172.21.15.152:6790/0 conn(0x7f6b48095670 0x7f6b4813fca0 :-1 s=OPENED pgs=68 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f6b48066f90 auth_reply(proto 2 0 (0) Success) v1 2021-02-24T15:16:14.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b2effd700 10 client.?.objecter ms_handle_connect 0x7f6b48094b80 2021-02-24T15:16:14.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b2effd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:14.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b467fc700 1 -- 172.21.15.152:0/3859410305 >> v1:172.21.15.181:6789/0 conn(0x7f6b48094b80 legacy=0x7f6b48131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261901648 0 0) 0x7f6b48091250 con 0x7f6b48090be0 2021-02-24T15:16:14.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.606+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b28004bd0 con 0x7f6b48090be0 2021-02-24T15:16:14.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2915224524 0 0) 0x7f6b28004bd0 con 0x7f6b48090be0 2021-02-24T15:16:14.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b48091250 con 0x7f6b48090be0 2021-02-24T15:16:14.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6b3c001ce0 con 0x7f6b48090be0 2021-02-24T15:16:14.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840011434 0 0) 0x7f6b481187a0 con 0x7f6b48094b80 2021-02-24T15:16:14.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b28004bd0 con 0x7f6b48094b80 2021-02-24T15:16:14.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3149724347 0 0) 0x7f6b48091250 con 0x7f6b48090be0 2021-02-24T15:16:14.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 >> v1:172.21.15.152:6790/0 conn(0x7f6b48095670 legacy=0x7f6b4813fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 >> v1:172.21.15.181:6789/0 conn(0x7f6b48094b80 legacy=0x7f6b48131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b48131fa0 con 0x7f6b48090be0 2021-02-24T15:16:14.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245234272 0 0) 0x7f6b48066f90 con 0x7f6b48095670 2021-02-24T15:16:14.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b48117da0 con 0x7f6b48090be0 2021-02-24T15:16:14.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b4d462700 10 client.4221.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:14.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b48116760 con 0x7f6b48090be0 2021-02-24T15:16:14.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b4d462700 1 librados: init done 2021-02-24T15:16:14.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6b3c002460 con 0x7f6b48090be0 2021-02-24T15:16:14.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.607+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6b3c002770 con 0x7f6b48090be0 2021-02-24T15:16:14.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.608+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f6b3c002900 con 0x7f6b48090be0 2021-02-24T15:16:14.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.608+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 3549+0+0 (unknown 1424957426 0 0) 0x7f6b3c03aa90 con 0x7f6b48090be0 2021-02-24T15:16:14.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.608+0000 7f6b2effd700 10 client.4221.objecter ms_dispatch 0x7f6b48001510 osd_map(14..14 src has 1..14) v4 2021-02-24T15:16:14.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.608+0000 7f6b2effd700 3 client.4221.objecter handle_osd_map got epochs [14,14] > 0 2021-02-24T15:16:14.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.608+0000 7f6b2effd700 3 client.4221.objecter handle_osd_map decoding full epoch 14 2021-02-24T15:16:14.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.608+0000 7f6b2effd700 20 client.4221.objecter dump_active .. 0 homeless 2021-02-24T15:16:14.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.608+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b20004d60 con 0x7f6b48090be0 2021-02-24T15:16:14.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.610+0000 7f6b2effd700 10 client.4221.objecter ms_handle_connect 0x7f6b28031290 2021-02-24T15:16:14.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.612+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f6b3c0128d0 con 0x7f6b48090be0 2021-02-24T15:16:14.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.781+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6b20005590 con 0x7f6b48090be0 2021-02-24T15:16:14.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.781+0000 7f6b2effd700 1 -- 172.21.15.152:0/3859410305 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v14) v1 ==== 110+0+10 (unknown 349952732 0 2170607528) 0x7f6b3c0124c0 con 0x7f6b48090be0 2021-02-24T15:16:14.783 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2021-02-24T15:16:14.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 10 librados: watch_flush enter 2021-02-24T15:16:14.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 10 librados: watch_flush exit 2021-02-24T15:16:14.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 20 client.4221.objecter shutdown clearing up homeless session... 2021-02-24T15:16:14.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 10 client.4221.objecter successfully canceled tick 2021-02-24T15:16:14.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 >> v1:172.21.15.181:6812/33484 conn(0x7f6b28031290 legacy=0x7f6b28033750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 >> v1:172.21.15.152:6789/0 conn(0x7f6b48090be0 legacy=0x7f6b48137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 shutdown_connections 2021-02-24T15:16:14.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 >> 172.21.15.152:0/3859410305 conn(0x7f6b480998d0 msgr2=0x7f6b48098390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:14.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 shutdown_connections 2021-02-24T15:16:14.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 1 -- 172.21.15.152:0/3859410305 wait complete. 2021-02-24T15:16:14.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.783+0000 7f6b4d462700 1 librados: shutdown 2021-02-24T15:16:14.795 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-24T15:16:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.913+0000 7fb8efd6c700 1 Processor -- start 2021-02-24T15:16:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.913+0000 7fb8efd6c700 1 -- start start 2021-02-24T15:16:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.914+0000 7fb8efd6c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e805d7c0 con 0x7fb8e8069b60 2021-02-24T15:16:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.914+0000 7fb8efd6c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e8095a70 con 0x7fb8e8068550 2021-02-24T15:16:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.914+0000 7fb8efd6c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80956b0 con 0x7fb8e80689b0 2021-02-24T15:16:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.914+0000 7fb8ee309700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fb8e80689b0 0x7fb8e8133400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34388/0 (socket says 172.21.15.152:34388) 2021-02-24T15:16:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.914+0000 7fb8edb08700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb8e8069b60 0x7fb8e8067e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45912/0 (socket says 172.21.15.152:45912) 2021-02-24T15:16:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.914+0000 7fb8ee309700 1 -- 172.21.15.152:0/1569020779 learned_addr learned my addr 172.21.15.152:0/1569020779 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:14.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ee309700 1 -- 172.21.15.152:0/1569020779 >> v1:172.21.15.152:6790/0 conn(0x7fb8e80689b0 legacy=0x7fb8e8133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8edb08700 1 -- 172.21.15.152:0/1569020779 >> v1:172.21.15.152:6789/0 conn(0x7fb8e8069b60 legacy=0x7fb8e8067e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ed307700 1 -- 172.21.15.152:0/1569020779 >> v1:172.21.15.181:6789/0 conn(0x7fb8e8068550 legacy=0x7fb8e812fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844238916 0 0) 0x7fb8e80956b0 con 0x7fb8e80689b0 2021-02-24T15:16:14.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d0003230 con 0x7fb8e80689b0 2021-02-24T15:16:14.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324062037 0 0) 0x7fb8e805d7c0 con 0x7fb8e8069b60 2021-02-24T15:16:14.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e80956b0 con 0x7fb8e8069b60 2021-02-24T15:16:14.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615034942 0 0) 0x7fb8dc001460 con 0x7fb8e8068550 2021-02-24T15:16:14.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e805d7c0 con 0x7fb8e8068550 2021-02-24T15:16:14.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2607926791 0 0) 0x7fb8d0003230 con 0x7fb8e80689b0 2021-02-24T15:16:14.927 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 >> v1:172.21.15.181:6789/0 conn(0x7fb8e8068550 legacy=0x7fb8e812fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.927 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 >> v1:172.21.15.152:6789/0 conn(0x7fb8e8069b60 legacy=0x7fb8e8067e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.927 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8096820 con 0x7fb8e80689b0 2021-02-24T15:16:14.927 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.916+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb8e0001d70 con 0x7fb8e80689b0 2021-02-24T15:16:14.928 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.917+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb8e0002020 con 0x7fb8e80689b0 2021-02-24T15:16:14.928 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.917+0000 7fb8ecb06700 1 -- 172.21.15.152:0/1569020779 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb8e0004ad0 con 0x7fb8e80689b0 2021-02-24T15:16:14.928 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.917+0000 7fb8efd6c700 1 -- 172.21.15.152:0/1569020779 >> v1:172.21.15.152:6790/0 conn(0x7fb8e80689b0 legacy=0x7fb8e8133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.928 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.917+0000 7fb8efd6c700 1 -- 172.21.15.152:0/1569020779 shutdown_connections 2021-02-24T15:16:14.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.917+0000 7fb8efd6c700 1 -- 172.21.15.152:0/1569020779 >> 172.21.15.152:0/1569020779 conn(0x7fb8e809a4d0 msgr2=0x7fb8e809a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:14.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.917+0000 7fb8efd6c700 1 -- 172.21.15.152:0/1569020779 shutdown_connections 2021-02-24T15:16:14.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.917+0000 7fb8efd6c700 1 -- 172.21.15.152:0/1569020779 wait complete. 2021-02-24T15:16:14.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8efd6c700 1 librados: starting msgr at 2021-02-24T15:16:14.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8efd6c700 1 librados: starting objecter 2021-02-24T15:16:14.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8efd6c700 1 Processor -- start 2021-02-24T15:16:14.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8efd6c700 1 -- start start 2021-02-24T15:16:14.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8efd6c700 1 librados: setting wanted keys 2021-02-24T15:16:14.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8efd6c700 1 librados: calling monclient init 2021-02-24T15:16:14.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8efd6c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e8123c50 con 0x7fb8e8068550 2021-02-24T15:16:14.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8efd6c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e8123ef0 con 0x7fb8e80689b0 2021-02-24T15:16:14.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8efd6c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e8124190 con 0x7fb8e8069b60 2021-02-24T15:16:14.932 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8edb08700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb8e8068550 0x7fb8e8090260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45918/0 (socket says 172.21.15.152:45918) 2021-02-24T15:16:14.932 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.918+0000 7fb8edb08700 1 -- 172.21.15.152:0/910807605 learned_addr learned my addr 172.21.15.152:0/910807605 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:14.936 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8edb08700 1 -- 172.21.15.152:0/910807605 >> v1:172.21.15.152:6789/0 conn(0x7fb8e8068550 legacy=0x7fb8e8090260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.936 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8ee309700 1 -- 172.21.15.152:0/910807605 >> v1:172.21.15.152:6790/0 conn(0x7fb8e8069b60 legacy=0x7fb8e8142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.936 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 10 client.?.objecter ms_handle_connect 0x7fb8e8068550 2021-02-24T15:16:14.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:14.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 10 client.?.objecter ms_handle_connect 0x7fb8e8069b60 2021-02-24T15:16:14.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:14.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107182738 0 0) 0x7fb8e8123c50 con 0x7fb8e8068550 2021-02-24T15:16:14.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c8004bd0 con 0x7fb8e8068550 2021-02-24T15:16:14.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8ed307700 1 -- 172.21.15.152:0/910807605 >> v1:172.21.15.181:6789/0 conn(0x7fb8e80689b0 legacy=0x7fb8e8090970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:14.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 10 client.?.objecter ms_handle_connect 0x7fb8e80689b0 2021-02-24T15:16:14.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:14.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745767175 0 0) 0x7fb8e8124190 con 0x7fb8e8069b60 2021-02-24T15:16:14.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e8123c50 con 0x7fb8e8069b60 2021-02-24T15:16:14.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435623292 0 0) 0x7fb8e8123ef0 con 0x7fb8e80689b0 2021-02-24T15:16:14.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e8124190 con 0x7fb8e80689b0 2021-02-24T15:16:14.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 658856426 0 0) 0x7fb8c8004bd0 con 0x7fb8e8068550 2021-02-24T15:16:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb8e8123ef0 con 0x7fb8e8068550 2021-02-24T15:16:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1859099139 0 0) 0x7fb8e8123c50 con 0x7fb8e8069b60 2021-02-24T15:16:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb8c8004bd0 con 0x7fb8e8069b60 2021-02-24T15:16:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb8e4001cb0 con 0x7fb8e8068550 2021-02-24T15:16:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb8e0004a10 con 0x7fb8e8069b60 2021-02-24T15:16:14.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 908501863 0 0) 0x7fb8e8123ef0 con 0x7fb8e8068550 2021-02-24T15:16:14.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 >> v1:172.21.15.152:6790/0 conn(0x7fb8e8069b60 legacy=0x7fb8e8142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 >> v1:172.21.15.181:6789/0 conn(0x7fb8e80689b0 legacy=0x7fb8e8090970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:14.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8122020 con 0x7fb8e8068550 2021-02-24T15:16:14.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1899324894 0 0) 0x7fb8c8004bd0 con 0x7fb8e8069b60 2021-02-24T15:16:14.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8efd6c700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e8124ab0 con 0x7fb8e8068550 2021-02-24T15:16:14.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb8e4004900 con 0x7fb8e8068550 2021-02-24T15:16:14.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb8e4004c10 con 0x7fb8e8068550 2021-02-24T15:16:14.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8efd6c700 10 client.4227.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:14.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8efd6c700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e81214c0 con 0x7fb8e8068550 2021-02-24T15:16:14.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.921+0000 7fb8efd6c700 1 librados: init done 2021-02-24T15:16:14.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fb8e4004df0 con 0x7fb8e8068550 2021-02-24T15:16:14.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 3549+0+0 (unknown 1424957426 0 0) 0x7fb8e403a8b0 con 0x7fb8e8068550 2021-02-24T15:16:14.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8d9ffb700 10 client.4227.objecter ms_dispatch 0x7fb8e8001510 osd_map(14..14 src has 1..14) v4 2021-02-24T15:16:14.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8d9ffb700 3 client.4227.objecter handle_osd_map got epochs [14,14] > 0 2021-02-24T15:16:14.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8d9ffb700 3 client.4227.objecter handle_osd_map decoding full epoch 14 2021-02-24T15:16:14.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8d9ffb700 20 client.4227.objecter dump_active .. 0 homeless 2021-02-24T15:16:14.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8ed307700 1 -- 172.21.15.152:0/910807605 >> v1:172.21.15.181:6812/33484 conn(0x7fb8c8031460 legacy=0x7fb8c8033920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-24T15:16:14.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8ed307700 1 -- 172.21.15.152:0/910807605 >> v1:172.21.15.181:6812/33484 conn(0x7fb8c8031460 legacy=0x7fb8c8033920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:16:14.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8ed307700 1 --1- 172.21.15.152:0/910807605 >> v1:172.21.15.181:6812/33484 conn(0x7fb8c8031460 0x7fb8c8033920 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-02-24T15:16:14.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8ed307700 1 --1- 172.21.15.152:0/910807605 >> v1:172.21.15.181:6812/33484 conn(0x7fb8c8031460 0x7fb8c8033920 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-02-24T15:16:14.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 >> v1:172.21.15.181:6812/33484 conn(0x7fb8c8031460 legacy=0x7fb8c8033920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:14.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.922+0000 7fb8efd6c700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e8127900 con 0x7fb8e8068550 2021-02-24T15:16:14.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:14.927+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fb8e8127900 con 0x7fb8e8068550 2021-02-24T15:16:15.096 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.095+0000 7fb8efd6c700 1 -- 172.21.15.152:0/910807605 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb8e8127900 con 0x7fb8e8068550 2021-02-24T15:16:15.097 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.095+0000 7fb8d9ffb700 1 -- 172.21.15.152:0/910807605 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (unknown 185327234 0 265718887) 0x7fb8e8127900 con 0x7fb8e8068550 2021-02-24T15:16:15.097 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 8 2021-02-24T15:16:15.098 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 10 librados: watch_flush enter 2021-02-24T15:16:15.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 10 librados: watch_flush exit 2021-02-24T15:16:15.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 20 client.4227.objecter shutdown clearing up homeless session... 2021-02-24T15:16:15.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 10 client.4227.objecter successfully canceled tick 2021-02-24T15:16:15.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 1 -- 172.21.15.152:0/910807605 >> v1:172.21.15.152:6789/0 conn(0x7fb8e8068550 legacy=0x7fb8e8090260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 1 -- 172.21.15.152:0/910807605 shutdown_connections 2021-02-24T15:16:15.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 1 -- 172.21.15.152:0/910807605 >> 172.21.15.152:0/910807605 conn(0x7fb8e809a4d0 msgr2=0x7fb8e80919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:15.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 1 -- 172.21.15.152:0/910807605 shutdown_connections 2021-02-24T15:16:15.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 1 -- 172.21.15.152:0/910807605 wait complete. 2021-02-24T15:16:15.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.097+0000 7fb8efd6c700 1 librados: shutdown 2021-02-24T15:16:15.110 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-02-24T15:16:15.110 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-02-24T15:16:15.111 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-02-24T15:16:15.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.228+0000 7f5b39ff9700 1 Processor -- start 2021-02-24T15:16:15.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.228+0000 7f5b39ff9700 1 -- start start 2021-02-24T15:16:15.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.229+0000 7f5b39ff9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b34097d40 con 0x7f5b34063220 2021-02-24T15:16:15.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.229+0000 7f5b39ff9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b34063d00 con 0x7f5b34099340 2021-02-24T15:16:15.232 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.229+0000 7f5b39ff9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b34097980 con 0x7f5b34062da0 2021-02-24T15:16:15.232 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.229+0000 7f5b33fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5b34063220 0x7f5b34133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45930/0 (socket says 172.21.15.152:45930) 2021-02-24T15:16:15.232 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.229+0000 7f5b32ffd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f5b34062da0 0x7f5b3412fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34404/0 (socket says 172.21.15.152:34404) 2021-02-24T15:16:15.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.229+0000 7f5b33fff700 1 -- 172.21.15.152:0/2043028280 learned_addr learned my addr 172.21.15.152:0/2043028280 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:15.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b33fff700 1 -- 172.21.15.152:0/2043028280 >> v1:172.21.15.152:6789/0 conn(0x7f5b34063220 legacy=0x7f5b34133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b32ffd700 1 -- 172.21.15.152:0/2043028280 >> v1:172.21.15.152:6790/0 conn(0x7f5b34062da0 legacy=0x7f5b3412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b337fe700 1 -- 172.21.15.152:0/2043028280 >> v1:172.21.15.181:6789/0 conn(0x7f5b34099340 legacy=0x7f5b34097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962386301 0 0) 0x7f5b34097980 con 0x7f5b34062da0 2021-02-24T15:16:15.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b20003230 con 0x7f5b34062da0 2021-02-24T15:16:15.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601498116 0 0) 0x7f5b34097d40 con 0x7f5b34063220 2021-02-24T15:16:15.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b34097980 con 0x7f5b34063220 2021-02-24T15:16:15.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804540458 0 0) 0x7f5b34063d00 con 0x7f5b34099340 2021-02-24T15:16:15.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b34097d40 con 0x7f5b34099340 2021-02-24T15:16:15.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1928225856 0 0) 0x7f5b34097980 con 0x7f5b34063220 2021-02-24T15:16:15.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 >> v1:172.21.15.152:6790/0 conn(0x7f5b34062da0 legacy=0x7f5b3412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 >> v1:172.21.15.181:6789/0 conn(0x7f5b34099340 legacy=0x7f5b34097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3408fac0 con 0x7f5b34063220 2021-02-24T15:16:15.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.231+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5b2c001cb0 con 0x7f5b34063220 2021-02-24T15:16:15.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.232+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5b2c001fc0 con 0x7f5b34063220 2021-02-24T15:16:15.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.232+0000 7f5b327fc700 1 -- 172.21.15.152:0/2043028280 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5b2c004ad0 con 0x7f5b34063220 2021-02-24T15:16:15.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.232+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2043028280 >> v1:172.21.15.152:6789/0 conn(0x7f5b34063220 legacy=0x7f5b34133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.232+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2043028280 shutdown_connections 2021-02-24T15:16:15.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.232+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2043028280 >> 172.21.15.152:0/2043028280 conn(0x7f5b3409dcc0 msgr2=0x7f5b3409e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:15.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.232+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2043028280 shutdown_connections 2021-02-24T15:16:15.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.232+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2043028280 wait complete. 2021-02-24T15:16:15.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.233+0000 7f5b39ff9700 1 librados: starting msgr at 2021-02-24T15:16:15.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.233+0000 7f5b39ff9700 1 librados: starting objecter 2021-02-24T15:16:15.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.233+0000 7f5b39ff9700 1 Processor -- start 2021-02-24T15:16:15.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.233+0000 7f5b39ff9700 1 -- start start 2021-02-24T15:16:15.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.233+0000 7f5b39ff9700 1 librados: setting wanted keys 2021-02-24T15:16:15.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.233+0000 7f5b39ff9700 1 librados: calling monclient init 2021-02-24T15:16:15.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.234+0000 7f5b39ff9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b340998b0 con 0x7f5b34063220 2021-02-24T15:16:15.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.234+0000 7f5b39ff9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b34065ec0 con 0x7f5b34099340 2021-02-24T15:16:15.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.234+0000 7f5b39ff9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3411d8a0 con 0x7f5b34062da0 2021-02-24T15:16:15.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.234+0000 7f5b337fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f5b34062da0 0x7f5b3411ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34408/0 (socket says 172.21.15.152:34408) 2021-02-24T15:16:15.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.234+0000 7f5b337fe700 1 -- 172.21.15.152:0/2688121072 learned_addr learned my addr 172.21.15.152:0/2688121072 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:15.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b32ffd700 1 -- 172.21.15.152:0/2688121072 >> v1:172.21.15.152:6789/0 conn(0x7f5b34063220 legacy=0x7f5b3411d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 10 client.?.objecter ms_handle_connect 0x7f5b34063220 2021-02-24T15:16:15.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b337fe700 1 -- 172.21.15.152:0/2688121072 >> v1:172.21.15.152:6790/0 conn(0x7f5b34062da0 legacy=0x7f5b3411ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:15.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 10 client.?.objecter ms_handle_connect 0x7f5b34062da0 2021-02-24T15:16:15.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:15.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403493930 0 0) 0x7f5b340998b0 con 0x7f5b34063220 2021-02-24T15:16:15.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b33fff700 1 -- 172.21.15.152:0/2688121072 >> v1:172.21.15.181:6789/0 conn(0x7f5b34099340 legacy=0x7f5b34146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b14004bd0 con 0x7f5b34063220 2021-02-24T15:16:15.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 10 client.?.objecter ms_handle_connect 0x7f5b34099340 2021-02-24T15:16:15.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:15.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870809810 0 0) 0x7f5b3411d8a0 con 0x7f5b34062da0 2021-02-24T15:16:15.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b340998b0 con 0x7f5b34062da0 2021-02-24T15:16:15.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2910478393 0 0) 0x7f5b14004bd0 con 0x7f5b34063220 2021-02-24T15:16:15.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b3411d8a0 con 0x7f5b34063220 2021-02-24T15:16:15.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 818254797 0 0) 0x7f5b340998b0 con 0x7f5b34062da0 2021-02-24T15:16:15.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b14004bd0 con 0x7f5b34062da0 2021-02-24T15:16:15.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5b28001ae0 con 0x7f5b34063220 2021-02-24T15:16:15.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698632541 0 0) 0x7f5b34065ec0 con 0x7f5b34099340 2021-02-24T15:16:15.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b340998b0 con 0x7f5b34099340 2021-02-24T15:16:15.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.236+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5b24001cb0 con 0x7f5b34062da0 2021-02-24T15:16:15.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3468356728 0 0) 0x7f5b3411d8a0 con 0x7f5b34063220 2021-02-24T15:16:15.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 >> v1:172.21.15.152:6790/0 conn(0x7f5b34062da0 legacy=0x7f5b3411ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 >> v1:172.21.15.181:6789/0 conn(0x7f5b34099340 legacy=0x7f5b34146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34065860 con 0x7f5b34063220 2021-02-24T15:16:15.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2310472144 0 0) 0x7f5b14004bd0 con 0x7f5b34062da0 2021-02-24T15:16:15.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b34065b00 con 0x7f5b34063220 2021-02-24T15:16:15.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b39ff9700 10 client.4233.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:15.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3411ef80 con 0x7f5b34063220 2021-02-24T15:16:15.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b39ff9700 1 librados: init done 2021-02-24T15:16:15.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5b28004820 con 0x7f5b34063220 2021-02-24T15:16:15.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5b28004b30 con 0x7f5b34063220 2021-02-24T15:16:15.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.237+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f5b28004d10 con 0x7f5b34063220 2021-02-24T15:16:15.266 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.238+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f5b2803a880 con 0x7f5b34063220 2021-02-24T15:16:15.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.238+0000 7f5b1b7fe700 10 client.4233.objecter ms_dispatch 0x7f5b34001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:15.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.238+0000 7f5b1b7fe700 3 client.4233.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:15.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.238+0000 7f5b1b7fe700 3 client.4233.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:15.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.238+0000 7f5b1b7fe700 20 client.4233.objecter dump_active .. 0 homeless 2021-02-24T15:16:15.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.238+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c004d60 con 0x7f5b34063220 2021-02-24T15:16:15.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.240+0000 7f5b1b7fe700 10 client.4233.objecter ms_handle_connect 0x7f5b140316c0 2021-02-24T15:16:15.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.242+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f5b280052d0 con 0x7f5b34063220 2021-02-24T15:16:15.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.452+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5b0c005010 con 0x7f5b34063220 2021-02-24T15:16:15.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.454+0000 7f5b1b7fe700 1 -- 172.21.15.152:0/2688121072 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+70303 (unknown 3797009233 0 2415364521) 0x7f5b28012690 con 0x7f5b34063220 2021-02-24T15:16:15.457 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:15.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.455+0000 7f5b39ff9700 10 librados: watch_flush enter 2021-02-24T15:16:15.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.455+0000 7f5b39ff9700 10 librados: watch_flush exit 2021-02-24T15:16:15.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.455+0000 7f5b39ff9700 20 client.4233.objecter shutdown clearing up homeless session... 2021-02-24T15:16:15.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.455+0000 7f5b39ff9700 10 client.4233.objecter successfully canceled tick 2021-02-24T15:16:15.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.455+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 >> v1:172.21.15.181:6812/33484 conn(0x7f5b140316c0 legacy=0x7f5b14033b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.455+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 >> v1:172.21.15.152:6789/0 conn(0x7f5b34063220 legacy=0x7f5b3411d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.455+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 shutdown_connections 2021-02-24T15:16:15.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.456+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 >> 172.21.15.152:0/2688121072 conn(0x7f5b3409dcc0 msgr2=0x7f5b3409c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:15.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.456+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 shutdown_connections 2021-02-24T15:16:15.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.456+0000 7f5b39ff9700 1 -- 172.21.15.152:0/2688121072 wait complete. 2021-02-24T15:16:15.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.456+0000 7f5b39ff9700 1 librados: shutdown 2021-02-24T15:16:15.468 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":4,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6812","nonce":33484}]},"active_addr":"172.21.15.181:6812/33484","active_change":"2021-02-24T15:16:06.606867+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":3639137003}]},{"addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":969238677}]}]}} 2021-02-24T15:16:15.470 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-02-24T15:16:15.470 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-02-24T15:16:15.471 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-24T15:16:15.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.587+0000 7fca6acc7700 1 Processor -- start 2021-02-24T15:16:15.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.587+0000 7fca6acc7700 1 -- start start 2021-02-24T15:16:15.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.587+0000 7fca6acc7700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6412b0d0 con 0x7fca64067e70 2021-02-24T15:16:15.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.587+0000 7fca6acc7700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca64098a60 con 0x7fca640679c0 2021-02-24T15:16:15.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.587+0000 7fca6acc7700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6409a0b0 con 0x7fca640613c0 2021-02-24T15:16:15.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.588+0000 7fca68a63700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fca640613c0 0x7fca6412a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34416/0 (socket says 172.21.15.152:34416) 2021-02-24T15:16:15.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.588+0000 7fca69264700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fca64067e70 0x7fca64133410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45944/0 (socket says 172.21.15.152:45944) 2021-02-24T15:16:15.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.588+0000 7fca68a63700 1 -- 172.21.15.152:0/3836277954 learned_addr learned my addr 172.21.15.152:0/3836277954 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:15.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca69264700 1 -- 172.21.15.152:0/3836277954 >> v1:172.21.15.152:6789/0 conn(0x7fca64067e70 legacy=0x7fca64133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca68a63700 1 -- 172.21.15.152:0/3836277954 >> v1:172.21.15.152:6790/0 conn(0x7fca640613c0 legacy=0x7fca6412a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233916234 0 0) 0x7fca6412b0d0 con 0x7fca64067e70 2021-02-24T15:16:15.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca48003230 con 0x7fca64067e70 2021-02-24T15:16:15.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712001402 0 0) 0x7fca6409a0b0 con 0x7fca640613c0 2021-02-24T15:16:15.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca6412b0d0 con 0x7fca640613c0 2021-02-24T15:16:15.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca63fff700 1 -- 172.21.15.152:0/3836277954 >> v1:172.21.15.181:6789/0 conn(0x7fca640679c0 legacy=0x7fca6412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697280192 0 0) 0x7fca64098a60 con 0x7fca640679c0 2021-02-24T15:16:15.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca6409a0b0 con 0x7fca640679c0 2021-02-24T15:16:15.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 876271978 0 0) 0x7fca6412b0d0 con 0x7fca640613c0 2021-02-24T15:16:15.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 >> v1:172.21.15.181:6789/0 conn(0x7fca640679c0 legacy=0x7fca6412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 >> v1:172.21.15.152:6789/0 conn(0x7fca64067e70 legacy=0x7fca64133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6409a350 con 0x7fca640613c0 2021-02-24T15:16:15.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fca58001970 con 0x7fca640613c0 2021-02-24T15:16:15.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fca58001c80 con 0x7fca640613c0 2021-02-24T15:16:15.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.590+0000 7fca637fe700 1 -- 172.21.15.152:0/3836277954 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fca58004750 con 0x7fca640613c0 2021-02-24T15:16:15.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.591+0000 7fca6acc7700 1 -- 172.21.15.152:0/3836277954 >> v1:172.21.15.152:6790/0 conn(0x7fca640613c0 legacy=0x7fca6412a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.591+0000 7fca6acc7700 1 -- 172.21.15.152:0/3836277954 shutdown_connections 2021-02-24T15:16:15.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.591+0000 7fca6acc7700 1 -- 172.21.15.152:0/3836277954 >> 172.21.15.152:0/3836277954 conn(0x7fca6409a940 msgr2=0x7fca6409ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:15.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.591+0000 7fca6acc7700 1 -- 172.21.15.152:0/3836277954 shutdown_connections 2021-02-24T15:16:15.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.591+0000 7fca6acc7700 1 -- 172.21.15.152:0/3836277954 wait complete. 2021-02-24T15:16:15.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.591+0000 7fca6acc7700 1 librados: starting msgr at 2021-02-24T15:16:15.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.591+0000 7fca6acc7700 1 librados: starting objecter 2021-02-24T15:16:15.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.592+0000 7fca6acc7700 1 Processor -- start 2021-02-24T15:16:15.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.592+0000 7fca6acc7700 1 -- start start 2021-02-24T15:16:15.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.592+0000 7fca6acc7700 1 librados: setting wanted keys 2021-02-24T15:16:15.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.592+0000 7fca6acc7700 1 librados: calling monclient init 2021-02-24T15:16:15.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.592+0000 7fca6acc7700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca64120ee0 con 0x7fca64067e70 2021-02-24T15:16:15.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.592+0000 7fca6acc7700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca64099480 con 0x7fca640613c0 2021-02-24T15:16:15.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.592+0000 7fca6acc7700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6411f850 con 0x7fca640679c0 2021-02-24T15:16:15.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.592+0000 7fca63fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fca640679c0 0x7fca641219b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34424/0 (socket says 172.21.15.152:34424) 2021-02-24T15:16:15.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.592+0000 7fca63fff700 1 -- 172.21.15.152:0/2994900010 learned_addr learned my addr 172.21.15.152:0/2994900010 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:15.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.594+0000 7fca69264700 1 -- 172.21.15.152:0/2994900010 >> v1:172.21.15.152:6789/0 conn(0x7fca64067e70 legacy=0x7fca64142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.594+0000 7fca60ff9700 10 client.?.objecter ms_handle_connect 0x7fca64067e70 2021-02-24T15:16:15.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca63fff700 1 -- 172.21.15.152:0/2994900010 >> v1:172.21.15.152:6790/0 conn(0x7fca640679c0 legacy=0x7fca641219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:15.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 10 client.?.objecter ms_handle_connect 0x7fca640679c0 2021-02-24T15:16:15.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:15.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358508352 0 0) 0x7fca64120ee0 con 0x7fca64067e70 2021-02-24T15:16:15.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca44004bd0 con 0x7fca64067e70 2021-02-24T15:16:15.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221307626 0 0) 0x7fca6411f850 con 0x7fca640679c0 2021-02-24T15:16:15.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca64120ee0 con 0x7fca640679c0 2021-02-24T15:16:15.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 10 client.?.objecter ms_handle_connect 0x7fca640613c0 2021-02-24T15:16:15.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:15.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca68a63700 1 -- 172.21.15.152:0/2994900010 >> v1:172.21.15.181:6789/0 conn(0x7fca640613c0 legacy=0x7fca641212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2306811440 0 0) 0x7fca44004bd0 con 0x7fca64067e70 2021-02-24T15:16:15.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fca6411f850 con 0x7fca64067e70 2021-02-24T15:16:15.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fca5c001fe0 con 0x7fca64067e70 2021-02-24T15:16:15.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 877339187 0 0) 0x7fca64120ee0 con 0x7fca640679c0 2021-02-24T15:16:15.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fca44004bd0 con 0x7fca640679c0 2021-02-24T15:16:15.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fca50001ec0 con 0x7fca640679c0 2021-02-24T15:16:15.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741748205 0 0) 0x7fca64099480 con 0x7fca640613c0 2021-02-24T15:16:15.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca64120ee0 con 0x7fca640613c0 2021-02-24T15:16:15.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2456327487 0 0) 0x7fca6411f850 con 0x7fca64067e70 2021-02-24T15:16:15.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 >> v1:172.21.15.152:6790/0 conn(0x7fca640679c0 legacy=0x7fca641219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 >> v1:172.21.15.181:6789/0 conn(0x7fca640613c0 legacy=0x7fca641212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca641220c0 con 0x7fca64067e70 2021-02-24T15:16:15.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca64123990 con 0x7fca64067e70 2021-02-24T15:16:15.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca6acc7700 10 client.4239.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:15.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fca64123c40 con 0x7fca64067e70 2021-02-24T15:16:15.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca6acc7700 1 librados: init done 2021-02-24T15:16:15.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fca5c004ce0 con 0x7fca64067e70 2021-02-24T15:16:15.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.595+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fca5c004ff0 con 0x7fca64067e70 2021-02-24T15:16:15.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.596+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fca5c0051d0 con 0x7fca64067e70 2021-02-24T15:16:15.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.596+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7fca5c03acf0 con 0x7fca64067e70 2021-02-24T15:16:15.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.596+0000 7fca60ff9700 10 client.4239.objecter ms_dispatch 0x7fca64001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:15.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.596+0000 7fca60ff9700 3 client.4239.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:15.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.596+0000 7fca60ff9700 3 client.4239.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:15.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.596+0000 7fca60ff9700 20 client.4239.objecter dump_active .. 0 homeless 2021-02-24T15:16:15.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.596+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c004d60 con 0x7fca64067e70 2021-02-24T15:16:15.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.599+0000 7fca60ff9700 10 client.4239.objecter ms_handle_connect 0x7fca440315a0 2021-02-24T15:16:15.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.600+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fca5c006750 con 0x7fca64067e70 2021-02-24T15:16:15.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.770+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca3c005010 con 0x7fca64067e70 2021-02-24T15:16:15.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.771+0000 7fca60ff9700 1 -- 172.21.15.152:0/2994900010 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10026 (unknown 4221056075 0 1209689785) 0x7fca5c012720 con 0x7fca64067e70 2021-02-24T15:16:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:15.774 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":15,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","created":"2021-02-24T15:16:02.232967+0000","modified":"2021-02-24T15:16:15.137619+0000","last_up_change":"2021-02-24T15:16:11.121140+0000","last_in_change":"2021-02-24T15:16:11.121140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-24T15:16:11.157287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-24T15:16:12.361586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a72c3535-e891-4444-bf97-dc6fae0ad363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6801","nonce":33735}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6803","nonce":33735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6807","nonce":33735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6805","nonce":33735}]},"public_addr":"172.21.15.152:6801/33735","cluster_addr":"172.21.15.152:6803/33735","heartbeat_back_addr":"172.21.15.152:6807/33735","heartbeat_front_addr":"172.21.15.152:6805/33735","state":["exists","up"]},{"osd":1,"uuid":"008b3230-90b6-4bee-8218-c422a983151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6800","nonce":33736}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6802","nonce":33736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6806","nonce":33736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6804","nonce":33736}]},"public_addr":"172.21.15.152:6800/33736","cluster_addr":"172.21.15.152:6802/33736","heartbeat_back_addr":"172.21.15.152:6806/33736","heartbeat_front_addr":"172.21.15.152:6804/33736","state":["exists","up"]},{"osd":2,"uuid":"b91de7c8-a67a-45d6-8643-8578d6b60c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6808","nonce":33737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6809","nonce":33737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6811","nonce":33737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6810","nonce":33737}]},"public_addr":"172.21.15.152:6808/33737","cluster_addr":"172.21.15.152:6809/33737","heartbeat_back_addr":"172.21.15.152:6811/33737","heartbeat_front_addr":"172.21.15.152:6810/33737","state":["exists","up"]},{"osd":3,"uuid":"cc030322-1a40-4f32-9ea3-48d755deaca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":33937}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":33937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":33937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":33937}]},"public_addr":"172.21.15.181:6801/33937","cluster_addr":"172.21.15.181:6803/33937","heartbeat_back_addr":"172.21.15.181:6807/33937","heartbeat_front_addr":"172.21.15.181:6805/33937","state":["exists","up"]},{"osd":4,"uuid":"3022f9f3-8ca8-403a-863a-41c661302f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":33938}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":33938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":33938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":33938}]},"public_addr":"172.21.15.181:6800/33938","cluster_addr":"172.21.15.181:6802/33938","heartbeat_back_addr":"172.21.15.181:6806/33938","heartbeat_front_addr":"172.21.15.181:6804/33938","state":["exists","up"]},{"osd":5,"uuid":"a6762546-97f4-409d-bebb-411eb5fba3db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":33963}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":33963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":33963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":33963}]},"public_addr":"172.21.15.181:6808/33963","cluster_addr":"172.21.15.181:6809/33963","heartbeat_back_addr":"172.21.15.181:6811/33963","heartbeat_front_addr":"172.21.15.181:6810/33963","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.364038+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.333681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.341529+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.302404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.368253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.356384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-24T15:16:15.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 10 librados: watch_flush enter 2021-02-24T15:16:15.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 10 librados: watch_flush exit 2021-02-24T15:16:15.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 20 client.4239.objecter shutdown clearing up homeless session... 2021-02-24T15:16:15.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 10 client.4239.objecter successfully canceled tick 2021-02-24T15:16:15.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 >> v1:172.21.15.181:6812/33484 conn(0x7fca440315a0 legacy=0x7fca44033a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 >> v1:172.21.15.152:6789/0 conn(0x7fca64067e70 legacy=0x7fca64142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 shutdown_connections 2021-02-24T15:16:15.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 >> 172.21.15.152:0/2994900010 conn(0x7fca6409a940 msgr2=0x7fca641244f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:15.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 shutdown_connections 2021-02-24T15:16:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 1 -- 172.21.15.152:0/2994900010 wait complete. 2021-02-24T15:16:15.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.773+0000 7fca6acc7700 1 librados: shutdown 2021-02-24T15:16:15.787 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-02-24T15:16:15.788 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-24T15:16:15.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.903+0000 7ff86faf1700 1 Processor -- start 2021-02-24T15:16:15.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.903+0000 7ff86faf1700 1 -- start start 2021-02-24T15:16:15.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.904+0000 7ff86faf1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff868097d40 con 0x7ff868099340 2021-02-24T15:16:15.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.904+0000 7ff86faf1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff868063d00 con 0x7ff868062da0 2021-02-24T15:16:15.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.904+0000 7ff86faf1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff868097980 con 0x7ff868063220 2021-02-24T15:16:15.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.904+0000 7ff86e08e700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff868063220 0x7ff868133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34430/0 (socket says 172.21.15.152:34430) 2021-02-24T15:16:15.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.904+0000 7ff86d88d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff868099340 0x7ff868097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45954/0 (socket says 172.21.15.152:45954) 2021-02-24T15:16:15.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.904+0000 7ff86e08e700 1 -- 172.21.15.152:0/4064970675 learned_addr learned my addr 172.21.15.152:0/4064970675 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:15.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.906+0000 7ff86d88d700 1 -- 172.21.15.152:0/4064970675 >> v1:172.21.15.152:6789/0 conn(0x7ff868099340 legacy=0x7ff868097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.906+0000 7ff86e08e700 1 -- 172.21.15.152:0/4064970675 >> v1:172.21.15.152:6790/0 conn(0x7ff868063220 legacy=0x7ff868133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.906+0000 7ff86d08c700 1 -- 172.21.15.152:0/4064970675 >> v1:172.21.15.181:6789/0 conn(0x7ff868062da0 legacy=0x7ff86812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.906+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583601396 0 0) 0x7ff868097d40 con 0x7ff868099340 2021-02-24T15:16:15.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.906+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff850003230 con 0x7ff868099340 2021-02-24T15:16:15.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.906+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230447927 0 0) 0x7ff868097980 con 0x7ff868063220 2021-02-24T15:16:15.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.906+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff868097d40 con 0x7ff868063220 2021-02-24T15:16:15.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3539846790 0 0) 0x7ff868097d40 con 0x7ff868063220 2021-02-24T15:16:15.932 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 >> v1:172.21.15.181:6789/0 conn(0x7ff868062da0 legacy=0x7ff86812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.932 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 >> v1:172.21.15.152:6789/0 conn(0x7ff868099340 legacy=0x7ff868097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.933 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86808fac0 con 0x7ff868063220 2021-02-24T15:16:15.933 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff860001cb0 con 0x7ff868063220 2021-02-24T15:16:15.933 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff860001fc0 con 0x7ff868063220 2021-02-24T15:16:15.934 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86c88b700 1 -- 172.21.15.152:0/4064970675 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff860004ad0 con 0x7ff868063220 2021-02-24T15:16:15.934 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86faf1700 1 -- 172.21.15.152:0/4064970675 >> v1:172.21.15.152:6790/0 conn(0x7ff868063220 legacy=0x7ff868133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.935 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86faf1700 1 -- 172.21.15.152:0/4064970675 shutdown_connections 2021-02-24T15:16:15.935 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86faf1700 1 -- 172.21.15.152:0/4064970675 >> 172.21.15.152:0/4064970675 conn(0x7ff86809dcc0 msgr2=0x7ff86809e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:15.935 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86faf1700 1 -- 172.21.15.152:0/4064970675 shutdown_connections 2021-02-24T15:16:15.936 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.907+0000 7ff86faf1700 1 -- 172.21.15.152:0/4064970675 wait complete. 2021-02-24T15:16:15.936 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.908+0000 7ff86faf1700 1 librados: starting msgr at 2021-02-24T15:16:15.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.908+0000 7ff86faf1700 1 librados: starting objecter 2021-02-24T15:16:15.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.908+0000 7ff86faf1700 1 Processor -- start 2021-02-24T15:16:15.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.908+0000 7ff86faf1700 1 -- start start 2021-02-24T15:16:15.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.908+0000 7ff86faf1700 1 librados: setting wanted keys 2021-02-24T15:16:15.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.908+0000 7ff86faf1700 1 librados: calling monclient init 2021-02-24T15:16:15.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.909+0000 7ff86faf1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86812a4c0 con 0x7ff868062da0 2021-02-24T15:16:15.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.909+0000 7ff86faf1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86812c550 con 0x7ff868099340 2021-02-24T15:16:15.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.909+0000 7ff86faf1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8680998b0 con 0x7ff868063220 2021-02-24T15:16:15.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.909+0000 7ff86d88d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff868062da0 0x7ff868133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45958/0 (socket says 172.21.15.152:45958) 2021-02-24T15:16:15.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.909+0000 7ff86d88d700 1 -- 172.21.15.152:0/1233332958 learned_addr learned my addr 172.21.15.152:0/1233332958 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:15.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff86d88d700 1 -- 172.21.15.152:0/1233332958 >> v1:172.21.15.152:6789/0 conn(0x7ff868062da0 legacy=0x7ff868133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff86d08c700 1 -- 172.21.15.152:0/1233332958 >> v1:172.21.15.152:6790/0 conn(0x7ff868063220 legacy=0x7ff86813eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 10 client.?.objecter ms_handle_connect 0x7ff868062da0 2021-02-24T15:16:15.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:15.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 10 client.?.objecter ms_handle_connect 0x7ff868063220 2021-02-24T15:16:15.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:15.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244618398 0 0) 0x7ff86812a4c0 con 0x7ff868062da0 2021-02-24T15:16:15.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff848004bd0 con 0x7ff868062da0 2021-02-24T15:16:15.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185424879 0 0) 0x7ff8680998b0 con 0x7ff868063220 2021-02-24T15:16:15.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff86812a4c0 con 0x7ff868063220 2021-02-24T15:16:15.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 10 client.?.objecter ms_handle_connect 0x7ff868099340 2021-02-24T15:16:15.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:15.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff86e08e700 1 -- 172.21.15.152:0/1233332958 >> v1:172.21.15.181:6789/0 conn(0x7ff868099340 legacy=0x7ff868142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:15.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 229474420 0 0) 0x7ff848004bd0 con 0x7ff868062da0 2021-02-24T15:16:15.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8680998b0 con 0x7ff868062da0 2021-02-24T15:16:15.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1978374238 0 0) 0x7ff86812a4c0 con 0x7ff868063220 2021-02-24T15:16:15.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff848004bd0 con 0x7ff868063220 2021-02-24T15:16:15.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff8640044f0 con 0x7ff868062da0 2021-02-24T15:16:15.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff858001bc0 con 0x7ff868063220 2021-02-24T15:16:15.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852016640 0 0) 0x7ff86812c550 con 0x7ff868099340 2021-02-24T15:16:15.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff86812a4c0 con 0x7ff868099340 2021-02-24T15:16:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2860731641 0 0) 0x7ff8680998b0 con 0x7ff868062da0 2021-02-24T15:16:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 >> v1:172.21.15.152:6790/0 conn(0x7ff868063220 legacy=0x7ff86813eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 >> v1:172.21.15.181:6789/0 conn(0x7ff868099340 legacy=0x7ff868142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:15.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8681263b0 con 0x7ff868062da0 2021-02-24T15:16:15.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.911+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86812aec0 con 0x7ff868062da0 2021-02-24T15:16:15.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff8640049f0 con 0x7ff868062da0 2021-02-24T15:16:15.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff864004d00 con 0x7ff868062da0 2021-02-24T15:16:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff86faf1700 10 client.4245.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff868135330 con 0x7ff868062da0 2021-02-24T15:16:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff86faf1700 1 librados: init done 2021-02-24T15:16:15.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff86400d900 con 0x7ff868062da0 2021-02-24T15:16:15.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7ff86403aa20 con 0x7ff868062da0 2021-02-24T15:16:15.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff855ffb700 10 client.4245.objecter ms_dispatch 0x7ff868001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:15.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff855ffb700 3 client.4245.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:15.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.912+0000 7ff855ffb700 3 client.4245.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.913+0000 7ff855ffb700 20 client.4245.objecter dump_active .. 0 homeless 2021-02-24T15:16:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.913+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff868058400 con 0x7ff868062da0 2021-02-24T15:16:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.915+0000 7ff855ffb700 10 client.4245.objecter ms_handle_connect 0x7ff848031630 2021-02-24T15:16:15.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:15.917+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7ff864012860 con 0x7ff868062da0 2021-02-24T15:16:16.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.088+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff868044c90 con 0x7ff868062da0 2021-02-24T15:16:16.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.088+0000 7ff855ffb700 1 -- 172.21.15.152:0/1233332958 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10026 (unknown 4221056075 0 1209689785) 0x7ff864012450 con 0x7ff868062da0 2021-02-24T15:16:16.090 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:16.090 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":15,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","created":"2021-02-24T15:16:02.232967+0000","modified":"2021-02-24T15:16:15.137619+0000","last_up_change":"2021-02-24T15:16:11.121140+0000","last_in_change":"2021-02-24T15:16:11.121140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-24T15:16:11.157287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-24T15:16:12.361586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a72c3535-e891-4444-bf97-dc6fae0ad363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6801","nonce":33735}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6803","nonce":33735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6807","nonce":33735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6805","nonce":33735}]},"public_addr":"172.21.15.152:6801/33735","cluster_addr":"172.21.15.152:6803/33735","heartbeat_back_addr":"172.21.15.152:6807/33735","heartbeat_front_addr":"172.21.15.152:6805/33735","state":["exists","up"]},{"osd":1,"uuid":"008b3230-90b6-4bee-8218-c422a983151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6800","nonce":33736}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6802","nonce":33736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6806","nonce":33736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6804","nonce":33736}]},"public_addr":"172.21.15.152:6800/33736","cluster_addr":"172.21.15.152:6802/33736","heartbeat_back_addr":"172.21.15.152:6806/33736","heartbeat_front_addr":"172.21.15.152:6804/33736","state":["exists","up"]},{"osd":2,"uuid":"b91de7c8-a67a-45d6-8643-8578d6b60c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6808","nonce":33737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6809","nonce":33737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6811","nonce":33737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6810","nonce":33737}]},"public_addr":"172.21.15.152:6808/33737","cluster_addr":"172.21.15.152:6809/33737","heartbeat_back_addr":"172.21.15.152:6811/33737","heartbeat_front_addr":"172.21.15.152:6810/33737","state":["exists","up"]},{"osd":3,"uuid":"cc030322-1a40-4f32-9ea3-48d755deaca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":33937}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":33937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":33937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":33937}]},"public_addr":"172.21.15.181:6801/33937","cluster_addr":"172.21.15.181:6803/33937","heartbeat_back_addr":"172.21.15.181:6807/33937","heartbeat_front_addr":"172.21.15.181:6805/33937","state":["exists","up"]},{"osd":4,"uuid":"3022f9f3-8ca8-403a-863a-41c661302f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":33938}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":33938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":33938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":33938}]},"public_addr":"172.21.15.181:6800/33938","cluster_addr":"172.21.15.181:6802/33938","heartbeat_back_addr":"172.21.15.181:6806/33938","heartbeat_front_addr":"172.21.15.181:6804/33938","state":["exists","up"]},{"osd":5,"uuid":"a6762546-97f4-409d-bebb-411eb5fba3db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":33963}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":33963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":33963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":33963}]},"public_addr":"172.21.15.181:6808/33963","cluster_addr":"172.21.15.181:6809/33963","heartbeat_back_addr":"172.21.15.181:6811/33963","heartbeat_front_addr":"172.21.15.181:6810/33963","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.364038+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.333681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.341529+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.302404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.368253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.356384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-24T15:16:16.091 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 10 librados: watch_flush enter 2021-02-24T15:16:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 10 librados: watch_flush exit 2021-02-24T15:16:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 20 client.4245.objecter shutdown clearing up homeless session... 2021-02-24T15:16:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 10 client.4245.objecter successfully canceled tick 2021-02-24T15:16:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 >> v1:172.21.15.181:6812/33484 conn(0x7ff848031630 legacy=0x7ff848033af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 >> v1:172.21.15.152:6789/0 conn(0x7ff868062da0 legacy=0x7ff868133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 shutdown_connections 2021-02-24T15:16:16.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 >> 172.21.15.152:0/1233332958 conn(0x7ff86809dcc0 msgr2=0x7ff86809c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.096 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 shutdown_connections 2021-02-24T15:16:16.096 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 1 -- 172.21.15.152:0/1233332958 wait complete. 2021-02-24T15:16:16.097 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.090+0000 7ff86faf1700 1 librados: shutdown 2021-02-24T15:16:16.109 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-02-24T15:16:16.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.226+0000 7f0118641700 1 Processor -- start 2021-02-24T15:16:16.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.226+0000 7f0118641700 1 -- start start 2021-02-24T15:16:16.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.226+0000 7f0118641700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0110062660 con 0x7f0110068410 2021-02-24T15:16:16.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.226+0000 7f0118641700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0110063af0 con 0x7f0110095bb0 2021-02-24T15:16:16.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.226+0000 7f0118641700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0110063d90 con 0x7f01100966a0 2021-02-24T15:16:16.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.226+0000 7f01163dd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f01100966a0 0x7f0110096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34444/0 (socket says 172.21.15.152:34444) 2021-02-24T15:16:16.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.226+0000 7f01163dd700 1 -- 172.21.15.152:0/253684334 learned_addr learned my addr 172.21.15.152:0/253684334 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01163dd700 1 -- 172.21.15.152:0/253684334 >> v1:172.21.15.152:6790/0 conn(0x7f01100966a0 legacy=0x7f0110096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f0116bde700 1 -- 172.21.15.152:0/253684334 >> v1:172.21.15.152:6789/0 conn(0x7f0110068410 legacy=0x7f0110133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296403209 0 0) 0x7f0110063d90 con 0x7f01100966a0 2021-02-24T15:16:16.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f0115bdc700 1 -- 172.21.15.152:0/253684334 >> v1:172.21.15.181:6789/0 conn(0x7f0110095bb0 legacy=0x7f0110130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f8003230 con 0x7f01100966a0 2021-02-24T15:16:16.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442215620 0 0) 0x7f0110062660 con 0x7f0110068410 2021-02-24T15:16:16.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0110063d90 con 0x7f0110068410 2021-02-24T15:16:16.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993535043 0 0) 0x7f0110063af0 con 0x7f0110095bb0 2021-02-24T15:16:16.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0110062660 con 0x7f0110095bb0 2021-02-24T15:16:16.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1683210775 0 0) 0x7f0110063d90 con 0x7f0110068410 2021-02-24T15:16:16.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 >> v1:172.21.15.152:6790/0 conn(0x7f01100966a0 legacy=0x7f0110096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 >> v1:172.21.15.181:6789/0 conn(0x7f0110095bb0 legacy=0x7f0110130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.239 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0110064030 con 0x7f0110068410 2021-02-24T15:16:16.239 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0108001d00 con 0x7f0110068410 2021-02-24T15:16:16.239 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0108002010 con 0x7f0110068410 2021-02-24T15:16:16.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.229+0000 7f01153db700 1 -- 172.21.15.152:0/253684334 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f01080023e0 con 0x7f0110068410 2021-02-24T15:16:16.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.230+0000 7f0118641700 1 -- 172.21.15.152:0/253684334 >> v1:172.21.15.152:6789/0 conn(0x7f0110068410 legacy=0x7f0110133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.230+0000 7f0118641700 1 -- 172.21.15.152:0/253684334 shutdown_connections 2021-02-24T15:16:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.230+0000 7f0118641700 1 -- 172.21.15.152:0/253684334 >> 172.21.15.152:0/253684334 conn(0x7f011009ba40 msgr2=0x7f011009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.230+0000 7f0118641700 1 -- 172.21.15.152:0/253684334 shutdown_connections 2021-02-24T15:16:16.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.230+0000 7f0118641700 1 -- 172.21.15.152:0/253684334 wait complete. 2021-02-24T15:16:16.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.230+0000 7f0118641700 1 librados: starting msgr at 2021-02-24T15:16:16.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.230+0000 7f0118641700 1 librados: starting objecter 2021-02-24T15:16:16.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.231+0000 7f0118641700 1 Processor -- start 2021-02-24T15:16:16.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.231+0000 7f0118641700 1 -- start start 2021-02-24T15:16:16.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.231+0000 7f0118641700 1 librados: setting wanted keys 2021-02-24T15:16:16.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.231+0000 7f0118641700 1 librados: calling monclient init 2021-02-24T15:16:16.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.231+0000 7f0118641700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0110063010 con 0x7f0110068410 2021-02-24T15:16:16.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.231+0000 7f0118641700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011011acf0 con 0x7f01100966a0 2021-02-24T15:16:16.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.231+0000 7f0118641700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01100674d0 con 0x7f0110095bb0 2021-02-24T15:16:16.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.231+0000 7f01163dd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0110068410 0x7f011013a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45972/0 (socket says 172.21.15.152:45972) 2021-02-24T15:16:16.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.231+0000 7f01163dd700 1 -- 172.21.15.152:0/2880172233 learned_addr learned my addr 172.21.15.152:0/2880172233 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f01163dd700 1 -- 172.21.15.152:0/2880172233 >> v1:172.21.15.152:6789/0 conn(0x7f0110068410 legacy=0x7f011013a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 10 client.?.objecter ms_handle_connect 0x7f0110068410 2021-02-24T15:16:16.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 10 client.?.objecter ms_handle_connect 0x7f0110095bb0 2021-02-24T15:16:16.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f0115bdc700 1 -- 172.21.15.152:0/2880172233 >> v1:172.21.15.152:6790/0 conn(0x7f0110095bb0 legacy=0x7f0110133de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478194683 0 0) 0x7f0110063010 con 0x7f0110068410 2021-02-24T15:16:16.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f0004bd0 con 0x7f0110068410 2021-02-24T15:16:16.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977650990 0 0) 0x7f01100674d0 con 0x7f0110095bb0 2021-02-24T15:16:16.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0110063010 con 0x7f0110095bb0 2021-02-24T15:16:16.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 10 client.?.objecter ms_handle_connect 0x7f01100966a0 2021-02-24T15:16:16.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f00fe7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.233+0000 7f0116bde700 1 -- 172.21.15.152:0/2880172233 >> v1:172.21.15.181:6789/0 conn(0x7f01100966a0 legacy=0x7f01101421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3605048445 0 0) 0x7f0110063010 con 0x7f0110095bb0 2021-02-24T15:16:16.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f01100674d0 con 0x7f0110095bb0 2021-02-24T15:16:16.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 866626154 0 0) 0x7f00f0004bd0 con 0x7f0110068410 2021-02-24T15:16:16.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0110063010 con 0x7f0110068410 2021-02-24T15:16:16.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0100001c20 con 0x7f0110095bb0 2021-02-24T15:16:16.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454438008 0 0) 0x7f011011acf0 con 0x7f01100966a0 2021-02-24T15:16:16.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f0004bd0 con 0x7f01100966a0 2021-02-24T15:16:16.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f010c001c60 con 0x7f0110068410 2021-02-24T15:16:16.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2600061860 0 0) 0x7f01100674d0 con 0x7f0110095bb0 2021-02-24T15:16:16.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 >> v1:172.21.15.181:6789/0 conn(0x7f01100966a0 legacy=0x7f01101421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 >> v1:172.21.15.152:6789/0 conn(0x7f0110068410 legacy=0x7f011013a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01101344f0 con 0x7f0110095bb0 2021-02-24T15:16:16.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011011a2f0 con 0x7f0110095bb0 2021-02-24T15:16:16.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f0118641700 10 client.4247.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:16.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0110118cb0 con 0x7f0110095bb0 2021-02-24T15:16:16.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f0118641700 1 librados: init done 2021-02-24T15:16:16.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f01000021f0 con 0x7f0110095bb0 2021-02-24T15:16:16.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.234+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0100002500 con 0x7f0110095bb0 2021-02-24T15:16:16.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f0100002720 con 0x7f0110095bb0 2021-02-24T15:16:16.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f010003a920 con 0x7f0110095bb0 2021-02-24T15:16:16.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f00fe7fc700 10 client.4247.objecter ms_dispatch 0x7f0110001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:16.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f00fe7fc700 3 client.4247.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:16.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f00fe7fc700 3 client.4247.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:16.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f00fe7fc700 20 client.4247.objecter dump_active .. 0 homeless 2021-02-24T15:16:16.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 10 client.4247.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-24T15:16:16.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 15 client.4247.objecter _session_command_op_assign -1 1 2021-02-24T15:16:16.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 20 client.4247.objecter _get_session s=0x7f00f4002830 osd=0 3 2021-02-24T15:16:16.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 20 client.4247.objecter put_session s=0x7f00f4002830 osd=0 3 2021-02-24T15:16:16.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 20 client.4247.objecter _get_session s=0x7f00f4002830 osd=0 3 2021-02-24T15:16:16.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 15 client.4247.objecter _session_command_op_remove -1 1 2021-02-24T15:16:16.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 20 client.4247.objecter get_session s=0x7f00f4002830 osd=0 3 2021-02-24T15:16:16.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 15 client.4247.objecter _session_command_op_assign 0 1 2021-02-24T15:16:16.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 20 client.4247.objecter put_session s=0x7f00f4002830 osd=0 4 2021-02-24T15:16:16.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 10 client.4247.objecter _send_command 1 2021-02-24T15:16:16.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.235+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.152:6801/33735 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00f4006c90 con 0x7f00f4002f20 2021-02-24T15:16:16.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.237+0000 7f00fe7fc700 10 client.4247.objecter ms_handle_connect 0x7f00f00316c0 2021-02-24T15:16:16.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.240+0000 7f00fe7fc700 10 client.4247.objecter ms_handle_connect 0x7f00f4002f20 2021-02-24T15:16:16.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.240+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== osd.0 v1:172.21.15.152:6801/33735 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f00f4006c90 con 0x7f00f4002f20 2021-02-24T15:16:16.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.240+0000 7f00fe7fc700 10 client.4247.objecter ms_dispatch 0x7f0110001510 command_reply(tid 1: 0 ) v1 2021-02-24T15:16:16.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.240+0000 7f00fe7fc700 10 client.4247.objecter _finish_command 1 = system:0 2021-02-24T15:16:16.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.240+0000 7f00fe7fc700 20 client.4247.objecter put_session s=0x7f00f4002830 osd=0 4 2021-02-24T15:16:16.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.240+0000 7f00fe7fc700 15 client.4247.objecter _session_command_op_remove 0 1 2021-02-24T15:16:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 10 client.4247.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-24T15:16:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 15 client.4247.objecter _session_command_op_assign -1 2 2021-02-24T15:16:16.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 20 client.4247.objecter _get_session s=0x7f00f4002830 osd=0 3 2021-02-24T15:16:16.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 20 client.4247.objecter put_session s=0x7f00f4002830 osd=0 3 2021-02-24T15:16:16.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 20 client.4247.objecter _get_session s=0x7f00f4002830 osd=0 3 2021-02-24T15:16:16.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 15 client.4247.objecter _session_command_op_remove -1 2 2021-02-24T15:16:16.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 20 client.4247.objecter get_session s=0x7f00f4002830 osd=0 3 2021-02-24T15:16:16.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 15 client.4247.objecter _session_command_op_assign 0 2 2021-02-24T15:16:16.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 20 client.4247.objecter put_session s=0x7f00f4002830 osd=0 4 2021-02-24T15:16:16.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 10 client.4247.objecter _send_command 2 2021-02-24T15:16:16.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.256+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 --> v1:172.21.15.152:6801/33735 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f00f4001120 con 0x7f00f4002f20 2021-02-24T15:16:16.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f00fe7fc700 1 -- 172.21.15.152:0/2880172233 <== osd.0 v1:172.21.15.152:6801/33735 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1800444376) 0x7f00f4001120 con 0x7f00f4002f20 2021-02-24T15:16:16.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f00fe7fc700 10 client.4247.objecter ms_dispatch 0x7f0110001510 command_reply(tid 2: 0 ) v1 2021-02-24T15:16:16.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f00fe7fc700 10 client.4247.objecter _finish_command 2 = system:0 2021-02-24T15:16:16.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f00fe7fc700 20 client.4247.objecter put_session s=0x7f00f4002830 osd=0 4 2021-02-24T15:16:16.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f00fe7fc700 15 client.4247.objecter _session_command_op_remove 0 2 2021-02-24T15:16:16.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 10 librados: watch_flush enter 2021-02-24T15:16:16.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 10 librados: watch_flush exit 2021-02-24T15:16:16.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 10 client.4247.objecter close_session for osd.0 2021-02-24T15:16:16.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 >> v1:172.21.15.152:6801/33735 conn(0x7f00f4002f20 legacy=0x7f00f40053e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 20 client.4247.objecter put_session s=0x7f00f4002830 osd=0 1 2021-02-24T15:16:16.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 20 client.4247.objecter shutdown clearing up homeless session... 2021-02-24T15:16:16.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 10 client.4247.objecter successfully canceled tick 2021-02-24T15:16:16.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 >> v1:172.21.15.181:6812/33484 conn(0x7f00f00316c0 legacy=0x7f00f0033b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 >> v1:172.21.15.152:6790/0 conn(0x7f0110095bb0 legacy=0x7f0110133de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0116bde700 1 -- 172.21.15.152:0/2880172233 reap_dead start 2021-02-24T15:16:16.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 shutdown_connections 2021-02-24T15:16:16.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 >> 172.21.15.152:0/2880172233 conn(0x7f011009ba40 msgr2=0x7f01101120a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 shutdown_connections 2021-02-24T15:16:16.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 1 -- 172.21.15.152:0/2880172233 wait complete. 2021-02-24T15:16:16.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.257+0000 7f0118641700 1 librados: shutdown 2021-02-24T15:16:16.279 INFO:teuthology.orchestra.run.smithi152.stdout:47244640259 2021-02-24T15:16:16.280 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-02-24T15:16:16.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.396+0000 7f89b5328700 1 Processor -- start 2021-02-24T15:16:16.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.396+0000 7f89b5328700 1 -- start start 2021-02-24T15:16:16.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.397+0000 7f89b5328700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0097d40 con 0x7f89b0062da0 2021-02-24T15:16:16.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.397+0000 7f89b5328700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0063d00 con 0x7f89b0099340 2021-02-24T15:16:16.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.397+0000 7f89b5328700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0097980 con 0x7f89b0063220 2021-02-24T15:16:16.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.397+0000 7f89af7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f89b0063220 0x7f89b0133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34458/0 (socket says 172.21.15.152:34458) 2021-02-24T15:16:16.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.397+0000 7f89af7fe700 1 -- 172.21.15.152:0/2844060807 learned_addr learned my addr 172.21.15.152:0/2844060807 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.397+0000 7f89ae7fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f89b0062da0 0x7f89b012fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:45986/0 (socket says 172.21.15.152:45986) 2021-02-24T15:16:16.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89ae7fc700 1 -- 172.21.15.152:0/2844060807 >> v1:172.21.15.152:6789/0 conn(0x7f89b0062da0 legacy=0x7f89b012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89af7fe700 1 -- 172.21.15.152:0/2844060807 >> v1:172.21.15.152:6790/0 conn(0x7f89b0063220 legacy=0x7f89b0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89aeffd700 1 -- 172.21.15.152:0/2844060807 >> v1:172.21.15.181:6789/0 conn(0x7f89b0099340 legacy=0x7f89b0097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313289390 0 0) 0x7f89b0097980 con 0x7f89b0063220 2021-02-24T15:16:16.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f899c003230 con 0x7f89b0063220 2021-02-24T15:16:16.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135453043 0 0) 0x7f89b0097d40 con 0x7f89b0062da0 2021-02-24T15:16:16.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b0097980 con 0x7f89b0062da0 2021-02-24T15:16:16.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3593337854 0 0) 0x7f899c003230 con 0x7f89b0063220 2021-02-24T15:16:16.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 >> v1:172.21.15.181:6789/0 conn(0x7f89b0099340 legacy=0x7f89b0097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.399+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 >> v1:172.21.15.152:6789/0 conn(0x7f89b0062da0 legacy=0x7f89b012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.400+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b008fac0 con 0x7f89b0063220 2021-02-24T15:16:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.400+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89a8001ca0 con 0x7f89b0063220 2021-02-24T15:16:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.400+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f89a8001ed0 con 0x7f89b0063220 2021-02-24T15:16:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.400+0000 7f89adffb700 1 -- 172.21.15.152:0/2844060807 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89a8004930 con 0x7f89b0063220 2021-02-24T15:16:16.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.400+0000 7f89b5328700 1 -- 172.21.15.152:0/2844060807 >> v1:172.21.15.152:6790/0 conn(0x7f89b0063220 legacy=0x7f89b0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.400+0000 7f89b5328700 1 -- 172.21.15.152:0/2844060807 shutdown_connections 2021-02-24T15:16:16.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.400+0000 7f89b5328700 1 -- 172.21.15.152:0/2844060807 >> 172.21.15.152:0/2844060807 conn(0x7f89b009dcc0 msgr2=0x7f89b009e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.400+0000 7f89b5328700 1 -- 172.21.15.152:0/2844060807 shutdown_connections 2021-02-24T15:16:16.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.400+0000 7f89b5328700 1 -- 172.21.15.152:0/2844060807 wait complete. 2021-02-24T15:16:16.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.401+0000 7f89b5328700 1 librados: starting msgr at 2021-02-24T15:16:16.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.401+0000 7f89b5328700 1 librados: starting objecter 2021-02-24T15:16:16.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.401+0000 7f89b5328700 1 Processor -- start 2021-02-24T15:16:16.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.401+0000 7f89b5328700 1 -- start start 2021-02-24T15:16:16.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.401+0000 7f89b5328700 1 librados: setting wanted keys 2021-02-24T15:16:16.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.401+0000 7f89b5328700 1 librados: calling monclient init 2021-02-24T15:16:16.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.401+0000 7f89b5328700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0095780 con 0x7f89b0099340 2021-02-24T15:16:16.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.401+0000 7f89b5328700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0095a20 con 0x7f89b0062da0 2021-02-24T15:16:16.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.401+0000 7f89b5328700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b00998b0 con 0x7f89b0063220 2021-02-24T15:16:16.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.402+0000 7f89ae7fc700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f89b0063220 0x7f89b0133ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34466/0 (socket says 172.21.15.152:34466) 2021-02-24T15:16:16.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.402+0000 7f89ae7fc700 1 -- 172.21.15.152:0/4089432863 learned_addr learned my addr 172.21.15.152:0/4089432863 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f89af7fe700 1 -- 172.21.15.152:0/4089432863 >> v1:172.21.15.152:6789/0 conn(0x7f89b0099340 legacy=0x7f89b01423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 10 client.?.objecter ms_handle_connect 0x7f89b0099340 2021-02-24T15:16:16.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f89ae7fc700 1 -- 172.21.15.152:0/4089432863 >> v1:172.21.15.152:6790/0 conn(0x7f89b0063220 legacy=0x7f89b0133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 10 client.?.objecter ms_handle_connect 0x7f89b0063220 2021-02-24T15:16:16.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791120905 0 0) 0x7f89b0095780 con 0x7f89b0099340 2021-02-24T15:16:16.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8990004bd0 con 0x7f89b0099340 2021-02-24T15:16:16.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904602403 0 0) 0x7f89b00998b0 con 0x7f89b0063220 2021-02-24T15:16:16.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b0095780 con 0x7f89b0063220 2021-02-24T15:16:16.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f89aeffd700 1 -- 172.21.15.152:0/4089432863 >> v1:172.21.15.181:6789/0 conn(0x7f89b0062da0 legacy=0x7f89b01337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 10 client.?.objecter ms_handle_connect 0x7f89b0062da0 2021-02-24T15:16:16.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180989596 0 0) 0x7f89b0095a20 con 0x7f89b0062da0 2021-02-24T15:16:16.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b00998b0 con 0x7f89b0062da0 2021-02-24T15:16:16.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3965000358 0 0) 0x7f89b0095780 con 0x7f89b0063220 2021-02-24T15:16:16.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89b0095a20 con 0x7f89b0063220 2021-02-24T15:16:16.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3582796550 0 0) 0x7f8990004bd0 con 0x7f89b0099340 2021-02-24T15:16:16.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89b0095780 con 0x7f89b0099340 2021-02-24T15:16:16.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89a4001d40 con 0x7f89b0063220 2021-02-24T15:16:16.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89a8004870 con 0x7f89b0099340 2021-02-24T15:16:16.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1389732985 0 0) 0x7f89b00998b0 con 0x7f89b0062da0 2021-02-24T15:16:16.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8990004bd0 con 0x7f89b0062da0 2021-02-24T15:16:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89a0001b60 con 0x7f89b0062da0 2021-02-24T15:16:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1748803104 0 0) 0x7f89b0095a20 con 0x7f89b0063220 2021-02-24T15:16:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 >> v1:172.21.15.181:6789/0 conn(0x7f89b0062da0 legacy=0x7f89b01337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 >> v1:172.21.15.152:6789/0 conn(0x7f89b0099340 legacy=0x7f89b01423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00938b0 con 0x7f89b0063220 2021-02-24T15:16:16.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.404+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b0092d60 con 0x7f89b0063220 2021-02-24T15:16:16.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f89b5328700 10 client.4253.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:16.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b0096300 con 0x7f89b0063220 2021-02-24T15:16:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f89b5328700 1 librados: init done 2021-02-24T15:16:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f89a4004960 con 0x7f89b0063220 2021-02-24T15:16:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89a4004c70 con 0x7f89b0063220 2021-02-24T15:16:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f89a400d770 con 0x7f89b0063220 2021-02-24T15:16:16.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f89b5328700 10 client.4253.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-24T15:16:16.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f89b5328700 15 client.4253.objecter _session_command_op_assign -1 1 2021-02-24T15:16:16.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f89b5328700 20 client.4253.objecter _get_session osd=-1 returning homeless 2021-02-24T15:16:16.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f89b5328700 10 client.4253.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:16.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8988002870 con 0x7f89b0063220 2021-02-24T15:16:16.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f89a403a9d0 con 0x7f89b0063220 2021-02-24T15:16:16.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 10 client.4253.objecter ms_dispatch 0x7f89b0001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:16.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 3 client.4253.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:16.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 3 client.4253.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 10 client.4253.objecter checking command 1 2021-02-24T15:16:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 20 client.4253.objecter _get_session s=0x7f8990037ea0 osd=1 3 2021-02-24T15:16:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 20 client.4253.objecter put_session s=0x7f8990037ea0 osd=1 3 2021-02-24T15:16:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 15 client.4253.objecter _session_command_op_remove -1 1 2021-02-24T15:16:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 20 client.4253.objecter _get_session s=0x7f8990037ea0 osd=1 3 2021-02-24T15:16:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 20 client.4253.objecter get_session s=0x7f8990037ea0 osd=1 3 2021-02-24T15:16:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 15 client.4253.objecter _session_command_op_assign 1 1 2021-02-24T15:16:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 20 client.4253.objecter put_session s=0x7f8990037ea0 osd=1 4 2021-02-24T15:16:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 10 client.4253.objecter _send_command 1 2021-02-24T15:16:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6800/33736 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f899003c220 con 0x7f8990038550 2021-02-24T15:16:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 20 client.4253.objecter dump_active .. 0 homeless 2021-02-24T15:16:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.405+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f89a40125e0 con 0x7f89b0063220 2021-02-24T15:16:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.408+0000 7f8996ffd700 10 client.4253.objecter ms_handle_connect 0x7f8990031750 2021-02-24T15:16:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.410+0000 7f8996ffd700 10 client.4253.objecter ms_handle_connect 0x7f8990038550 2021-02-24T15:16:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.411+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== osd.1 v1:172.21.15.152:6800/33736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f899003c220 con 0x7f8990038550 2021-02-24T15:16:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.411+0000 7f8996ffd700 10 client.4253.objecter ms_dispatch 0x7f89b0001510 command_reply(tid 1: 0 ) v1 2021-02-24T15:16:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.411+0000 7f8996ffd700 10 client.4253.objecter _finish_command 1 = system:0 2021-02-24T15:16:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.411+0000 7f8996ffd700 20 client.4253.objecter put_session s=0x7f8990037ea0 osd=1 4 2021-02-24T15:16:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.411+0000 7f8996ffd700 15 client.4253.objecter _session_command_op_remove 1 1 2021-02-24T15:16:16.449 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 10 client.4253.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-24T15:16:16.449 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 15 client.4253.objecter _session_command_op_assign -1 2 2021-02-24T15:16:16.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 20 client.4253.objecter _get_session s=0x7f8990037ea0 osd=1 3 2021-02-24T15:16:16.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 20 client.4253.objecter put_session s=0x7f8990037ea0 osd=1 3 2021-02-24T15:16:16.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 20 client.4253.objecter _get_session s=0x7f8990037ea0 osd=1 3 2021-02-24T15:16:16.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 15 client.4253.objecter _session_command_op_remove -1 2 2021-02-24T15:16:16.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 20 client.4253.objecter get_session s=0x7f8990037ea0 osd=1 3 2021-02-24T15:16:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 15 client.4253.objecter _session_command_op_assign 1 2 2021-02-24T15:16:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 20 client.4253.objecter put_session s=0x7f8990037ea0 osd=1 4 2021-02-24T15:16:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 10 client.4253.objecter _send_command 2 2021-02-24T15:16:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 --> v1:172.21.15.152:6800/33736 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8988001100 con 0x7f8990038550 2021-02-24T15:16:16.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f8996ffd700 1 -- 172.21.15.152:0/4089432863 <== osd.1 v1:172.21.15.152:6800/33736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1800444376) 0x7f8988001100 con 0x7f8990038550 2021-02-24T15:16:16.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f8996ffd700 10 client.4253.objecter ms_dispatch 0x7f89b0001510 command_reply(tid 2: 0 ) v1 2021-02-24T15:16:16.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f8996ffd700 10 client.4253.objecter _finish_command 2 = system:0 2021-02-24T15:16:16.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f8996ffd700 20 client.4253.objecter put_session s=0x7f8990037ea0 osd=1 4 2021-02-24T15:16:16.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.427+0000 7f8996ffd700 15 client.4253.objecter _session_command_op_remove 1 2 2021-02-24T15:16:16.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 10 librados: watch_flush enter 2021-02-24T15:16:16.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 10 librados: watch_flush exit 2021-02-24T15:16:16.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 10 client.4253.objecter close_session for osd.1 2021-02-24T15:16:16.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 >> v1:172.21.15.152:6800/33736 conn(0x7f8990038550 legacy=0x7f899003a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 20 client.4253.objecter put_session s=0x7f8990037ea0 osd=1 1 2021-02-24T15:16:16.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 20 client.4253.objecter shutdown clearing up homeless session... 2021-02-24T15:16:16.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 10 client.4253.objecter successfully canceled tick 2021-02-24T15:16:16.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 >> v1:172.21.15.181:6812/33484 conn(0x7f8990031750 legacy=0x7f8990033c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 >> v1:172.21.15.152:6790/0 conn(0x7f89b0063220 legacy=0x7f89b0133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89af7fe700 1 -- 172.21.15.152:0/4089432863 reap_dead start 2021-02-24T15:16:16.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 shutdown_connections 2021-02-24T15:16:16.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 >> 172.21.15.152:0/4089432863 conn(0x7f89b009dcc0 msgr2=0x7f89b009c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 shutdown_connections 2021-02-24T15:16:16.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 1 -- 172.21.15.152:0/4089432863 wait complete. 2021-02-24T15:16:16.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.428+0000 7f89b5328700 1 librados: shutdown 2021-02-24T15:16:16.456 INFO:teuthology.orchestra.run.smithi152.stdout:47244640259 2021-02-24T15:16:16.456 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-02-24T15:16:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.574+0000 7ff4f9ae5700 1 Processor -- start 2021-02-24T15:16:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.574+0000 7ff4f9ae5700 1 -- start start 2021-02-24T15:16:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.575+0000 7ff4f9ae5700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f4097d40 con 0x7ff4f4062da0 2021-02-24T15:16:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.575+0000 7ff4f9ae5700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f4063d00 con 0x7ff4f4099340 2021-02-24T15:16:16.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.575+0000 7ff4f9ae5700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f4097980 con 0x7ff4f4063220 2021-02-24T15:16:16.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.575+0000 7ff4f3fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff4f4063220 0x7ff4f4133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34476/0 (socket says 172.21.15.152:34476) 2021-02-24T15:16:16.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.575+0000 7ff4f2ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff4f4062da0 0x7ff4f412fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46002/0 (socket says 172.21.15.152:46002) 2021-02-24T15:16:16.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.575+0000 7ff4f3fff700 1 -- 172.21.15.152:0/178538413 learned_addr learned my addr 172.21.15.152:0/178538413 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.577+0000 7ff4f2ffd700 1 -- 172.21.15.152:0/178538413 >> v1:172.21.15.152:6789/0 conn(0x7ff4f4062da0 legacy=0x7ff4f412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.577+0000 7ff4f3fff700 1 -- 172.21.15.152:0/178538413 >> v1:172.21.15.152:6790/0 conn(0x7ff4f4063220 legacy=0x7ff4f4133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.577+0000 7ff4f37fe700 1 -- 172.21.15.152:0/178538413 >> v1:172.21.15.181:6789/0 conn(0x7ff4f4099340 legacy=0x7ff4f4097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364638849 0 0) 0x7ff4f4097980 con 0x7ff4f4063220 2021-02-24T15:16:16.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e0003230 con 0x7ff4f4063220 2021-02-24T15:16:16.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669136028 0 0) 0x7ff4f4097d40 con 0x7ff4f4062da0 2021-02-24T15:16:16.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f4097980 con 0x7ff4f4062da0 2021-02-24T15:16:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130931748 0 0) 0x7ff4f4063d00 con 0x7ff4f4099340 2021-02-24T15:16:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f4097d40 con 0x7ff4f4099340 2021-02-24T15:16:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 659623666 0 0) 0x7ff4e0003230 con 0x7ff4f4063220 2021-02-24T15:16:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 >> v1:172.21.15.181:6789/0 conn(0x7ff4f4099340 legacy=0x7ff4f4097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 >> v1:172.21.15.152:6789/0 conn(0x7ff4f4062da0 legacy=0x7ff4f412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f408fac0 con 0x7ff4f4063220 2021-02-24T15:16:16.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff4ec001cb0 con 0x7ff4f4063220 2021-02-24T15:16:16.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff4ec001fc0 con 0x7ff4f4063220 2021-02-24T15:16:16.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f27fc700 1 -- 172.21.15.152:0/178538413 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff4ec004ad0 con 0x7ff4f4063220 2021-02-24T15:16:16.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/178538413 >> v1:172.21.15.152:6790/0 conn(0x7ff4f4063220 legacy=0x7ff4f4133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/178538413 shutdown_connections 2021-02-24T15:16:16.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.578+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/178538413 >> 172.21.15.152:0/178538413 conn(0x7ff4f409dcc0 msgr2=0x7ff4f409e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.579+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/178538413 shutdown_connections 2021-02-24T15:16:16.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.579+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/178538413 wait complete. 2021-02-24T15:16:16.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.579+0000 7ff4f9ae5700 1 librados: starting msgr at 2021-02-24T15:16:16.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.579+0000 7ff4f9ae5700 1 librados: starting objecter 2021-02-24T15:16:16.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.580+0000 7ff4f9ae5700 1 Processor -- start 2021-02-24T15:16:16.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.580+0000 7ff4f9ae5700 1 -- start start 2021-02-24T15:16:16.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.580+0000 7ff4f9ae5700 1 librados: setting wanted keys 2021-02-24T15:16:16.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.580+0000 7ff4f9ae5700 1 librados: calling monclient init 2021-02-24T15:16:16.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.580+0000 7ff4f9ae5700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f412bee0 con 0x7ff4f4063220 2021-02-24T15:16:16.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.580+0000 7ff4f9ae5700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f412c180 con 0x7ff4f4099340 2021-02-24T15:16:16.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.580+0000 7ff4f9ae5700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f412c420 con 0x7ff4f4062da0 2021-02-24T15:16:16.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.580+0000 7ff4f37fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff4f4062da0 0x7ff4f4133930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34480/0 (socket says 172.21.15.152:34480) 2021-02-24T15:16:16.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.580+0000 7ff4f37fe700 1 -- 172.21.15.152:0/646453361 learned_addr learned my addr 172.21.15.152:0/646453361 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4f2ffd700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.152:6789/0 conn(0x7ff4f4063220 legacy=0x7ff4f413eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4f37fe700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.152:6790/0 conn(0x7ff4f4062da0 legacy=0x7ff4f4133930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 10 client.?.objecter ms_handle_connect 0x7ff4f4063220 2021-02-24T15:16:16.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 10 client.?.objecter ms_handle_connect 0x7ff4f4062da0 2021-02-24T15:16:16.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711555726 0 0) 0x7ff4f412bee0 con 0x7ff4f4063220 2021-02-24T15:16:16.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d4004bd0 con 0x7ff4f4063220 2021-02-24T15:16:16.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014125060 0 0) 0x7ff4f412c420 con 0x7ff4f4062da0 2021-02-24T15:16:16.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f412bee0 con 0x7ff4f4062da0 2021-02-24T15:16:16.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 10 client.?.objecter ms_handle_connect 0x7ff4f4099340 2021-02-24T15:16:16.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4db7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.582+0000 7ff4f3fff700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.181:6789/0 conn(0x7ff4f4099340 legacy=0x7ff4f4142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4160069641 0 0) 0x7ff4d4004bd0 con 0x7ff4f4063220 2021-02-24T15:16:16.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff4f412c420 con 0x7ff4f4063220 2021-02-24T15:16:16.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff4e8001c60 con 0x7ff4f4063220 2021-02-24T15:16:16.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3118176804 0 0) 0x7ff4f412bee0 con 0x7ff4f4062da0 2021-02-24T15:16:16.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4f2ffd700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.152:6789/0 conn(0x7ff4f4063220 legacy=0x7ff4f413eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-24T15:16:16.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4f2ffd700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.152:6789/0 conn(0x7ff4f4063220 legacy=0x7ff4f413eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:16:16.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4f2ffd700 1 --1- 172.21.15.152:0/646453361 >> v1:172.21.15.152:6789/0 conn(0x7ff4f4063220 0x7ff4f413eef0 :-1 s=OPENED pgs=86 cs=1 l=1).handle_message read tag failed 2021-02-24T15:16:16.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4f2ffd700 1 --1- 172.21.15.152:0/646453361 >> v1:172.21.15.152:6789/0 conn(0x7ff4f4063220 0x7ff4f413eef0 :-1 s=OPENED pgs=86 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:16:16.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff4d4004bd0 con 0x7ff4f4062da0 2021-02-24T15:16:16.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221343700 0 0) 0x7ff4f412c180 con 0x7ff4f4099340 2021-02-24T15:16:16.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f412bee0 con 0x7ff4f4099340 2021-02-24T15:16:16.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff4e4001bd0 con 0x7ff4f4062da0 2021-02-24T15:16:16.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2637230680 0 0) 0x7ff4d4004bd0 con 0x7ff4f4062da0 2021-02-24T15:16:16.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.181:6789/0 conn(0x7ff4f4099340 legacy=0x7ff4f4142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.152:6789/0 conn(0x7ff4f4063220 legacy=0x7ff4f413eef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:16.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f412a2b0 con 0x7ff4f4062da0 2021-02-24T15:16:16.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f4134040 con 0x7ff4f4062da0 2021-02-24T15:16:16.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4f9ae5700 10 client.4259.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:16.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f4135090 con 0x7ff4f4062da0 2021-02-24T15:16:16.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4f9ae5700 1 librados: init done 2021-02-24T15:16:16.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff4e4002170 con 0x7ff4f4062da0 2021-02-24T15:16:16.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.583+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff4e4002480 con 0x7ff4f4062da0 2021-02-24T15:16:16.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff4e40026a0 con 0x7ff4f4062da0 2021-02-24T15:16:16.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4f9ae5700 10 client.4259.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-24T15:16:16.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4f9ae5700 15 client.4259.objecter _session_command_op_assign -1 1 2021-02-24T15:16:16.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4f9ae5700 20 client.4259.objecter _get_session osd=-1 returning homeless 2021-02-24T15:16:16.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4f9ae5700 10 client.4259.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:16.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4cc002870 con 0x7ff4f4062da0 2021-02-24T15:16:16.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7ff4e403a820 con 0x7ff4f4062da0 2021-02-24T15:16:16.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 10 client.4259.objecter ms_dispatch 0x7ff4f4001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:16.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 3 client.4259.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:16.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 3 client.4259.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:16.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 10 client.4259.objecter checking command 1 2021-02-24T15:16:16.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 20 client.4259.objecter _get_session s=0x7ff4d4037f40 osd=2 3 2021-02-24T15:16:16.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 20 client.4259.objecter put_session s=0x7ff4d4037f40 osd=2 3 2021-02-24T15:16:16.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 15 client.4259.objecter _session_command_op_remove -1 1 2021-02-24T15:16:16.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 20 client.4259.objecter _get_session s=0x7ff4d4037f40 osd=2 3 2021-02-24T15:16:16.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 20 client.4259.objecter get_session s=0x7ff4d4037f40 osd=2 3 2021-02-24T15:16:16.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 15 client.4259.objecter _session_command_op_assign 2 1 2021-02-24T15:16:16.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 20 client.4259.objecter put_session s=0x7ff4d4037f40 osd=2 4 2021-02-24T15:16:16.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 10 client.4259.objecter _send_command 1 2021-02-24T15:16:16.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6808/33737 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4d403c2c0 con 0x7ff4d40385f0 2021-02-24T15:16:16.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 20 client.4259.objecter dump_active .. 0 homeless 2021-02-24T15:16:16.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.584+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7ff4e4002930 con 0x7ff4f4062da0 2021-02-24T15:16:16.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.586+0000 7ff4db7fe700 10 client.4259.objecter ms_handle_connect 0x7ff4d40316b0 2021-02-24T15:16:16.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.589+0000 7ff4db7fe700 10 client.4259.objecter ms_handle_connect 0x7ff4d40385f0 2021-02-24T15:16:16.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.589+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== osd.2 v1:172.21.15.152:6808/33737 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7ff4d403c2c0 con 0x7ff4d40385f0 2021-02-24T15:16:16.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.589+0000 7ff4db7fe700 10 client.4259.objecter ms_dispatch 0x7ff4f4001510 command_reply(tid 1: 0 ) v1 2021-02-24T15:16:16.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.589+0000 7ff4db7fe700 10 client.4259.objecter _finish_command 1 = system:0 2021-02-24T15:16:16.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.589+0000 7ff4db7fe700 20 client.4259.objecter put_session s=0x7ff4d4037f40 osd=2 4 2021-02-24T15:16:16.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.589+0000 7ff4db7fe700 15 client.4259.objecter _session_command_op_remove 2 1 2021-02-24T15:16:16.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.605+0000 7ff4f9ae5700 10 client.4259.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-24T15:16:16.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.605+0000 7ff4f9ae5700 15 client.4259.objecter _session_command_op_assign -1 2 2021-02-24T15:16:16.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.605+0000 7ff4f9ae5700 20 client.4259.objecter _get_session s=0x7ff4d4037f40 osd=2 3 2021-02-24T15:16:16.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.605+0000 7ff4f9ae5700 20 client.4259.objecter put_session s=0x7ff4d4037f40 osd=2 3 2021-02-24T15:16:16.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.605+0000 7ff4f9ae5700 20 client.4259.objecter _get_session s=0x7ff4d4037f40 osd=2 3 2021-02-24T15:16:16.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.605+0000 7ff4f9ae5700 15 client.4259.objecter _session_command_op_remove -1 2 2021-02-24T15:16:16.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.605+0000 7ff4f9ae5700 20 client.4259.objecter get_session s=0x7ff4d4037f40 osd=2 3 2021-02-24T15:16:16.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.605+0000 7ff4f9ae5700 15 client.4259.objecter _session_command_op_assign 2 2 2021-02-24T15:16:16.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.605+0000 7ff4f9ae5700 20 client.4259.objecter put_session s=0x7ff4d4037f40 osd=2 4 2021-02-24T15:16:16.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 10 client.4259.objecter _send_command 2 2021-02-24T15:16:16.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 --> v1:172.21.15.152:6808/33737 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff4cc001100 con 0x7ff4d40385f0 2021-02-24T15:16:16.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4db7fe700 1 -- 172.21.15.152:0/646453361 <== osd.2 v1:172.21.15.152:6808/33737 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1800444376) 0x7ff4cc001100 con 0x7ff4d40385f0 2021-02-24T15:16:16.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4db7fe700 10 client.4259.objecter ms_dispatch 0x7ff4f4001510 command_reply(tid 2: 0 ) v1 2021-02-24T15:16:16.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4db7fe700 10 client.4259.objecter _finish_command 2 = system:0 2021-02-24T15:16:16.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4db7fe700 20 client.4259.objecter put_session s=0x7ff4d4037f40 osd=2 4 2021-02-24T15:16:16.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4db7fe700 15 client.4259.objecter _session_command_op_remove 2 2 2021-02-24T15:16:16.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 10 librados: watch_flush enter 2021-02-24T15:16:16.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 10 librados: watch_flush exit 2021-02-24T15:16:16.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 10 client.4259.objecter close_session for osd.2 2021-02-24T15:16:16.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.152:6808/33737 conn(0x7ff4d40385f0 legacy=0x7ff4d403aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 20 client.4259.objecter put_session s=0x7ff4d4037f40 osd=2 1 2021-02-24T15:16:16.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 20 client.4259.objecter shutdown clearing up homeless session... 2021-02-24T15:16:16.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 10 client.4259.objecter successfully canceled tick 2021-02-24T15:16:16.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.181:6812/33484 conn(0x7ff4d40316b0 legacy=0x7ff4d4033b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 >> v1:172.21.15.152:6790/0 conn(0x7ff4f4062da0 legacy=0x7ff4f4133930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f3fff700 1 -- 172.21.15.152:0/646453361 reap_dead start 2021-02-24T15:16:16.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 shutdown_connections 2021-02-24T15:16:16.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 >> 172.21.15.152:0/646453361 conn(0x7ff4f409dcc0 msgr2=0x7ff4f409c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 shutdown_connections 2021-02-24T15:16:16.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 1 -- 172.21.15.152:0/646453361 wait complete. 2021-02-24T15:16:16.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.606+0000 7ff4f9ae5700 1 librados: shutdown 2021-02-24T15:16:16.653 INFO:teuthology.orchestra.run.smithi152.stdout:47244640259 2021-02-24T15:16:16.654 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-02-24T15:16:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.774+0000 7fdcefcf0700 1 Processor -- start 2021-02-24T15:16:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.774+0000 7fdcefcf0700 1 -- start start 2021-02-24T15:16:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.775+0000 7fdcefcf0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce8062660 con 0x7fdce80966a0 2021-02-24T15:16:16.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.775+0000 7fdcefcf0700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce8063af0 con 0x7fdce8068410 2021-02-24T15:16:16.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.775+0000 7fdcefcf0700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce8063d90 con 0x7fdce8095bb0 2021-02-24T15:16:16.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.775+0000 7fdceda8c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdce80966a0 0x7fdce8096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46014/0 (socket says 172.21.15.152:46014) 2021-02-24T15:16:16.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.775+0000 7fdced28b700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fdce8095bb0 0x7fdce8130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34494/0 (socket says 172.21.15.152:34494) 2021-02-24T15:16:16.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.775+0000 7fdceda8c700 1 -- 172.21.15.152:0/1204655539 learned_addr learned my addr 172.21.15.152:0/1204655539 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdced28b700 1 -- 172.21.15.152:0/1204655539 >> v1:172.21.15.152:6790/0 conn(0x7fdce8095bb0 legacy=0x7fdce8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceda8c700 1 -- 172.21.15.152:0/1204655539 >> v1:172.21.15.152:6789/0 conn(0x7fdce80966a0 legacy=0x7fdce8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912708721 0 0) 0x7fdce8062660 con 0x7fdce80966a0 2021-02-24T15:16:16.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdcee28d700 1 -- 172.21.15.152:0/1204655539 >> v1:172.21.15.181:6789/0 conn(0x7fdce8068410 legacy=0x7fdce8133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd0003230 con 0x7fdce80966a0 2021-02-24T15:16:16.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103823448 0 0) 0x7fdce8063d90 con 0x7fdce8095bb0 2021-02-24T15:16:16.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce8062660 con 0x7fdce8095bb0 2021-02-24T15:16:16.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186603398 0 0) 0x7fdce8063af0 con 0x7fdce8068410 2021-02-24T15:16:16.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce8063d90 con 0x7fdce8068410 2021-02-24T15:16:16.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3650267544 0 0) 0x7fdcd0003230 con 0x7fdce80966a0 2021-02-24T15:16:16.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 >> v1:172.21.15.152:6790/0 conn(0x7fdce8095bb0 legacy=0x7fdce8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 >> v1:172.21.15.181:6789/0 conn(0x7fdce8068410 legacy=0x7fdce8133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8064030 con 0x7fdce80966a0 2021-02-24T15:16:16.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.777+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fdce4001930 con 0x7fdce80966a0 2021-02-24T15:16:16.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.778+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdce4001c40 con 0x7fdce80966a0 2021-02-24T15:16:16.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.778+0000 7fdceca8a700 1 -- 172.21.15.152:0/1204655539 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fdce4004750 con 0x7fdce80966a0 2021-02-24T15:16:16.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.778+0000 7fdcefcf0700 1 -- 172.21.15.152:0/1204655539 >> v1:172.21.15.152:6789/0 conn(0x7fdce80966a0 legacy=0x7fdce8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.778+0000 7fdcefcf0700 1 -- 172.21.15.152:0/1204655539 shutdown_connections 2021-02-24T15:16:16.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.778+0000 7fdcefcf0700 1 -- 172.21.15.152:0/1204655539 >> 172.21.15.152:0/1204655539 conn(0x7fdce809ba40 msgr2=0x7fdce809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.778+0000 7fdcefcf0700 1 -- 172.21.15.152:0/1204655539 shutdown_connections 2021-02-24T15:16:16.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.778+0000 7fdcefcf0700 1 -- 172.21.15.152:0/1204655539 wait complete. 2021-02-24T15:16:16.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcefcf0700 1 librados: starting msgr at 2021-02-24T15:16:16.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcefcf0700 1 librados: starting objecter 2021-02-24T15:16:16.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcefcf0700 1 Processor -- start 2021-02-24T15:16:16.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcefcf0700 1 -- start start 2021-02-24T15:16:16.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcefcf0700 1 librados: setting wanted keys 2021-02-24T15:16:16.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcefcf0700 1 librados: calling monclient init 2021-02-24T15:16:16.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcefcf0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce8063010 con 0x7fdce8095bb0 2021-02-24T15:16:16.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcefcf0700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce8067420 con 0x7fdce8068410 2021-02-24T15:16:16.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcefcf0700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce81343e0 con 0x7fdce80966a0 2021-02-24T15:16:16.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdced28b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdce8095bb0 0x7fdce813a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46022/0 (socket says 172.21.15.152:46022) 2021-02-24T15:16:16.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdcee28d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fdce80966a0 0x7fdce81420e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34500/0 (socket says 172.21.15.152:34500) 2021-02-24T15:16:16.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.779+0000 7fdced28b700 1 -- 172.21.15.152:0/218295805 learned_addr learned my addr 172.21.15.152:0/218295805 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcee28d700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.152:6790/0 conn(0x7fdce80966a0 legacy=0x7fdce81420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdced28b700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.152:6789/0 conn(0x7fdce8095bb0 legacy=0x7fdce813a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 10 client.?.objecter ms_handle_connect 0x7fdce80966a0 2021-02-24T15:16:16.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 10 client.?.objecter ms_handle_connect 0x7fdce8095bb0 2021-02-24T15:16:16.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdceda8c700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.181:6789/0 conn(0x7fdce8068410 legacy=0x7fdce8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388380655 0 0) 0x7fdce81343e0 con 0x7fdce80966a0 2021-02-24T15:16:16.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc8004bd0 con 0x7fdce80966a0 2021-02-24T15:16:16.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 10 client.?.objecter ms_handle_connect 0x7fdce8068410 2021-02-24T15:16:16.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230241401 0 0) 0x7fdce8063010 con 0x7fdce8095bb0 2021-02-24T15:16:16.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce81343e0 con 0x7fdce8095bb0 2021-02-24T15:16:16.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3814576456 0 0) 0x7fdcc8004bd0 con 0x7fdce80966a0 2021-02-24T15:16:16.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdce8063010 con 0x7fdce80966a0 2021-02-24T15:16:16.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fdce0001f60 con 0x7fdce80966a0 2021-02-24T15:16:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498062228 0 0) 0x7fdce8067420 con 0x7fdce8068410 2021-02-24T15:16:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc8004bd0 con 0x7fdce8068410 2021-02-24T15:16:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3063808162 0 0) 0x7fdce81343e0 con 0x7fdce8095bb0 2021-02-24T15:16:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdce8067420 con 0x7fdce8095bb0 2021-02-24T15:16:16.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fdcdc001be0 con 0x7fdce8095bb0 2021-02-24T15:16:16.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdced28b700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.152:6789/0 conn(0x7fdce8095bb0 legacy=0x7fdce813a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-24T15:16:16.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdced28b700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.152:6789/0 conn(0x7fdce8095bb0 legacy=0x7fdce813a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:16:16.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdced28b700 1 --1- 172.21.15.152:0/218295805 >> v1:172.21.15.152:6789/0 conn(0x7fdce8095bb0 0x7fdce813a090 :-1 s=OPENED pgs=88 cs=1 l=1).handle_message read tag failed 2021-02-24T15:16:16.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdced28b700 1 --1- 172.21.15.152:0/218295805 >> v1:172.21.15.152:6789/0 conn(0x7fdce8095bb0 0x7fdce813a090 :-1 s=OPENED pgs=88 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:16:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2404590814 0 0) 0x7fdce8063010 con 0x7fdce80966a0 2021-02-24T15:16:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.181:6789/0 conn(0x7fdce8068410 legacy=0x7fdce8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.152:6789/0 conn(0x7fdce8095bb0 legacy=0x7fdce813a090 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce811b6b0 con 0x7fdce80966a0 2021-02-24T15:16:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce813a7a0 con 0x7fdce80966a0 2021-02-24T15:16:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdce00025b0 con 0x7fdce80966a0 2021-02-24T15:16:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.782+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fdce00028c0 con 0x7fdce80966a0 2021-02-24T15:16:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 10 client.4265.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce811a1e0 con 0x7fdce80966a0 2021-02-24T15:16:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 1 librados: init done 2021-02-24T15:16:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fdce0002a20 con 0x7fdce80966a0 2021-02-24T15:16:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7fdce003acd0 con 0x7fdce80966a0 2021-02-24T15:16:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcd9ffb700 10 client.4265.objecter ms_dispatch 0x7fdce8001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:16.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcd9ffb700 3 client.4265.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:16.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcd9ffb700 3 client.4265.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:16.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcd9ffb700 20 client.4265.objecter dump_active .. 0 homeless 2021-02-24T15:16:16.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 10 client.4265.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-24T15:16:16.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 15 client.4265.objecter _session_command_op_assign -1 1 2021-02-24T15:16:16.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 20 client.4265.objecter _get_session s=0x7fdce8119540 osd=3 3 2021-02-24T15:16:16.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 20 client.4265.objecter put_session s=0x7fdce8119540 osd=3 3 2021-02-24T15:16:16.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 20 client.4265.objecter _get_session s=0x7fdce8119540 osd=3 3 2021-02-24T15:16:16.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 15 client.4265.objecter _session_command_op_remove -1 1 2021-02-24T15:16:16.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 20 client.4265.objecter get_session s=0x7fdce8119540 osd=3 3 2021-02-24T15:16:16.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 15 client.4265.objecter _session_command_op_assign 3 1 2021-02-24T15:16:16.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 20 client.4265.objecter put_session s=0x7fdce8119540 osd=3 4 2021-02-24T15:16:16.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 10 client.4265.objecter _send_command 1 2021-02-24T15:16:16.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.783+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.181:6801/33937 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdce81150b0 con 0x7fdce81145c0 2021-02-24T15:16:16.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.786+0000 7fdcd9ffb700 10 client.4265.objecter ms_handle_connect 0x7fdcc8031590 2021-02-24T15:16:16.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.788+0000 7fdcd9ffb700 10 client.4265.objecter ms_handle_connect 0x7fdce81145c0 2021-02-24T15:16:16.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.789+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== osd.3 v1:172.21.15.181:6801/33937 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fdcdc008610 con 0x7fdce81145c0 2021-02-24T15:16:16.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.789+0000 7fdcd9ffb700 10 client.4265.objecter ms_dispatch 0x7fdce8001510 command_reply(tid 1: 0 ) v1 2021-02-24T15:16:16.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.789+0000 7fdcd9ffb700 10 client.4265.objecter _finish_command 1 = system:0 2021-02-24T15:16:16.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.789+0000 7fdcd9ffb700 20 client.4265.objecter put_session s=0x7fdce8119540 osd=3 4 2021-02-24T15:16:16.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.789+0000 7fdcd9ffb700 15 client.4265.objecter _session_command_op_remove 3 1 2021-02-24T15:16:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 10 client.4265.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-24T15:16:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 15 client.4265.objecter _session_command_op_assign -1 2 2021-02-24T15:16:16.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 20 client.4265.objecter _get_session s=0x7fdce8119540 osd=3 3 2021-02-24T15:16:16.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 20 client.4265.objecter put_session s=0x7fdce8119540 osd=3 3 2021-02-24T15:16:16.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 20 client.4265.objecter _get_session s=0x7fdce8119540 osd=3 3 2021-02-24T15:16:16.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 15 client.4265.objecter _session_command_op_remove -1 2 2021-02-24T15:16:16.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 20 client.4265.objecter get_session s=0x7fdce8119540 osd=3 3 2021-02-24T15:16:16.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 15 client.4265.objecter _session_command_op_assign 3 2 2021-02-24T15:16:16.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 20 client.4265.objecter put_session s=0x7fdce8119540 osd=3 4 2021-02-24T15:16:16.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 10 client.4265.objecter _send_command 2 2021-02-24T15:16:16.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.805+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 --> v1:172.21.15.181:6801/33937 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdce8058400 con 0x7fdce81145c0 2021-02-24T15:16:16.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcd9ffb700 1 -- 172.21.15.152:0/218295805 <== osd.3 v1:172.21.15.181:6801/33937 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2570787547) 0x7fdce8058400 con 0x7fdce81145c0 2021-02-24T15:16:16.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcd9ffb700 10 client.4265.objecter ms_dispatch 0x7fdce8001510 command_reply(tid 2: 0 ) v1 2021-02-24T15:16:16.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcd9ffb700 10 client.4265.objecter _finish_command 2 = system:0 2021-02-24T15:16:16.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcd9ffb700 20 client.4265.objecter put_session s=0x7fdce8119540 osd=3 4 2021-02-24T15:16:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcd9ffb700 15 client.4265.objecter _session_command_op_remove 3 2 2021-02-24T15:16:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 10 librados: watch_flush enter 2021-02-24T15:16:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 10 librados: watch_flush exit 2021-02-24T15:16:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 10 client.4265.objecter close_session for osd.3 2021-02-24T15:16:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.181:6801/33937 conn(0x7fdce81145c0 legacy=0x7fdce81149a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 20 client.4265.objecter put_session s=0x7fdce8119540 osd=3 1 2021-02-24T15:16:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 20 client.4265.objecter shutdown clearing up homeless session... 2021-02-24T15:16:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 10 client.4265.objecter successfully canceled tick 2021-02-24T15:16:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.181:6812/33484 conn(0x7fdcc8031590 legacy=0x7fdcc8033a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 >> v1:172.21.15.152:6790/0 conn(0x7fdce80966a0 legacy=0x7fdce81420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcee28d700 1 -- 172.21.15.152:0/218295805 reap_dead start 2021-02-24T15:16:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 shutdown_connections 2021-02-24T15:16:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 >> 172.21.15.152:0/218295805 conn(0x7fdce809ba40 msgr2=0x7fdce809a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 shutdown_connections 2021-02-24T15:16:16.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 1 -- 172.21.15.152:0/218295805 wait complete. 2021-02-24T15:16:16.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.806+0000 7fdcefcf0700 1 librados: shutdown 2021-02-24T15:16:16.841 INFO:teuthology.orchestra.run.smithi152.stdout:47244640258 2021-02-24T15:16:16.842 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-02-24T15:16:16.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.959+0000 7f91f5e74700 1 Processor -- start 2021-02-24T15:16:16.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.959+0000 7f91f5e74700 1 -- start start 2021-02-24T15:16:16.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.960+0000 7f91f5e74700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f0097d40 con 0x7f91f0062da0 2021-02-24T15:16:16.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.960+0000 7f91f5e74700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f0063d00 con 0x7f91f0063220 2021-02-24T15:16:16.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.960+0000 7f91f5e74700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f0097980 con 0x7f91f0099340 2021-02-24T15:16:16.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.960+0000 7f91eeffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f91f0062da0 0x7f91f012fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46030/0 (socket says 172.21.15.152:46030) 2021-02-24T15:16:16.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.960+0000 7f91ef7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f91f0099340 0x7f91f0097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34506/0 (socket says 172.21.15.152:34506) 2021-02-24T15:16:16.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.960+0000 7f91eeffd700 1 -- 172.21.15.152:0/809202351 learned_addr learned my addr 172.21.15.152:0/809202351 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91eeffd700 1 -- 172.21.15.152:0/809202351 >> v1:172.21.15.152:6789/0 conn(0x7f91f0062da0 legacy=0x7f91f012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ef7fe700 1 -- 172.21.15.152:0/809202351 >> v1:172.21.15.152:6790/0 conn(0x7f91f0099340 legacy=0x7f91f0097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591530103 0 0) 0x7f91f0097980 con 0x7f91f0099340 2021-02-24T15:16:16.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91effff700 1 -- 172.21.15.152:0/809202351 >> v1:172.21.15.181:6789/0 conn(0x7f91f0063220 legacy=0x7f91f0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91dc003230 con 0x7f91f0099340 2021-02-24T15:16:16.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532844602 0 0) 0x7f91f0097d40 con 0x7f91f0062da0 2021-02-24T15:16:16.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f0097980 con 0x7f91f0062da0 2021-02-24T15:16:16.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191212514 0 0) 0x7f91f0063d00 con 0x7f91f0063220 2021-02-24T15:16:16.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f0097d40 con 0x7f91f0063220 2021-02-24T15:16:16.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 726205703 0 0) 0x7f91dc003230 con 0x7f91f0099340 2021-02-24T15:16:16.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 >> v1:172.21.15.181:6789/0 conn(0x7f91f0063220 legacy=0x7f91f0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 >> v1:172.21.15.152:6789/0 conn(0x7f91f0062da0 legacy=0x7f91f012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f008fac0 con 0x7f91f0099340 2021-02-24T15:16:16.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.962+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f91e0001930 con 0x7f91f0099340 2021-02-24T15:16:16.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.963+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f91e0001c40 con 0x7f91f0099340 2021-02-24T15:16:16.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.963+0000 7f91ee7fc700 1 -- 172.21.15.152:0/809202351 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f91e0004690 con 0x7f91f0099340 2021-02-24T15:16:16.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.963+0000 7f91f5e74700 1 -- 172.21.15.152:0/809202351 >> v1:172.21.15.152:6790/0 conn(0x7f91f0099340 legacy=0x7f91f0097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.963+0000 7f91f5e74700 1 -- 172.21.15.152:0/809202351 shutdown_connections 2021-02-24T15:16:16.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.963+0000 7f91f5e74700 1 -- 172.21.15.152:0/809202351 >> 172.21.15.152:0/809202351 conn(0x7f91f009dcc0 msgr2=0x7f91f009e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:16.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.963+0000 7f91f5e74700 1 -- 172.21.15.152:0/809202351 shutdown_connections 2021-02-24T15:16:16.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.963+0000 7f91f5e74700 1 -- 172.21.15.152:0/809202351 wait complete. 2021-02-24T15:16:16.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.964+0000 7f91f5e74700 1 librados: starting msgr at 2021-02-24T15:16:16.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.964+0000 7f91f5e74700 1 librados: starting objecter 2021-02-24T15:16:16.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.964+0000 7f91f5e74700 1 Processor -- start 2021-02-24T15:16:16.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.964+0000 7f91f5e74700 1 -- start start 2021-02-24T15:16:16.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.964+0000 7f91f5e74700 1 librados: setting wanted keys 2021-02-24T15:16:16.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.964+0000 7f91f5e74700 1 librados: calling monclient init 2021-02-24T15:16:16.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.965+0000 7f91f5e74700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f0095070 con 0x7f91f0062da0 2021-02-24T15:16:16.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.965+0000 7f91f5e74700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f0095310 con 0x7f91f0099340 2021-02-24T15:16:16.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.965+0000 7f91f5e74700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f00955b0 con 0x7f91f0063220 2021-02-24T15:16:16.976 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.965+0000 7f91ef7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f91f0062da0 0x7f91f0139de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46034/0 (socket says 172.21.15.152:46034) 2021-02-24T15:16:16.976 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.965+0000 7f91eeffd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f91f0063220 0x7f91f0096d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34512/0 (socket says 172.21.15.152:34512) 2021-02-24T15:16:16.976 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.965+0000 7f91ef7fe700 1 -- 172.21.15.152:0/3371246228 learned_addr learned my addr 172.21.15.152:0/3371246228 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:16.976 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91ef7fe700 1 -- 172.21.15.152:0/3371246228 >> v1:172.21.15.152:6789/0 conn(0x7f91f0062da0 legacy=0x7f91f0139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.977 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 10 client.?.objecter ms_handle_connect 0x7f91f0062da0 2021-02-24T15:16:16.977 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.977 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 10 client.?.objecter ms_handle_connect 0x7f91f0063220 2021-02-24T15:16:16.977 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91eeffd700 1 -- 172.21.15.152:0/3371246228 >> v1:172.21.15.152:6790/0 conn(0x7f91f0063220 legacy=0x7f91f0096d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.977 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.978 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681490682 0 0) 0x7f91f0095070 con 0x7f91f0062da0 2021-02-24T15:16:16.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d0004bd0 con 0x7f91f0062da0 2021-02-24T15:16:16.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902641596 0 0) 0x7f91f00955b0 con 0x7f91f0063220 2021-02-24T15:16:16.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f0095070 con 0x7f91f0063220 2021-02-24T15:16:16.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 10 client.?.objecter ms_handle_connect 0x7f91f0099340 2021-02-24T15:16:16.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91effff700 1 -- 172.21.15.152:0/3371246228 >> v1:172.21.15.181:6789/0 conn(0x7f91f0099340 legacy=0x7f91f0142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:16.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:16.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 302908400 0 0) 0x7f91f0095070 con 0x7f91f0063220 2021-02-24T15:16:16.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f91f00955b0 con 0x7f91f0063220 2021-02-24T15:16:16.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399201804 0 0) 0x7f91f0095310 con 0x7f91f0099340 2021-02-24T15:16:16.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f0095070 con 0x7f91f0099340 2021-02-24T15:16:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4083140901 0 0) 0x7f91d0004bd0 con 0x7f91f0062da0 2021-02-24T15:16:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f91f0095310 con 0x7f91f0062da0 2021-02-24T15:16:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f91e4001c60 con 0x7f91f0063220 2021-02-24T15:16:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f91e00018f0 con 0x7f91f0062da0 2021-02-24T15:16:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1465759365 0 0) 0x7f91f00955b0 con 0x7f91f0063220 2021-02-24T15:16:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 >> v1:172.21.15.181:6789/0 conn(0x7f91f0099340 legacy=0x7f91f0142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 >> v1:172.21.15.152:6789/0 conn(0x7f91f0062da0 legacy=0x7f91f0139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f013a4f0 con 0x7f91f0063220 2021-02-24T15:16:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f00936e0 con 0x7f91f0063220 2021-02-24T15:16:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91f5e74700 10 client.4271.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:16.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f0097410 con 0x7f91f0063220 2021-02-24T15:16:16.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.967+0000 7f91f5e74700 1 librados: init done 2021-02-24T15:16:16.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f91e4004820 con 0x7f91f0063220 2021-02-24T15:16:16.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f91e4004b30 con 0x7f91f0063220 2021-02-24T15:16:16.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f91e4004d10 con 0x7f91f0063220 2021-02-24T15:16:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91f5e74700 10 client.4271.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-24T15:16:16.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91f5e74700 15 client.4271.objecter _session_command_op_assign -1 1 2021-02-24T15:16:16.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91f5e74700 20 client.4271.objecter _get_session osd=-1 returning homeless 2021-02-24T15:16:16.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91f5e74700 10 client.4271.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:16.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.152:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91c8002870 con 0x7f91f0063220 2021-02-24T15:16:16.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f91e403a8c0 con 0x7f91f0063220 2021-02-24T15:16:16.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 10 client.4271.objecter ms_dispatch 0x7f91f0001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:16.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 3 client.4271.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 3 client.4271.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 10 client.4271.objecter checking command 1 2021-02-24T15:16:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 20 client.4271.objecter _get_session s=0x7f91d0037ee0 osd=4 3 2021-02-24T15:16:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 20 client.4271.objecter put_session s=0x7f91d0037ee0 osd=4 3 2021-02-24T15:16:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 15 client.4271.objecter _session_command_op_remove -1 1 2021-02-24T15:16:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 20 client.4271.objecter _get_session s=0x7f91d0037ee0 osd=4 3 2021-02-24T15:16:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 20 client.4271.objecter get_session s=0x7f91d0037ee0 osd=4 3 2021-02-24T15:16:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 15 client.4271.objecter _session_command_op_assign 4 1 2021-02-24T15:16:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 20 client.4271.objecter put_session s=0x7f91d0037ee0 osd=4 4 2021-02-24T15:16:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 10 client.4271.objecter _send_command 1 2021-02-24T15:16:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.181:6800/33938 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91d003c260 con 0x7f91d0038590 2021-02-24T15:16:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 20 client.4271.objecter dump_active .. 0 homeless 2021-02-24T15:16:16.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.968+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f91e403adc0 con 0x7f91f0063220 2021-02-24T15:16:16.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.971+0000 7f91d77fe700 10 client.4271.objecter ms_handle_connect 0x7f91d00316d0 2021-02-24T15:16:17.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.973+0000 7f91d77fe700 10 client.4271.objecter ms_handle_connect 0x7f91d0038590 2021-02-24T15:16:17.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.974+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== osd.4 v1:172.21.15.181:6800/33938 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f91d003c260 con 0x7f91d0038590 2021-02-24T15:16:17.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.974+0000 7f91d77fe700 10 client.4271.objecter ms_dispatch 0x7f91f0001510 command_reply(tid 1: 0 ) v1 2021-02-24T15:16:17.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.974+0000 7f91d77fe700 10 client.4271.objecter _finish_command 1 = system:0 2021-02-24T15:16:17.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.974+0000 7f91d77fe700 20 client.4271.objecter put_session s=0x7f91d0037ee0 osd=4 4 2021-02-24T15:16:17.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.974+0000 7f91d77fe700 15 client.4271.objecter _session_command_op_remove 4 1 2021-02-24T15:16:17.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.990+0000 7f91f5e74700 10 client.4271.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-24T15:16:17.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.990+0000 7f91f5e74700 15 client.4271.objecter _session_command_op_assign -1 2 2021-02-24T15:16:17.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.990+0000 7f91f5e74700 20 client.4271.objecter _get_session s=0x7f91d0037ee0 osd=4 3 2021-02-24T15:16:17.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.990+0000 7f91f5e74700 20 client.4271.objecter put_session s=0x7f91d0037ee0 osd=4 3 2021-02-24T15:16:17.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.990+0000 7f91f5e74700 20 client.4271.objecter _get_session s=0x7f91d0037ee0 osd=4 3 2021-02-24T15:16:17.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.990+0000 7f91f5e74700 15 client.4271.objecter _session_command_op_remove -1 2 2021-02-24T15:16:17.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.990+0000 7f91f5e74700 20 client.4271.objecter get_session s=0x7f91d0037ee0 osd=4 3 2021-02-24T15:16:17.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.991+0000 7f91f5e74700 15 client.4271.objecter _session_command_op_assign 4 2 2021-02-24T15:16:17.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.991+0000 7f91f5e74700 20 client.4271.objecter put_session s=0x7f91d0037ee0 osd=4 4 2021-02-24T15:16:17.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.991+0000 7f91f5e74700 10 client.4271.objecter _send_command 2 2021-02-24T15:16:17.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.991+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 --> v1:172.21.15.181:6800/33938 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91c8001100 con 0x7f91d0038590 2021-02-24T15:16:17.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.991+0000 7f91d77fe700 1 -- 172.21.15.152:0/3371246228 <== osd.4 v1:172.21.15.181:6800/33938 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1800444376) 0x7f91c8001100 con 0x7f91d0038590 2021-02-24T15:16:17.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.991+0000 7f91d77fe700 10 client.4271.objecter ms_dispatch 0x7f91f0001510 command_reply(tid 2: 0 ) v1 2021-02-24T15:16:17.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.991+0000 7f91d77fe700 10 client.4271.objecter _finish_command 2 = system:0 2021-02-24T15:16:17.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.991+0000 7f91d77fe700 20 client.4271.objecter put_session s=0x7f91d0037ee0 osd=4 4 2021-02-24T15:16:17.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.991+0000 7f91d77fe700 15 client.4271.objecter _session_command_op_remove 4 2 2021-02-24T15:16:17.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 10 librados: watch_flush enter 2021-02-24T15:16:17.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 10 librados: watch_flush exit 2021-02-24T15:16:17.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 10 client.4271.objecter close_session for osd.4 2021-02-24T15:16:17.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 >> v1:172.21.15.181:6800/33938 conn(0x7f91d0038590 legacy=0x7f91d003a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 20 client.4271.objecter put_session s=0x7f91d0037ee0 osd=4 1 2021-02-24T15:16:17.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 20 client.4271.objecter shutdown clearing up homeless session... 2021-02-24T15:16:17.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 10 client.4271.objecter successfully canceled tick 2021-02-24T15:16:17.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 >> v1:172.21.15.181:6812/33484 conn(0x7f91d00316d0 legacy=0x7f91d0033b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 >> v1:172.21.15.152:6790/0 conn(0x7f91f0063220 legacy=0x7f91f0096d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91effff700 1 -- 172.21.15.152:0/3371246228 reap_dead start 2021-02-24T15:16:17.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 shutdown_connections 2021-02-24T15:16:17.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 >> 172.21.15.152:0/3371246228 conn(0x7f91f009dcc0 msgr2=0x7f91f009c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:17.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 shutdown_connections 2021-02-24T15:16:17.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 1 -- 172.21.15.152:0/3371246228 wait complete. 2021-02-24T15:16:17.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:16.992+0000 7f91f5e74700 1 librados: shutdown 2021-02-24T15:16:17.018 INFO:teuthology.orchestra.run.smithi152.stdout:47244640259 2021-02-24T15:16:17.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-02-24T15:16:17.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.146+0000 7f35752bd700 1 Processor -- start 2021-02-24T15:16:17.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.146+0000 7f35752bd700 1 -- start start 2021-02-24T15:16:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.147+0000 7f35752bd700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3570063e40 con 0x7f35700940d0 2021-02-24T15:16:17.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.147+0000 7f35752bd700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3570097740 con 0x7f3570095c90 2021-02-24T15:16:17.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.147+0000 7f35752bd700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3570064070 con 0x7f3570068550 2021-02-24T15:16:17.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.147+0000 7f356f7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f35700940d0 0x7f3570133360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46048/0 (socket says 172.21.15.152:46048) 2021-02-24T15:16:17.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.147+0000 7f356e7fc700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f3570068550 0x7f3570097030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34522/0 (socket says 172.21.15.152:34522) 2021-02-24T15:16:17.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.147+0000 7f356f7fe700 1 -- 172.21.15.152:0/1679319357 learned_addr learned my addr 172.21.15.152:0/1679319357 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:17.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.149+0000 7f356f7fe700 1 -- 172.21.15.152:0/1679319357 >> v1:172.21.15.152:6789/0 conn(0x7f35700940d0 legacy=0x7f3570133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.149+0000 7f356e7fc700 1 -- 172.21.15.152:0/1679319357 >> v1:172.21.15.152:6790/0 conn(0x7f3570068550 legacy=0x7f3570097030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.149+0000 7f356effd700 1 -- 172.21.15.152:0/1679319357 >> v1:172.21.15.181:6789/0 conn(0x7f3570095c90 legacy=0x7f3570096920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.149+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886928900 0 0) 0x7f3570063e40 con 0x7f35700940d0 2021-02-24T15:16:17.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.149+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f355c003230 con 0x7f35700940d0 2021-02-24T15:16:17.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.149+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816902846 0 0) 0x7f3570064070 con 0x7f3570068550 2021-02-24T15:16:17.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.149+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3570063e40 con 0x7f3570068550 2021-02-24T15:16:17.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.149+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416576230 0 0) 0x7f3570097740 con 0x7f3570095c90 2021-02-24T15:16:17.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.149+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3570064070 con 0x7f3570095c90 2021-02-24T15:16:17.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1959156971 0 0) 0x7f355c003230 con 0x7f35700940d0 2021-02-24T15:16:17.166 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 >> v1:172.21.15.152:6790/0 conn(0x7f3570068550 legacy=0x7f3570097030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.166 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 >> v1:172.21.15.181:6789/0 conn(0x7f3570095c90 legacy=0x7f3570096920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.166 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570064310 con 0x7f35700940d0 2021-02-24T15:16:17.166 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3568001cb0 con 0x7f35700940d0 2021-02-24T15:16:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3568001fc0 con 0x7f35700940d0 2021-02-24T15:16:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f356dffb700 1 -- 172.21.15.152:0/1679319357 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3568004ad0 con 0x7f35700940d0 2021-02-24T15:16:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f35752bd700 1 -- 172.21.15.152:0/1679319357 >> v1:172.21.15.152:6789/0 conn(0x7f35700940d0 legacy=0x7f3570133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f35752bd700 1 -- 172.21.15.152:0/1679319357 shutdown_connections 2021-02-24T15:16:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f35752bd700 1 -- 172.21.15.152:0/1679319357 >> 172.21.15.152:0/1679319357 conn(0x7f357009bce0 msgr2=0x7f357009c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:17.168 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f35752bd700 1 -- 172.21.15.152:0/1679319357 shutdown_connections 2021-02-24T15:16:17.168 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.150+0000 7f35752bd700 1 -- 172.21.15.152:0/1679319357 wait complete. 2021-02-24T15:16:17.168 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.151+0000 7f35752bd700 1 librados: starting msgr at 2021-02-24T15:16:17.168 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.151+0000 7f35752bd700 1 librados: starting objecter 2021-02-24T15:16:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.151+0000 7f35752bd700 1 Processor -- start 2021-02-24T15:16:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.151+0000 7f35752bd700 1 -- start start 2021-02-24T15:16:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.151+0000 7f35752bd700 1 librados: setting wanted keys 2021-02-24T15:16:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.151+0000 7f35752bd700 1 librados: calling monclient init 2021-02-24T15:16:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.152+0000 7f35752bd700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3570134210 con 0x7f35700940d0 2021-02-24T15:16:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.152+0000 7f35752bd700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357011afa0 con 0x7f3570140170 2021-02-24T15:16:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.152+0000 7f35752bd700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357011b240 con 0x7f3570095c90 2021-02-24T15:16:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.152+0000 7f356effd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f35700940d0 0x7f3570139e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46050/0 (socket says 172.21.15.152:46050) 2021-02-24T15:16:17.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.152+0000 7f356e7fc700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f3570095c90 0x7f3570133b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34528/0 (socket says 172.21.15.152:34528) 2021-02-24T15:16:17.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.152+0000 7f356effd700 1 -- 172.21.15.152:0/554668846 learned_addr learned my addr 172.21.15.152:0/554668846 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:17.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f356e7fc700 1 -- 172.21.15.152:0/554668846 >> v1:172.21.15.152:6790/0 conn(0x7f3570095c90 legacy=0x7f3570133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f356effd700 1 -- 172.21.15.152:0/554668846 >> v1:172.21.15.152:6789/0 conn(0x7f35700940d0 legacy=0x7f3570139e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 10 client.?.objecter ms_handle_connect 0x7f3570095c90 2021-02-24T15:16:17.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 10 client.?.objecter ms_handle_connect 0x7f35700940d0 2021-02-24T15:16:17.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918921506 0 0) 0x7f357011b240 con 0x7f3570095c90 2021-02-24T15:16:17.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3550004bd0 con 0x7f3570095c90 2021-02-24T15:16:17.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718621697 0 0) 0x7f3570134210 con 0x7f35700940d0 2021-02-24T15:16:17.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f357011b240 con 0x7f35700940d0 2021-02-24T15:16:17.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 10 client.?.objecter ms_handle_connect 0x7f3570140170 2021-02-24T15:16:17.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f356f7fe700 1 -- 172.21.15.152:0/554668846 >> v1:172.21.15.181:6789/0 conn(0x7f3570140170 legacy=0x7f3570142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 479425045 0 0) 0x7f3550004bd0 con 0x7f3570095c90 2021-02-24T15:16:17.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.154+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3570134210 con 0x7f3570095c90 2021-02-24T15:16:17.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3564001d30 con 0x7f3570095c90 2021-02-24T15:16:17.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1947401681 0 0) 0x7f357011b240 con 0x7f35700940d0 2021-02-24T15:16:17.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3550004bd0 con 0x7f35700940d0 2021-02-24T15:16:17.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3560001be0 con 0x7f35700940d0 2021-02-24T15:16:17.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729320886 0 0) 0x7f357011afa0 con 0x7f3570140170 2021-02-24T15:16:17.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f357011b240 con 0x7f3570140170 2021-02-24T15:16:17.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 549163937 0 0) 0x7f3570134210 con 0x7f3570095c90 2021-02-24T15:16:17.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 >> v1:172.21.15.181:6789/0 conn(0x7f3570140170 legacy=0x7f3570142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 >> v1:172.21.15.152:6789/0 conn(0x7f35700940d0 legacy=0x7f3570139e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357011b4e0 con 0x7f3570095c90 2021-02-24T15:16:17.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3570119370 con 0x7f3570095c90 2021-02-24T15:16:17.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f35752bd700 10 client.4277.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:17.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f357013ab20 con 0x7f3570095c90 2021-02-24T15:16:17.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f35752bd700 1 librados: init done 2021-02-24T15:16:17.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f35640048a0 con 0x7f3570095c90 2021-02-24T15:16:17.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3564004bb0 con 0x7f3570095c90 2021-02-24T15:16:17.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f3564004d90 con 0x7f3570095c90 2021-02-24T15:16:17.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f35752bd700 10 client.4277.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-24T15:16:17.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f35752bd700 15 client.4277.objecter _session_command_op_assign -1 1 2021-02-24T15:16:17.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f35752bd700 20 client.4277.objecter _get_session osd=-1 returning homeless 2021-02-24T15:16:17.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f35752bd700 10 client.4277.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:17.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.155+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.152:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3548002870 con 0x7f3570095c90 2021-02-24T15:16:17.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f356403a900 con 0x7f3570095c90 2021-02-24T15:16:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 10 client.4277.objecter ms_dispatch 0x7f3570001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 3 client.4277.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 3 client.4277.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 10 client.4277.objecter checking command 1 2021-02-24T15:16:17.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 20 client.4277.objecter _get_session s=0x7f3550037fc0 osd=5 3 2021-02-24T15:16:17.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 20 client.4277.objecter put_session s=0x7f3550037fc0 osd=5 3 2021-02-24T15:16:17.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 15 client.4277.objecter _session_command_op_remove -1 1 2021-02-24T15:16:17.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 20 client.4277.objecter _get_session s=0x7f3550037fc0 osd=5 3 2021-02-24T15:16:17.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 20 client.4277.objecter get_session s=0x7f3550037fc0 osd=5 3 2021-02-24T15:16:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 15 client.4277.objecter _session_command_op_assign 5 1 2021-02-24T15:16:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 20 client.4277.objecter put_session s=0x7f3550037fc0 osd=5 4 2021-02-24T15:16:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 10 client.4277.objecter _send_command 1 2021-02-24T15:16:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.181:6808/33963 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f355003c340 con 0x7f3550038670 2021-02-24T15:16:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 20 client.4277.objecter dump_active .. 0 homeless 2021-02-24T15:16:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.156+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f35640126f0 con 0x7f3570095c90 2021-02-24T15:16:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.158+0000 7f3556ffd700 10 client.4277.objecter ms_handle_connect 0x7f3550031730 2021-02-24T15:16:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.160+0000 7f3556ffd700 10 client.4277.objecter ms_handle_connect 0x7f3550038670 2021-02-24T15:16:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.162+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== osd.5 v1:172.21.15.181:6808/33963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f355003c340 con 0x7f3550038670 2021-02-24T15:16:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.162+0000 7f3556ffd700 10 client.4277.objecter ms_dispatch 0x7f3570001510 command_reply(tid 1: 0 ) v1 2021-02-24T15:16:17.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.162+0000 7f3556ffd700 10 client.4277.objecter _finish_command 1 = system:0 2021-02-24T15:16:17.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.162+0000 7f3556ffd700 20 client.4277.objecter put_session s=0x7f3550037fc0 osd=5 4 2021-02-24T15:16:17.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.162+0000 7f3556ffd700 15 client.4277.objecter _session_command_op_remove 5 1 2021-02-24T15:16:17.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 10 client.4277.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-24T15:16:17.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 15 client.4277.objecter _session_command_op_assign -1 2 2021-02-24T15:16:17.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 20 client.4277.objecter _get_session s=0x7f3550037fc0 osd=5 3 2021-02-24T15:16:17.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 20 client.4277.objecter put_session s=0x7f3550037fc0 osd=5 3 2021-02-24T15:16:17.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 20 client.4277.objecter _get_session s=0x7f3550037fc0 osd=5 3 2021-02-24T15:16:17.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 15 client.4277.objecter _session_command_op_remove -1 2 2021-02-24T15:16:17.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 20 client.4277.objecter get_session s=0x7f3550037fc0 osd=5 3 2021-02-24T15:16:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 15 client.4277.objecter _session_command_op_assign 5 2 2021-02-24T15:16:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 20 client.4277.objecter put_session s=0x7f3550037fc0 osd=5 4 2021-02-24T15:16:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 10 client.4277.objecter _send_command 2 2021-02-24T15:16:17.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.177+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 --> v1:172.21.15.181:6808/33963 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3548001100 con 0x7f3550038670 2021-02-24T15:16:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f3556ffd700 1 -- 172.21.15.152:0/554668846 <== osd.5 v1:172.21.15.181:6808/33963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 654699149) 0x7f3548001100 con 0x7f3550038670 2021-02-24T15:16:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f3556ffd700 10 client.4277.objecter ms_dispatch 0x7f3570001510 command_reply(tid 2: 0 ) v1 2021-02-24T15:16:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f3556ffd700 10 client.4277.objecter _finish_command 2 = system:0 2021-02-24T15:16:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f3556ffd700 20 client.4277.objecter put_session s=0x7f3550037fc0 osd=5 4 2021-02-24T15:16:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f3556ffd700 15 client.4277.objecter _session_command_op_remove 5 2 2021-02-24T15:16:17.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 10 librados: watch_flush enter 2021-02-24T15:16:17.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 10 librados: watch_flush exit 2021-02-24T15:16:17.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 10 client.4277.objecter close_session for osd.5 2021-02-24T15:16:17.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 >> v1:172.21.15.181:6808/33963 conn(0x7f3550038670 legacy=0x7f355003aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 20 client.4277.objecter put_session s=0x7f3550037fc0 osd=5 1 2021-02-24T15:16:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 20 client.4277.objecter shutdown clearing up homeless session... 2021-02-24T15:16:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 10 client.4277.objecter successfully canceled tick 2021-02-24T15:16:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 >> v1:172.21.15.181:6812/33484 conn(0x7f3550031730 legacy=0x7f3550033bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 >> v1:172.21.15.152:6790/0 conn(0x7f3570095c90 legacy=0x7f3570133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f356f7fe700 1 -- 172.21.15.152:0/554668846 reap_dead start 2021-02-24T15:16:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 shutdown_connections 2021-02-24T15:16:17.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 >> 172.21.15.152:0/554668846 conn(0x7f357009bce0 msgr2=0x7f35700675c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:17.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 shutdown_connections 2021-02-24T15:16:17.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 1 -- 172.21.15.152:0/554668846 wait complete. 2021-02-24T15:16:17.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.178+0000 7f35752bd700 1 librados: shutdown 2021-02-24T15:16:17.196 INFO:teuthology.orchestra.run.smithi152.stdout:47244640260 2021-02-24T15:16:17.196 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-02-24T15:16:17.315 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.314+0000 7f7ab32fb700 1 Processor -- start 2021-02-24T15:16:17.315 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.314+0000 7f7ab32fb700 1 -- start start 2021-02-24T15:16:17.316 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.315+0000 7f7ab32fb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac062660 con 0x7f7aac068410 2021-02-24T15:16:17.316 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.315+0000 7f7ab32fb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac063af0 con 0x7f7aac095bb0 2021-02-24T15:16:17.316 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.315+0000 7f7ab32fb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac063d90 con 0x7f7aac0966a0 2021-02-24T15:16:17.317 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.315+0000 7f7ab1898700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7aac068410 0x7f7aac133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46064/0 (socket says 172.21.15.152:46064) 2021-02-24T15:16:17.317 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.315+0000 7f7ab1898700 1 -- 172.21.15.152:0/3751998268 learned_addr learned my addr 172.21.15.152:0/3751998268 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:17.319 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7ab1097700 1 -- 172.21.15.152:0/3751998268 >> v1:172.21.15.152:6790/0 conn(0x7f7aac0966a0 legacy=0x7f7aac096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.319 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7ab1898700 1 -- 172.21.15.152:0/3751998268 >> v1:172.21.15.152:6789/0 conn(0x7f7aac068410 legacy=0x7f7aac133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.319 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408885112 0 0) 0x7f7aac063d90 con 0x7f7aac0966a0 2021-02-24T15:16:17.320 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a94003230 con 0x7f7aac0966a0 2021-02-24T15:16:17.320 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941192189 0 0) 0x7f7aac062660 con 0x7f7aac068410 2021-02-24T15:16:17.320 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aac063d90 con 0x7f7aac068410 2021-02-24T15:16:17.320 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7ab0896700 1 -- 172.21.15.152:0/3751998268 >> v1:172.21.15.181:6789/0 conn(0x7f7aac095bb0 legacy=0x7f7aac130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.320 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 994121922 0 0) 0x7f7a94003230 con 0x7f7aac0966a0 2021-02-24T15:16:17.321 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 >> v1:172.21.15.181:6789/0 conn(0x7f7aac095bb0 legacy=0x7f7aac130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.321 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 >> v1:172.21.15.152:6789/0 conn(0x7f7aac068410 legacy=0x7f7aac133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.321 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac064030 con 0x7f7aac0966a0 2021-02-24T15:16:17.321 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7aa0001980 con 0x7f7aac0966a0 2021-02-24T15:16:17.321 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7aa0001c90 con 0x7f7aac0966a0 2021-02-24T15:16:17.322 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.317+0000 7f7a9ffff700 1 -- 172.21.15.152:0/3751998268 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7aa0002060 con 0x7f7aac0966a0 2021-02-24T15:16:17.322 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.318+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3751998268 >> v1:172.21.15.152:6790/0 conn(0x7f7aac0966a0 legacy=0x7f7aac096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.322 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.318+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3751998268 shutdown_connections 2021-02-24T15:16:17.322 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.318+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3751998268 >> 172.21.15.152:0/3751998268 conn(0x7f7aac09ba40 msgr2=0x7f7aac09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:17.323 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.318+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3751998268 shutdown_connections 2021-02-24T15:16:17.323 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.318+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3751998268 wait complete. 2021-02-24T15:16:17.327 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab32fb700 1 librados: starting msgr at 2021-02-24T15:16:17.327 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab32fb700 1 librados: starting objecter 2021-02-24T15:16:17.327 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab32fb700 1 Processor -- start 2021-02-24T15:16:17.327 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab32fb700 1 -- start start 2021-02-24T15:16:17.327 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab32fb700 1 librados: setting wanted keys 2021-02-24T15:16:17.328 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab32fb700 1 librados: calling monclient init 2021-02-24T15:16:17.328 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab32fb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac063010 con 0x7f7aac0966a0 2021-02-24T15:16:17.328 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab32fb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac11ad40 con 0x7f7aac095bb0 2021-02-24T15:16:17.328 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab32fb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac067540 con 0x7f7aac068410 2021-02-24T15:16:17.329 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab1097700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f7aac068410 0x7f7aac13a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34542/0 (socket says 172.21.15.152:34542) 2021-02-24T15:16:17.329 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.319+0000 7f7ab1097700 1 -- 172.21.15.152:0/3206897289 learned_addr learned my addr 172.21.15.152:0/3206897289 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:17.329 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7ab1097700 1 -- 172.21.15.152:0/3206897289 >> v1:172.21.15.152:6790/0 conn(0x7f7aac068410 legacy=0x7f7aac13a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.329 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7ab1898700 1 -- 172.21.15.152:0/3206897289 >> v1:172.21.15.152:6789/0 conn(0x7f7aac0966a0 legacy=0x7f7aac142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.329 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 10 client.?.objecter ms_handle_connect 0x7f7aac068410 2021-02-24T15:16:17.330 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.330 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 10 client.?.objecter ms_handle_connect 0x7f7aac0966a0 2021-02-24T15:16:17.330 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.330 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7ab1097700 1 --1- 172.21.15.152:0/3206897289 >> v1:172.21.15.152:6790/0 conn(0x7f7aac068410 0x7f7aac13a370 :-1 s=OPENED pgs=90 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f7aac067540 auth_reply(proto 2 0 (0) Success) v1 2021-02-24T15:16:17.330 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722371440 0 0) 0x7f7aac063010 con 0x7f7aac0966a0 2021-02-24T15:16:17.331 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a8c004bd0 con 0x7f7aac0966a0 2021-02-24T15:16:17.331 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 10 client.?.objecter ms_handle_connect 0x7f7aac095bb0 2021-02-24T15:16:17.331 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.331 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7ab0896700 1 -- 172.21.15.152:0/3206897289 >> v1:172.21.15.181:6789/0 conn(0x7f7aac095bb0 legacy=0x7f7aac133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.332 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2777802147 0 0) 0x7f7a8c004bd0 con 0x7f7aac0966a0 2021-02-24T15:16:17.332 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7aac063010 con 0x7f7aac0966a0 2021-02-24T15:16:17.332 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7aa4001f10 con 0x7f7aac0966a0 2021-02-24T15:16:17.332 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175089545 0 0) 0x7f7aac11ad40 con 0x7f7aac095bb0 2021-02-24T15:16:17.332 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a8c004bd0 con 0x7f7aac095bb0 2021-02-24T15:16:17.333 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2177753948 0 0) 0x7f7aac063010 con 0x7f7aac0966a0 2021-02-24T15:16:17.333 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 >> v1:172.21.15.152:6790/0 conn(0x7f7aac068410 legacy=0x7f7aac13a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.333 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 >> v1:172.21.15.181:6789/0 conn(0x7f7aac095bb0 legacy=0x7f7aac133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.333 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac134540 con 0x7f7aac0966a0 2021-02-24T15:16:17.333 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572860610 0 0) 0x7f7aac067540 con 0x7f7aac068410 2021-02-24T15:16:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac11a340 con 0x7f7aac0966a0 2021-02-24T15:16:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7ab32fb700 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac118d00 con 0x7f7aac0966a0 2021-02-24T15:16:17.334 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7ab32fb700 1 librados: init done 2021-02-24T15:16:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7aa4004c90 con 0x7f7aac0966a0 2021-02-24T15:16:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.322+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7aa4004fa0 con 0x7f7aac0966a0 2021-02-24T15:16:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.323+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f7aa4005180 con 0x7f7aac0966a0 2021-02-24T15:16:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.323+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f7aa403aba0 con 0x7f7aac0966a0 2021-02-24T15:16:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.323+0000 7f7a9d7fa700 10 client.4287.objecter ms_dispatch 0x7f7aac001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:17.336 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.323+0000 7f7a9d7fa700 3 client.4287.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:17.336 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.323+0000 7f7a9d7fa700 3 client.4287.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:17.336 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.323+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a84004d60 con 0x7f7aac0966a0 2021-02-24T15:16:17.336 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.323+0000 7f7a9d7fa700 20 client.4287.objecter dump_active .. 0 homeless 2021-02-24T15:16:17.336 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.326+0000 7f7a9d7fa700 10 client.4287.objecter ms_handle_connect 0x7f7a8c031430 2021-02-24T15:16:17.337 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.327+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f7aa40129e0 con 0x7f7aac0966a0 2021-02-24T15:16:17.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.496+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a84005010 con 0x7f7aac0966a0 2021-02-24T15:16:17.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.497+0000 7f7a9d7fa700 1 -- 172.21.15.152:0/3206897289 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 847495621) 0x7f7aa40125d0 con 0x7f7aac0966a0 2021-02-24T15:16:17.498 INFO:teuthology.orchestra.run.smithi152.stdout:47244640259 2021-02-24T15:16:17.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 10 librados: watch_flush enter 2021-02-24T15:16:17.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 10 librados: watch_flush exit 2021-02-24T15:16:17.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 20 client.4287.objecter shutdown clearing up homeless session... 2021-02-24T15:16:17.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 10 client.4287.objecter successfully canceled tick 2021-02-24T15:16:17.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 >> v1:172.21.15.181:6812/33484 conn(0x7f7a8c031430 legacy=0x7f7a8c0338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 >> v1:172.21.15.152:6789/0 conn(0x7f7aac0966a0 legacy=0x7f7aac142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 shutdown_connections 2021-02-24T15:16:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 >> 172.21.15.152:0/3206897289 conn(0x7f7aac09ba40 msgr2=0x7f7aac1120a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 shutdown_connections 2021-02-24T15:16:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 1 -- 172.21.15.152:0/3206897289 wait complete. 2021-02-24T15:16:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.498+0000 7f7ab32fb700 1 librados: shutdown 2021-02-24T15:16:17.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2021-02-24T15:16:17.511 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-02-24T15:16:17.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.627+0000 7fcb2ca74700 1 Processor -- start 2021-02-24T15:16:17.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.627+0000 7fcb2ca74700 1 -- start start 2021-02-24T15:16:17.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.628+0000 7fcb2ca74700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb28097d40 con 0x7fcb28099340 2021-02-24T15:16:17.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.628+0000 7fcb2ca74700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb28063d00 con 0x7fcb28062da0 2021-02-24T15:16:17.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.628+0000 7fcb2ca74700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb28097980 con 0x7fcb28063220 2021-02-24T15:16:17.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.628+0000 7fcb2659c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fcb28099340 0x7fcb28097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46074/0 (socket says 172.21.15.152:46074) 2021-02-24T15:16:17.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.628+0000 7fcb2659c700 1 -- 172.21.15.152:0/2068625054 learned_addr learned my addr 172.21.15.152:0/2068625054 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:17.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.630+0000 7fcb26d9d700 1 -- 172.21.15.152:0/2068625054 >> v1:172.21.15.152:6790/0 conn(0x7fcb28063220 legacy=0x7fcb28133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.630+0000 7fcb2659c700 1 -- 172.21.15.152:0/2068625054 >> v1:172.21.15.152:6789/0 conn(0x7fcb28099340 legacy=0x7fcb28097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb25d9b700 1 -- 172.21.15.152:0/2068625054 >> v1:172.21.15.181:6789/0 conn(0x7fcb28062da0 legacy=0x7fcb2812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309132190 0 0) 0x7fcb28097980 con 0x7fcb28063220 2021-02-24T15:16:17.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb0c003230 con 0x7fcb28063220 2021-02-24T15:16:17.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742381599 0 0) 0x7fcb28097d40 con 0x7fcb28099340 2021-02-24T15:16:17.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb28097980 con 0x7fcb28099340 2021-02-24T15:16:17.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497003128 0 0) 0x7fcb28063d00 con 0x7fcb28062da0 2021-02-24T15:16:17.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb28097d40 con 0x7fcb28062da0 2021-02-24T15:16:17.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 362538389 0 0) 0x7fcb28097980 con 0x7fcb28099340 2021-02-24T15:16:17.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 >> v1:172.21.15.152:6790/0 conn(0x7fcb28063220 legacy=0x7fcb28133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 >> v1:172.21.15.181:6789/0 conn(0x7fcb28062da0 legacy=0x7fcb2812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2808fac0 con 0x7fcb28099340 2021-02-24T15:16:17.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fcb18001930 con 0x7fcb28099340 2021-02-24T15:16:17.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcb18001c40 con 0x7fcb28099340 2021-02-24T15:16:17.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2559a700 1 -- 172.21.15.152:0/2068625054 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fcb18004750 con 0x7fcb28099340 2021-02-24T15:16:17.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.631+0000 7fcb2ca74700 1 -- 172.21.15.152:0/2068625054 >> v1:172.21.15.152:6789/0 conn(0x7fcb28099340 legacy=0x7fcb28097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 -- 172.21.15.152:0/2068625054 shutdown_connections 2021-02-24T15:16:17.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 -- 172.21.15.152:0/2068625054 >> 172.21.15.152:0/2068625054 conn(0x7fcb2809dcc0 msgr2=0x7fcb2809e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:17.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 -- 172.21.15.152:0/2068625054 shutdown_connections 2021-02-24T15:16:17.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 -- 172.21.15.152:0/2068625054 wait complete. 2021-02-24T15:16:17.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 librados: starting msgr at 2021-02-24T15:16:17.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 librados: starting objecter 2021-02-24T15:16:17.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 Processor -- start 2021-02-24T15:16:17.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 -- start start 2021-02-24T15:16:17.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 librados: setting wanted keys 2021-02-24T15:16:17.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.632+0000 7fcb2ca74700 1 librados: calling monclient init 2021-02-24T15:16:17.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.633+0000 7fcb2ca74700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280951b0 con 0x7fcb28063220 2021-02-24T15:16:17.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.633+0000 7fcb2ca74700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb28095450 con 0x7fcb28099340 2021-02-24T15:16:17.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.633+0000 7fcb2ca74700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280956f0 con 0x7fcb28062da0 2021-02-24T15:16:17.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.633+0000 7fcb2659c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fcb28062da0 0x7fcb28139d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34556/0 (socket says 172.21.15.152:34556) 2021-02-24T15:16:17.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.633+0000 7fcb2659c700 1 -- 172.21.15.152:0/202525275 learned_addr learned my addr 172.21.15.152:0/202525275 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:17.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb25d9b700 1 -- 172.21.15.152:0/202525275 >> v1:172.21.15.152:6789/0 conn(0x7fcb28063220 legacy=0x7fcb28096ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb2659c700 1 -- 172.21.15.152:0/202525275 >> v1:172.21.15.152:6790/0 conn(0x7fcb28062da0 legacy=0x7fcb28139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 10 client.?.objecter ms_handle_connect 0x7fcb28063220 2021-02-24T15:16:17.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 10 client.?.objecter ms_handle_connect 0x7fcb28062da0 2021-02-24T15:16:17.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 10 client.?.objecter ms_handle_connect 0x7fcb28099340 2021-02-24T15:16:17.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb26d9d700 1 -- 172.21.15.152:0/202525275 >> v1:172.21.15.181:6789/0 conn(0x7fcb28099340 legacy=0x7fcb281420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749990246 0 0) 0x7fcb280951b0 con 0x7fcb28063220 2021-02-24T15:16:17.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb04004bd0 con 0x7fcb28063220 2021-02-24T15:16:17.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177642898 0 0) 0x7fcb280956f0 con 0x7fcb28062da0 2021-02-24T15:16:17.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb280951b0 con 0x7fcb28062da0 2021-02-24T15:16:17.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137248975 0 0) 0x7fcb28095450 con 0x7fcb28099340 2021-02-24T15:16:17.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb280956f0 con 0x7fcb28099340 2021-02-24T15:16:17.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2479585639 0 0) 0x7fcb04004bd0 con 0x7fcb28063220 2021-02-24T15:16:17.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb28095450 con 0x7fcb28063220 2021-02-24T15:16:17.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.635+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fcb1c001be0 con 0x7fcb28063220 2021-02-24T15:16:17.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1000142753 0 0) 0x7fcb280951b0 con 0x7fcb28062da0 2021-02-24T15:16:17.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb04004bd0 con 0x7fcb28062da0 2021-02-24T15:16:17.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fcb180018f0 con 0x7fcb28062da0 2021-02-24T15:16:17.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 409934438 0 0) 0x7fcb280956f0 con 0x7fcb28099340 2021-02-24T15:16:17.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb280951b0 con 0x7fcb28099340 2021-02-24T15:16:17.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fcb20001ce0 con 0x7fcb28099340 2021-02-24T15:16:17.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1420670302 0 0) 0x7fcb28095450 con 0x7fcb28063220 2021-02-24T15:16:17.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 >> v1:172.21.15.152:6790/0 conn(0x7fcb28062da0 legacy=0x7fcb28139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 >> v1:172.21.15.181:6789/0 conn(0x7fcb28099340 legacy=0x7fcb281420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28093510 con 0x7fcb28063220 2021-02-24T15:16:17.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2813a480 con 0x7fcb28063220 2021-02-24T15:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb2ca74700 10 client.4293.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb28097470 con 0x7fcb28063220 2021-02-24T15:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb2ca74700 1 librados: init done 2021-02-24T15:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcb1c0022b0 con 0x7fcb28063220 2021-02-24T15:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fcb1c0025c0 con 0x7fcb28063220 2021-02-24T15:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.636+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fcb1c0027a0 con 0x7fcb28063220 2021-02-24T15:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.637+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb08004d60 con 0x7fcb28063220 2021-02-24T15:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.637+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7fcb1c03a9d0 con 0x7fcb28063220 2021-02-24T15:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.637+0000 7fcb167fc700 10 client.4293.objecter ms_dispatch 0x7fcb28001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.637+0000 7fcb167fc700 3 client.4293.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:17.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.637+0000 7fcb167fc700 3 client.4293.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:17.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.637+0000 7fcb167fc700 20 client.4293.objecter dump_active .. 0 homeless 2021-02-24T15:16:17.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.639+0000 7fcb167fc700 10 client.4293.objecter ms_handle_connect 0x7fcb04031780 2021-02-24T15:16:17.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.641+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fcb1c012810 con 0x7fcb28063220 2021-02-24T15:16:17.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.808+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb08005010 con 0x7fcb28063220 2021-02-24T15:16:17.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.809+0000 7fcb167fc700 1 -- 172.21.15.152:0/202525275 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 847495621) 0x7fcb1c012400 con 0x7fcb28063220 2021-02-24T15:16:17.810 INFO:teuthology.orchestra.run.smithi152.stdout:47244640259 2021-02-24T15:16:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.810+0000 7fcb2ca74700 10 librados: watch_flush enter 2021-02-24T15:16:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.810+0000 7fcb2ca74700 10 librados: watch_flush exit 2021-02-24T15:16:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.810+0000 7fcb2ca74700 20 client.4293.objecter shutdown clearing up homeless session... 2021-02-24T15:16:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.810+0000 7fcb2ca74700 10 client.4293.objecter successfully canceled tick 2021-02-24T15:16:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.810+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 >> v1:172.21.15.181:6812/33484 conn(0x7fcb04031780 legacy=0x7fcb04033c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.810+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 >> v1:172.21.15.152:6789/0 conn(0x7fcb28063220 legacy=0x7fcb28096ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.810+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 shutdown_connections 2021-02-24T15:16:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.810+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 >> 172.21.15.152:0/202525275 conn(0x7fcb2809dcc0 msgr2=0x7fcb2809c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.811+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 shutdown_connections 2021-02-24T15:16:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.811+0000 7fcb2ca74700 1 -- 172.21.15.152:0/202525275 wait complete. 2021-02-24T15:16:17.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.811+0000 7fcb2ca74700 1 librados: shutdown 2021-02-24T15:16:17.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2021-02-24T15:16:17.823 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-02-24T15:16:17.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.939+0000 7fc8b0d76700 1 Processor -- start 2021-02-24T15:16:17.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.939+0000 7fc8b0d76700 1 -- start start 2021-02-24T15:16:17.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.940+0000 7fc8b0d76700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac12b0d0 con 0x7fc8ac0613c0 2021-02-24T15:16:17.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.940+0000 7fc8b0d76700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac098a60 con 0x7fc8ac067e70 2021-02-24T15:16:17.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.940+0000 7fc8b0d76700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac09a0b0 con 0x7fc8ac0679c0 2021-02-24T15:16:17.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.940+0000 7fc8a9d9b700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc8ac0679c0 0x7fc8ac12fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34564/0 (socket says 172.21.15.152:34564) 2021-02-24T15:16:17.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.940+0000 7fc8a9d9b700 1 -- 172.21.15.152:0/392660158 learned_addr learned my addr 172.21.15.152:0/392660158 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:17.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8aa59c700 1 -- 172.21.15.152:0/392660158 >> v1:172.21.15.152:6789/0 conn(0x7fc8ac0613c0 legacy=0x7fc8ac12a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a9d9b700 1 -- 172.21.15.152:0/392660158 >> v1:172.21.15.152:6790/0 conn(0x7fc8ac0679c0 legacy=0x7fc8ac12fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8aad9d700 1 -- 172.21.15.152:0/392660158 >> v1:172.21.15.181:6789/0 conn(0x7fc8ac067e70 legacy=0x7fc8ac133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490398765 0 0) 0x7fc8ac09a0b0 con 0x7fc8ac0679c0 2021-02-24T15:16:17.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc890003230 con 0x7fc8ac0679c0 2021-02-24T15:16:17.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421764001 0 0) 0x7fc8ac12b0d0 con 0x7fc8ac0613c0 2021-02-24T15:16:17.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8ac09a0b0 con 0x7fc8ac0613c0 2021-02-24T15:16:17.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179926050 0 0) 0x7fc8ac098a60 con 0x7fc8ac067e70 2021-02-24T15:16:17.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8ac12b0d0 con 0x7fc8ac067e70 2021-02-24T15:16:17.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1028945235 0 0) 0x7fc890003230 con 0x7fc8ac0679c0 2021-02-24T15:16:17.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 >> v1:172.21.15.181:6789/0 conn(0x7fc8ac067e70 legacy=0x7fc8ac133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 >> v1:172.21.15.152:6789/0 conn(0x7fc8ac0613c0 legacy=0x7fc8ac12a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac09a350 con 0x7fc8ac0679c0 2021-02-24T15:16:17.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.942+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc8a0001970 con 0x7fc8ac0679c0 2021-02-24T15:16:17.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.943+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc8a0001c80 con 0x7fc8ac0679c0 2021-02-24T15:16:17.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.943+0000 7fc8a959a700 1 -- 172.21.15.152:0/392660158 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc8a0004750 con 0x7fc8ac0679c0 2021-02-24T15:16:17.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.943+0000 7fc8b0d76700 1 -- 172.21.15.152:0/392660158 >> v1:172.21.15.152:6790/0 conn(0x7fc8ac0679c0 legacy=0x7fc8ac12fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.943+0000 7fc8b0d76700 1 -- 172.21.15.152:0/392660158 shutdown_connections 2021-02-24T15:16:17.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.943+0000 7fc8b0d76700 1 -- 172.21.15.152:0/392660158 >> 172.21.15.152:0/392660158 conn(0x7fc8ac09a940 msgr2=0x7fc8ac09ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.943+0000 7fc8b0d76700 1 -- 172.21.15.152:0/392660158 shutdown_connections 2021-02-24T15:16:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.943+0000 7fc8b0d76700 1 -- 172.21.15.152:0/392660158 wait complete. 2021-02-24T15:16:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8b0d76700 1 librados: starting msgr at 2021-02-24T15:16:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8b0d76700 1 librados: starting objecter 2021-02-24T15:16:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8b0d76700 1 Processor -- start 2021-02-24T15:16:17.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8b0d76700 1 -- start start 2021-02-24T15:16:17.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8b0d76700 1 librados: setting wanted keys 2021-02-24T15:16:17.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8b0d76700 1 librados: calling monclient init 2021-02-24T15:16:17.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8b0d76700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac120fd0 con 0x7fc8ac0679c0 2021-02-24T15:16:17.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8b0d76700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac120530 con 0x7fc8ac0613c0 2021-02-24T15:16:17.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8b0d76700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac067510 con 0x7fc8ac067e70 2021-02-24T15:16:17.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8a9d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc8ac0679c0 0x7fc8ac13f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46094/0 (socket says 172.21.15.152:46094) 2021-02-24T15:16:17.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8aad9d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc8ac067e70 0x7fc8ac142930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34572/0 (socket says 172.21.15.152:34572) 2021-02-24T15:16:17.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.944+0000 7fc8a9d9b700 1 -- 172.21.15.152:0/3479499355 learned_addr learned my addr 172.21.15.152:0/3479499355 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:17.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc8aad9d700 1 -- 172.21.15.152:0/3479499355 >> v1:172.21.15.152:6790/0 conn(0x7fc8ac067e70 legacy=0x7fc8ac142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc8a9d9b700 1 -- 172.21.15.152:0/3479499355 >> v1:172.21.15.152:6789/0 conn(0x7fc8ac0679c0 legacy=0x7fc8ac13f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 10 client.?.objecter ms_handle_connect 0x7fc8ac067e70 2021-02-24T15:16:17.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 10 client.?.objecter ms_handle_connect 0x7fc8ac0679c0 2021-02-24T15:16:17.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224104741 0 0) 0x7fc8ac067510 con 0x7fc8ac067e70 2021-02-24T15:16:17.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc888004bd0 con 0x7fc8ac067e70 2021-02-24T15:16:17.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332678324 0 0) 0x7fc8ac120fd0 con 0x7fc8ac0679c0 2021-02-24T15:16:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8ac067510 con 0x7fc8ac0679c0 2021-02-24T15:16:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 10 client.?.objecter ms_handle_connect 0x7fc8ac0613c0 2021-02-24T15:16:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc8aa59c700 1 -- 172.21.15.152:0/3479499355 >> v1:172.21.15.181:6789/0 conn(0x7fc8ac0613c0 legacy=0x7fc8ac123490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:17.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3199956655 0 0) 0x7fc888004bd0 con 0x7fc8ac067e70 2021-02-24T15:16:17.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc8ac120fd0 con 0x7fc8ac067e70 2021-02-24T15:16:17.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc8a4001fa0 con 0x7fc8ac067e70 2021-02-24T15:16:17.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1404010399 0 0) 0x7fc8ac067510 con 0x7fc8ac0679c0 2021-02-24T15:16:17.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc888004bd0 con 0x7fc8ac0679c0 2021-02-24T15:16:17.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249993514 0 0) 0x7fc8ac120530 con 0x7fc8ac0613c0 2021-02-24T15:16:17.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8ac067510 con 0x7fc8ac0613c0 2021-02-24T15:16:17.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc8a0001930 con 0x7fc8ac0679c0 2021-02-24T15:16:17.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2671844385 0 0) 0x7fc8ac120fd0 con 0x7fc8ac067e70 2021-02-24T15:16:17.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 >> v1:172.21.15.181:6789/0 conn(0x7fc8ac0613c0 legacy=0x7fc8ac123490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 >> v1:172.21.15.152:6789/0 conn(0x7fc8ac0679c0 legacy=0x7fc8ac13f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:17.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac11f240 con 0x7fc8ac067e70 2021-02-24T15:16:17.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac123ba0 con 0x7fc8ac067e70 2021-02-24T15:16:17.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc8b0d76700 10 client.4295.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:17.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac066c20 con 0x7fc8ac067e70 2021-02-24T15:16:17.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc8b0d76700 1 librados: init done 2021-02-24T15:16:17.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc8a40025e0 con 0x7fc8ac067e70 2021-02-24T15:16:17.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.947+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc8a40028f0 con 0x7fc8ac067e70 2021-02-24T15:16:17.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.948+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fc8a4002ad0 con 0x7fc8ac067e70 2021-02-24T15:16:17.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.948+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7fc8a403ab70 con 0x7fc8ac067e70 2021-02-24T15:16:17.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.948+0000 7fc89a7fc700 10 client.4295.objecter ms_dispatch 0x7fc8ac001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:17.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.948+0000 7fc89a7fc700 3 client.4295.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:17.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.948+0000 7fc89a7fc700 3 client.4295.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:17.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.948+0000 7fc89a7fc700 20 client.4295.objecter dump_active .. 0 homeless 2021-02-24T15:16:17.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.948+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88c004d60 con 0x7fc8ac067e70 2021-02-24T15:16:17.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.951+0000 7fc89a7fc700 10 client.4295.objecter ms_handle_connect 0x7fc888031730 2021-02-24T15:16:17.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:17.952+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fc8a40129d0 con 0x7fc8ac067e70 2021-02-24T15:16:18.122 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.121+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc88c005010 con 0x7fc8ac067e70 2021-02-24T15:16:18.122 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.121+0000 7fc89a7fc700 1 -- 172.21.15.152:0/3479499355 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 847495621) 0x7fc8a40125c0 con 0x7fc8ac067e70 2021-02-24T15:16:18.122 INFO:teuthology.orchestra.run.smithi152.stdout:47244640259 2021-02-24T15:16:18.128 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.122+0000 7fc8b0d76700 10 librados: watch_flush enter 2021-02-24T15:16:18.128 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 10 librados: watch_flush exit 2021-02-24T15:16:18.128 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 20 client.4295.objecter shutdown clearing up homeless session... 2021-02-24T15:16:18.128 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 10 client.4295.objecter successfully canceled tick 2021-02-24T15:16:18.129 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 >> v1:172.21.15.181:6812/33484 conn(0x7fc888031730 legacy=0x7fc888033bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:18.129 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 >> v1:172.21.15.152:6790/0 conn(0x7fc8ac067e70 legacy=0x7fc8ac142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:18.129 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 shutdown_connections 2021-02-24T15:16:18.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 >> 172.21.15.152:0/3479499355 conn(0x7fc8ac09a940 msgr2=0x7fc8ac1244f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:18.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 shutdown_connections 2021-02-24T15:16:18.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 1 -- 172.21.15.152:0/3479499355 wait complete. 2021-02-24T15:16:18.131 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.123+0000 7fc8b0d76700 1 librados: shutdown 2021-02-24T15:16:18.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.2 2021-02-24T15:16:18.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-02-24T15:16:18.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.254+0000 7f7d7651f700 1 Processor -- start 2021-02-24T15:16:18.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.254+0000 7f7d7651f700 1 -- start start 2021-02-24T15:16:18.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.255+0000 7f7d7651f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d70097d40 con 0x7f7d70063220 2021-02-24T15:16:18.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.255+0000 7f7d7651f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d70063d00 con 0x7f7d70099340 2021-02-24T15:16:18.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.255+0000 7f7d7651f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d70097980 con 0x7f7d70062da0 2021-02-24T15:16:18.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.255+0000 7f7d6f7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f7d70062da0 0x7f7d7012fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34576/0 (socket says 172.21.15.152:34576) 2021-02-24T15:16:18.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.255+0000 7f7d74abc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7d70063220 0x7f7d70133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46104/0 (socket says 172.21.15.152:46104) 2021-02-24T15:16:18.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.255+0000 7f7d6f7fe700 1 -- 172.21.15.152:0/468908802 learned_addr learned my addr 172.21.15.152:0/468908802 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:18.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.257+0000 7f7d74abc700 1 -- 172.21.15.152:0/468908802 >> v1:172.21.15.152:6789/0 conn(0x7f7d70063220 legacy=0x7f7d70133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:18.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.257+0000 7f7d6f7fe700 1 -- 172.21.15.152:0/468908802 >> v1:172.21.15.152:6790/0 conn(0x7f7d70062da0 legacy=0x7f7d7012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:18.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.257+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216712716 0 0) 0x7f7d70097d40 con 0x7f7d70063220 2021-02-24T15:16:18.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.257+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d5c003230 con 0x7f7d70063220 2021-02-24T15:16:18.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.257+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617426413 0 0) 0x7f7d70097980 con 0x7f7d70062da0 2021-02-24T15:16:18.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.257+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d70097d40 con 0x7f7d70062da0 2021-02-24T15:16:18.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.257+0000 7f7d6ffff700 1 -- 172.21.15.152:0/468908802 >> v1:172.21.15.181:6789/0 conn(0x7f7d70099340 legacy=0x7f7d70097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:18.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2141376088 0 0) 0x7f7d70097d40 con 0x7f7d70062da0 2021-02-24T15:16:18.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 >> v1:172.21.15.181:6789/0 conn(0x7f7d70099340 legacy=0x7f7d70097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:18.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 >> v1:172.21.15.152:6789/0 conn(0x7f7d70063220 legacy=0x7f7d70133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:18.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7008fac0 con 0x7f7d70062da0 2021-02-24T15:16:18.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7d64001930 con 0x7f7d70062da0 2021-02-24T15:16:18.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d6f7fe700 1 --1- 172.21.15.152:0/468908802 >> v1:172.21.15.152:6790/0 conn(0x7f7d70062da0 0x7f7d7012fd10 :-1 s=OPENED pgs=95 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f7d64004750 mon_map magic: 0 v1 2021-02-24T15:16:18.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7d64001c40 con 0x7f7d70062da0 2021-02-24T15:16:18.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d7651f700 1 -- 172.21.15.152:0/468908802 >> v1:172.21.15.152:6790/0 conn(0x7f7d70062da0 legacy=0x7f7d7012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:18.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d6effd700 1 -- 172.21.15.152:0/468908802 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7d64004750 con 0x7f7d70062da0 2021-02-24T15:16:18.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d7651f700 1 -- 172.21.15.152:0/468908802 shutdown_connections 2021-02-24T15:16:18.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d7651f700 1 -- 172.21.15.152:0/468908802 >> 172.21.15.152:0/468908802 conn(0x7f7d7009dcc0 msgr2=0x7f7d7009e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:18.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d7651f700 1 -- 172.21.15.152:0/468908802 shutdown_connections 2021-02-24T15:16:18.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.258+0000 7f7d7651f700 1 -- 172.21.15.152:0/468908802 wait complete. 2021-02-24T15:16:18.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.259+0000 7f7d7651f700 1 librados: starting msgr at 2021-02-24T15:16:18.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.259+0000 7f7d7651f700 1 librados: starting objecter 2021-02-24T15:16:18.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.259+0000 7f7d7651f700 1 Processor -- start 2021-02-24T15:16:18.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.259+0000 7f7d7651f700 1 -- start start 2021-02-24T15:16:18.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.259+0000 7f7d7651f700 1 librados: setting wanted keys 2021-02-24T15:16:18.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.259+0000 7f7d7651f700 1 librados: calling monclient init 2021-02-24T15:16:18.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.260+0000 7f7d7651f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d70093ef0 con 0x7f7d70062da0 2021-02-24T15:16:18.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.260+0000 7f7d7651f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7013ae20 con 0x7f7d70099340 2021-02-24T15:16:18.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.260+0000 7f7d7651f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d70095ce0 con 0x7f7d70063220 2021-02-24T15:16:18.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.260+0000 7f7d6f7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f7d70063220 0x7f7d7013a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34584/0 (socket says 172.21.15.152:34584) 2021-02-24T15:16:18.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.260+0000 7f7d6ffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7d70062da0 0x7f7d7013a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46106/0 (socket says 172.21.15.152:46106) 2021-02-24T15:16:18.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.260+0000 7f7d6f7fe700 1 -- 172.21.15.152:0/1797062710 learned_addr learned my addr 172.21.15.152:0/1797062710 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:18.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d6ffff700 1 -- 172.21.15.152:0/1797062710 >> v1:172.21.15.152:6789/0 conn(0x7f7d70062da0 legacy=0x7f7d7013a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:18.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 10 client.?.objecter ms_handle_connect 0x7f7d70062da0 2021-02-24T15:16:18.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:18.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d6f7fe700 1 -- 172.21.15.152:0/1797062710 >> v1:172.21.15.152:6790/0 conn(0x7f7d70063220 legacy=0x7f7d7013a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:18.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 10 client.?.objecter ms_handle_connect 0x7f7d70063220 2021-02-24T15:16:18.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:18.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037105018 0 0) 0x7f7d70093ef0 con 0x7f7d70062da0 2021-02-24T15:16:18.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d50004bd0 con 0x7f7d70062da0 2021-02-24T15:16:18.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627862603 0 0) 0x7f7d70095ce0 con 0x7f7d70063220 2021-02-24T15:16:18.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d70093ef0 con 0x7f7d70063220 2021-02-24T15:16:18.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d74abc700 1 -- 172.21.15.152:0/1797062710 >> v1:172.21.15.181:6789/0 conn(0x7f7d70099340 legacy=0x7f7d701423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:18.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 10 client.?.objecter ms_handle_connect 0x7f7d70099340 2021-02-24T15:16:18.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:18.294 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202791017 0 0) 0x7f7d7013ae20 con 0x7f7d70099340 2021-02-24T15:16:18.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d70095ce0 con 0x7f7d70099340 2021-02-24T15:16:18.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3494992971 0 0) 0x7f7d70093ef0 con 0x7f7d70063220 2021-02-24T15:16:18.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7d7013ae20 con 0x7f7d70063220 2021-02-24T15:16:18.295 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7d64004690 con 0x7f7d70063220 2021-02-24T15:16:18.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.262+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2059450689 0 0) 0x7f7d50004bd0 con 0x7f7d70062da0 2021-02-24T15:16:18.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7d70093ef0 con 0x7f7d70062da0 2021-02-24T15:16:18.296 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7d60001b60 con 0x7f7d70062da0 2021-02-24T15:16:18.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1345250304 0 0) 0x7f7d7013ae20 con 0x7f7d70063220 2021-02-24T15:16:18.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 >> v1:172.21.15.181:6789/0 conn(0x7f7d70099340 legacy=0x7f7d701423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:18.297 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 >> v1:172.21.15.152:6789/0 conn(0x7f7d70062da0 legacy=0x7f7d7013a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:18.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d70095f80 con 0x7f7d70063220 2021-02-24T15:16:18.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d70094ab0 con 0x7f7d70063220 2021-02-24T15:16:18.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d7651f700 10 client.4301.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:18.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d700979d0 con 0x7f7d70063220 2021-02-24T15:16:18.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d7651f700 1 librados: init done 2021-02-24T15:16:18.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7d640012e0 con 0x7f7d70063220 2021-02-24T15:16:18.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.263+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7d640050d0 con 0x7f7d70063220 2021-02-24T15:16:18.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.264+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f7d6400dbd0 con 0x7f7d70063220 2021-02-24T15:16:18.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.264+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f7d6403aac0 con 0x7f7d70063220 2021-02-24T15:16:18.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.264+0000 7f7d57fff700 10 client.4301.objecter ms_dispatch 0x7f7d70001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:18.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.264+0000 7f7d57fff700 3 client.4301.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:18.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.264+0000 7f7d57fff700 3 client.4301.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:18.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.264+0000 7f7d57fff700 20 client.4301.objecter dump_active .. 0 homeless 2021-02-24T15:16:18.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.264+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d48004d60 con 0x7f7d70063220 2021-02-24T15:16:18.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.266+0000 7f7d57fff700 10 client.4301.objecter ms_handle_connect 0x7f7d50031460 2021-02-24T15:16:18.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.268+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f7d64012900 con 0x7f7d70063220 2021-02-24T15:16:18.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.437+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7d48005010 con 0x7f7d70063220 2021-02-24T15:16:18.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.437+0000 7f7d57fff700 1 -- 172.21.15.152:0/1797062710 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (unknown 383520633 0 3327677263) 0x7f7d640124f0 con 0x7f7d70063220 2021-02-24T15:16:18.439 INFO:teuthology.orchestra.run.smithi152.stdout:47244640257 2021-02-24T15:16:18.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.438+0000 7f7d7651f700 10 librados: watch_flush enter 2021-02-24T15:16:18.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 10 librados: watch_flush exit 2021-02-24T15:16:18.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 20 client.4301.objecter shutdown clearing up homeless session... 2021-02-24T15:16:18.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 10 client.4301.objecter successfully canceled tick 2021-02-24T15:16:18.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 >> v1:172.21.15.181:6812/33484 conn(0x7f7d50031460 legacy=0x7f7d50033920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:18.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 >> v1:172.21.15.152:6790/0 conn(0x7f7d70063220 legacy=0x7f7d7013a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:18.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 shutdown_connections 2021-02-24T15:16:18.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 >> 172.21.15.152:0/1797062710 conn(0x7f7d7009dcc0 msgr2=0x7f7d7009c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:18.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 shutdown_connections 2021-02-24T15:16:18.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 1 -- 172.21.15.152:0/1797062710 wait complete. 2021-02-24T15:16:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:18.439+0000 7f7d7651f700 1 librados: shutdown 2021-02-24T15:16:18.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640257 for osd.3 2021-02-24T15:16:19.452 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-02-24T15:16:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.595+0000 7fe9f67a2700 1 Processor -- start 2021-02-24T15:16:19.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.595+0000 7fe9f67a2700 1 -- start start 2021-02-24T15:16:19.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.595+0000 7fe9f67a2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f0129990 con 0x7fe9f0097040 2021-02-24T15:16:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.595+0000 7fe9f67a2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f012a2c0 con 0x7fe9f00974f0 2021-02-24T15:16:19.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.595+0000 7fe9f67a2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f009a300 con 0x7fe9f0097b10 2021-02-24T15:16:19.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.595+0000 7fe9f4f9f700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe9f0097040 0x7fe9f012fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46118/0 (socket says 172.21.15.152:46118) 2021-02-24T15:16:19.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.595+0000 7fe9f57a0700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fe9f0097b10 0x7fe9f0129bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34590/0 (socket says 172.21.15.152:34590) 2021-02-24T15:16:19.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.595+0000 7fe9f4f9f700 1 -- 172.21.15.152:0/2267838721 learned_addr learned my addr 172.21.15.152:0/2267838721 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:19.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9f57a0700 1 -- 172.21.15.152:0/2267838721 >> v1:172.21.15.152:6790/0 conn(0x7fe9f0097b10 legacy=0x7fe9f0129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9f4f9f700 1 -- 172.21.15.152:0/2267838721 >> v1:172.21.15.152:6789/0 conn(0x7fe9f0097040 legacy=0x7fe9f012fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775398462 0 0) 0x7fe9f009a300 con 0x7fe9f0097b10 2021-02-24T15:16:19.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d8003230 con 0x7fe9f0097b10 2021-02-24T15:16:19.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402571831 0 0) 0x7fe9f0129990 con 0x7fe9f0097040 2021-02-24T15:16:19.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f009a300 con 0x7fe9f0097040 2021-02-24T15:16:19.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9f5fa1700 1 -- 172.21.15.152:0/2267838721 >> v1:172.21.15.181:6789/0 conn(0x7fe9f00974f0 legacy=0x7fe9f0133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650216275 0 0) 0x7fe9f012a2c0 con 0x7fe9f00974f0 2021-02-24T15:16:19.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f0129990 con 0x7fe9f00974f0 2021-02-24T15:16:19.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1406036985 0 0) 0x7fe9f009a300 con 0x7fe9f0097040 2021-02-24T15:16:19.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 >> v1:172.21.15.152:6790/0 conn(0x7fe9f0097b10 legacy=0x7fe9f0129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 >> v1:172.21.15.181:6789/0 conn(0x7fe9f00974f0 legacy=0x7fe9f0133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f008fb30 con 0x7fe9f0097040 2021-02-24T15:16:19.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe9e0001930 con 0x7fe9f0097040 2021-02-24T15:16:19.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe9e0001c40 con 0x7fe9f0097040 2021-02-24T15:16:19.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.598+0000 7fe9dffff700 1 -- 172.21.15.152:0/2267838721 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe9e0004750 con 0x7fe9f0097040 2021-02-24T15:16:19.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.599+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2267838721 >> v1:172.21.15.152:6789/0 conn(0x7fe9f0097040 legacy=0x7fe9f012fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.599+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2267838721 shutdown_connections 2021-02-24T15:16:19.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.599+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2267838721 >> 172.21.15.152:0/2267838721 conn(0x7fe9f009d9e0 msgr2=0x7fe9f009ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:19.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.599+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2267838721 shutdown_connections 2021-02-24T15:16:19.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.599+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2267838721 wait complete. 2021-02-24T15:16:19.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f67a2700 1 librados: starting msgr at 2021-02-24T15:16:19.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f67a2700 1 librados: starting objecter 2021-02-24T15:16:19.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f67a2700 1 Processor -- start 2021-02-24T15:16:19.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f67a2700 1 -- start start 2021-02-24T15:16:19.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f67a2700 1 librados: setting wanted keys 2021-02-24T15:16:19.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f67a2700 1 librados: calling monclient init 2021-02-24T15:16:19.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f67a2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f0114510 con 0x7fe9f0097040 2021-02-24T15:16:19.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f67a2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f01147b0 con 0x7fe9f0097b10 2021-02-24T15:16:19.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f67a2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f0114a50 con 0x7fe9f00974f0 2021-02-24T15:16:19.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f57a0700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe9f0097040 0x7fe9f0127010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46120/0 (socket says 172.21.15.152:46120) 2021-02-24T15:16:19.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f4f9f700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fe9f00974f0 0x7fe9f013f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34598/0 (socket says 172.21.15.152:34598) 2021-02-24T15:16:19.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.600+0000 7fe9f57a0700 1 -- 172.21.15.152:0/2334129560 learned_addr learned my addr 172.21.15.152:0/2334129560 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:19.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9f57a0700 1 -- 172.21.15.152:0/2334129560 >> v1:172.21.15.152:6789/0 conn(0x7fe9f0097040 legacy=0x7fe9f0127010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9f4f9f700 1 -- 172.21.15.152:0/2334129560 >> v1:172.21.15.152:6790/0 conn(0x7fe9f00974f0 legacy=0x7fe9f013f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 10 client.?.objecter ms_handle_connect 0x7fe9f0097040 2021-02-24T15:16:19.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:19.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 10 client.?.objecter ms_handle_connect 0x7fe9f00974f0 2021-02-24T15:16:19.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:19.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091713153 0 0) 0x7fe9f0114510 con 0x7fe9f0097040 2021-02-24T15:16:19.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d0004bd0 con 0x7fe9f0097040 2021-02-24T15:16:19.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 10 client.?.objecter ms_handle_connect 0x7fe9f0097b10 2021-02-24T15:16:19.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9f5fa1700 1 -- 172.21.15.152:0/2334129560 >> v1:172.21.15.181:6789/0 conn(0x7fe9f0097b10 legacy=0x7fe9f01427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:19.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683297130 0 0) 0x7fe9f0114a50 con 0x7fe9f00974f0 2021-02-24T15:16:19.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f0114510 con 0x7fe9f00974f0 2021-02-24T15:16:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640227998 0 0) 0x7fe9f01147b0 con 0x7fe9f0097b10 2021-02-24T15:16:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f0114a50 con 0x7fe9f0097b10 2021-02-24T15:16:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2909177098 0 0) 0x7fe9f0114510 con 0x7fe9f00974f0 2021-02-24T15:16:19.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9f01147b0 con 0x7fe9f00974f0 2021-02-24T15:16:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe9e00018f0 con 0x7fe9f00974f0 2021-02-24T15:16:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3356551827 0 0) 0x7fe9d0004bd0 con 0x7fe9f0097040 2021-02-24T15:16:19.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9f0114510 con 0x7fe9f0097040 2021-02-24T15:16:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe9ec001990 con 0x7fe9f0097040 2021-02-24T15:16:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 280239434 0 0) 0x7fe9f0114a50 con 0x7fe9f0097b10 2021-02-24T15:16:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9d0004bd0 con 0x7fe9f0097b10 2021-02-24T15:16:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe9e8001f60 con 0x7fe9f0097b10 2021-02-24T15:16:19.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 55735347 0 0) 0x7fe9f01147b0 con 0x7fe9f00974f0 2021-02-24T15:16:19.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 >> v1:172.21.15.181:6789/0 conn(0x7fe9f0097b10 legacy=0x7fe9f01427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 >> v1:172.21.15.152:6789/0 conn(0x7fe9f0097040 legacy=0x7fe9f0127010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f013ac20 con 0x7fe9f00974f0 2021-02-24T15:16:19.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f0096360 con 0x7fe9f00974f0 2021-02-24T15:16:19.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9f67a2700 10 client.4307.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:19.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f012f260 con 0x7fe9f00974f0 2021-02-24T15:16:19.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9f67a2700 1 librados: init done 2021-02-24T15:16:19.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe9e0001560 con 0x7fe9f00974f0 2021-02-24T15:16:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.603+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe9e0004ea0 con 0x7fe9f00974f0 2021-02-24T15:16:19.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.604+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fe9e000d9a0 con 0x7fe9f00974f0 2021-02-24T15:16:19.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.604+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7fe9e003ab40 con 0x7fe9f00974f0 2021-02-24T15:16:19.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.604+0000 7fe9dd7fa700 10 client.4307.objecter ms_dispatch 0x7fe9f0001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:19.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.604+0000 7fe9dd7fa700 3 client.4307.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:19.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.604+0000 7fe9dd7fa700 3 client.4307.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:19.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.604+0000 7fe9dd7fa700 20 client.4307.objecter dump_active .. 0 homeless 2021-02-24T15:16:19.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.604+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c8004d60 con 0x7fe9f00974f0 2021-02-24T15:16:19.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.607+0000 7fe9dd7fa700 10 client.4307.objecter ms_handle_connect 0x7fe9d0031750 2021-02-24T15:16:19.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.608+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fe9e0012980 con 0x7fe9f00974f0 2021-02-24T15:16:19.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.776+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9c8005010 con 0x7fe9f00974f0 2021-02-24T15:16:19.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.776+0000 7fe9dd7fa700 1 -- 172.21.15.152:0/2334129560 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (unknown 383520633 0 847495621) 0x7fe9e0012570 con 0x7fe9f00974f0 2021-02-24T15:16:19.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 10 librados: watch_flush enter 2021-02-24T15:16:19.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 10 librados: watch_flush exit 2021-02-24T15:16:19.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 20 client.4307.objecter shutdown clearing up homeless session... 2021-02-24T15:16:19.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 10 client.4307.objecter successfully canceled tick 2021-02-24T15:16:19.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 >> v1:172.21.15.181:6812/33484 conn(0x7fe9d0031750 legacy=0x7fe9d0033c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 >> v1:172.21.15.152:6790/0 conn(0x7fe9f00974f0 legacy=0x7fe9f013f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 shutdown_connections 2021-02-24T15:16:19.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 >> 172.21.15.152:0/2334129560 conn(0x7fe9f009d9e0 msgr2=0x7fe9f012da90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:19.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 shutdown_connections 2021-02-24T15:16:19.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 1 -- 172.21.15.152:0/2334129560 wait complete. 2021-02-24T15:16:19.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.778+0000 7fe9f67a2700 1 librados: shutdown 2021-02-24T15:16:19.791 INFO:teuthology.orchestra.run.smithi152.stdout:47244640259 2021-02-24T15:16:19.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640259 for osd.3 2021-02-24T15:16:19.793 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-02-24T15:16:19.932 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.930+0000 7fc261ff3700 1 Processor -- start 2021-02-24T15:16:19.932 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.930+0000 7fc261ff3700 1 -- start start 2021-02-24T15:16:19.933 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.931+0000 7fc261ff3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c062660 con 0x7fc25c0966a0 2021-02-24T15:16:19.933 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.931+0000 7fc261ff3700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c063af0 con 0x7fc25c068410 2021-02-24T15:16:19.933 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.931+0000 7fc261ff3700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c063d90 con 0x7fc25c095bb0 2021-02-24T15:16:19.934 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.931+0000 7fc25affd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc25c095bb0 0x7fc25c130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34604/0 (socket says 172.21.15.152:34604) 2021-02-24T15:16:19.934 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.931+0000 7fc25affd700 1 -- 172.21.15.152:0/671343210 learned_addr learned my addr 172.21.15.152:0/671343210 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:19.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25b7fe700 1 -- 172.21.15.152:0/671343210 >> v1:172.21.15.152:6789/0 conn(0x7fc25c0966a0 legacy=0x7fc25c096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25affd700 1 -- 172.21.15.152:0/671343210 >> v1:172.21.15.152:6790/0 conn(0x7fc25c095bb0 legacy=0x7fc25c130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037385687 0 0) 0x7fc25c062660 con 0x7fc25c0966a0 2021-02-24T15:16:19.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25bfff700 1 -- 172.21.15.152:0/671343210 >> v1:172.21.15.181:6789/0 conn(0x7fc25c068410 legacy=0x7fc25c133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc248003230 con 0x7fc25c0966a0 2021-02-24T15:16:19.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708737654 0 0) 0x7fc25c063d90 con 0x7fc25c095bb0 2021-02-24T15:16:19.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc25c062660 con 0x7fc25c095bb0 2021-02-24T15:16:19.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129673185 0 0) 0x7fc25c063af0 con 0x7fc25c068410 2021-02-24T15:16:19.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc25c063d90 con 0x7fc25c068410 2021-02-24T15:16:19.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 480507425 0 0) 0x7fc25c062660 con 0x7fc25c095bb0 2021-02-24T15:16:19.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 >> v1:172.21.15.181:6789/0 conn(0x7fc25c068410 legacy=0x7fc25c133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 >> v1:172.21.15.152:6789/0 conn(0x7fc25c0966a0 legacy=0x7fc25c096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.933+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c064030 con 0x7fc25c095bb0 2021-02-24T15:16:19.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.934+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc2500019f0 con 0x7fc25c095bb0 2021-02-24T15:16:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.934+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc250001c50 con 0x7fc25c095bb0 2021-02-24T15:16:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.934+0000 7fc25a7fc700 1 -- 172.21.15.152:0/671343210 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc250004750 con 0x7fc25c095bb0 2021-02-24T15:16:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.934+0000 7fc261ff3700 1 -- 172.21.15.152:0/671343210 >> v1:172.21.15.152:6790/0 conn(0x7fc25c095bb0 legacy=0x7fc25c130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.934+0000 7fc261ff3700 1 -- 172.21.15.152:0/671343210 shutdown_connections 2021-02-24T15:16:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.934+0000 7fc261ff3700 1 -- 172.21.15.152:0/671343210 >> 172.21.15.152:0/671343210 conn(0x7fc25c09ba40 msgr2=0x7fc25c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.934+0000 7fc261ff3700 1 -- 172.21.15.152:0/671343210 shutdown_connections 2021-02-24T15:16:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.934+0000 7fc261ff3700 1 -- 172.21.15.152:0/671343210 wait complete. 2021-02-24T15:16:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.935+0000 7fc261ff3700 1 librados: starting msgr at 2021-02-24T15:16:19.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.935+0000 7fc261ff3700 1 librados: starting objecter 2021-02-24T15:16:19.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.935+0000 7fc261ff3700 1 Processor -- start 2021-02-24T15:16:19.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.935+0000 7fc261ff3700 1 -- start start 2021-02-24T15:16:19.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.935+0000 7fc261ff3700 1 librados: setting wanted keys 2021-02-24T15:16:19.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.935+0000 7fc261ff3700 1 librados: calling monclient init 2021-02-24T15:16:19.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.936+0000 7fc261ff3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c063010 con 0x7fc25c0966a0 2021-02-24T15:16:19.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.936+0000 7fc261ff3700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c11abe0 con 0x7fc25c068410 2021-02-24T15:16:19.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.936+0000 7fc261ff3700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c067420 con 0x7fc25c095bb0 2021-02-24T15:16:19.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.936+0000 7fc25affd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc25c095bb0 0x7fc25c133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34612/0 (socket says 172.21.15.152:34612) 2021-02-24T15:16:19.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.936+0000 7fc25affd700 1 -- 172.21.15.152:0/1588907112 learned_addr learned my addr 172.21.15.152:0/1588907112 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:19.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc25bfff700 1 -- 172.21.15.152:0/1588907112 >> v1:172.21.15.152:6789/0 conn(0x7fc25c0966a0 legacy=0x7fc25c1420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc25affd700 1 -- 172.21.15.152:0/1588907112 >> v1:172.21.15.152:6790/0 conn(0x7fc25c095bb0 legacy=0x7fc25c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 10 client.?.objecter ms_handle_connect 0x7fc25c0966a0 2021-02-24T15:16:19.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:19.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 10 client.?.objecter ms_handle_connect 0x7fc25c095bb0 2021-02-24T15:16:19.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:19.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513060036 0 0) 0x7fc25c063010 con 0x7fc25c0966a0 2021-02-24T15:16:19.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc23c004bd0 con 0x7fc25c0966a0 2021-02-24T15:16:19.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052195112 0 0) 0x7fc25c067420 con 0x7fc25c095bb0 2021-02-24T15:16:19.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc25c063010 con 0x7fc25c095bb0 2021-02-24T15:16:19.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 10 client.?.objecter ms_handle_connect 0x7fc25c068410 2021-02-24T15:16:19.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc25b7fe700 1 -- 172.21.15.152:0/1588907112 >> v1:172.21.15.181:6789/0 conn(0x7fc25c068410 legacy=0x7fc25c13a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:19.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:19.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 9329441 0 0) 0x7fc23c004bd0 con 0x7fc25c0966a0 2021-02-24T15:16:19.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc25c067420 con 0x7fc25c0966a0 2021-02-24T15:16:19.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc254001f60 con 0x7fc25c0966a0 2021-02-24T15:16:19.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2957910737 0 0) 0x7fc25c063010 con 0x7fc25c095bb0 2021-02-24T15:16:19.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc23c004bd0 con 0x7fc25c095bb0 2021-02-24T15:16:19.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056586703 0 0) 0x7fc25c11abe0 con 0x7fc25c068410 2021-02-24T15:16:19.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc25c063010 con 0x7fc25c068410 2021-02-24T15:16:19.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc2500019b0 con 0x7fc25c095bb0 2021-02-24T15:16:19.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 472020113 0 0) 0x7fc25c067420 con 0x7fc25c0966a0 2021-02-24T15:16:19.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 >> v1:172.21.15.152:6790/0 conn(0x7fc25c095bb0 legacy=0x7fc25c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 >> v1:172.21.15.181:6789/0 conn(0x7fc25c068410 legacy=0x7fc25c13a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:19.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c1343e0 con 0x7fc25c0966a0 2021-02-24T15:16:19.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25c11a1e0 con 0x7fc25c0966a0 2021-02-24T15:16:19.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc261ff3700 10 client.4317.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:19.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25c118ba0 con 0x7fc25c0966a0 2021-02-24T15:16:19.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.938+0000 7fc261ff3700 1 librados: init done 2021-02-24T15:16:19.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.939+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc2540025b0 con 0x7fc25c0966a0 2021-02-24T15:16:19.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.939+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc2540028c0 con 0x7fc25c0966a0 2021-02-24T15:16:19.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.939+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fc254002ae0 con 0x7fc25c0966a0 2021-02-24T15:16:19.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.939+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc234004d60 con 0x7fc25c0966a0 2021-02-24T15:16:19.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.939+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7fc25403ace0 con 0x7fc25c0966a0 2021-02-24T15:16:19.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.939+0000 7fc2437fe700 10 client.4317.objecter ms_dispatch 0x7fc25c001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:19.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.939+0000 7fc2437fe700 3 client.4317.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:19.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.939+0000 7fc2437fe700 3 client.4317.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:19.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.940+0000 7fc2437fe700 20 client.4317.objecter dump_active .. 0 homeless 2021-02-24T15:16:19.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.942+0000 7fc2437fe700 10 client.4317.objecter ms_handle_connect 0x7fc23c031750 2021-02-24T15:16:19.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:19.943+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fc254012b40 con 0x7fc25c0966a0 2021-02-24T15:16:20.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.111+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc234005010 con 0x7fc25c0966a0 2021-02-24T15:16:20.113 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.112+0000 7fc2437fe700 1 -- 172.21.15.152:0/1588907112 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (unknown 1823589948 0 1444633209) 0x7fc254012730 con 0x7fc25c0966a0 2021-02-24T15:16:20.113 INFO:teuthology.orchestra.run.smithi152.stdout:47244640260 2021-02-24T15:16:20.115 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 10 librados: watch_flush enter 2021-02-24T15:16:20.115 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 10 librados: watch_flush exit 2021-02-24T15:16:20.115 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 20 client.4317.objecter shutdown clearing up homeless session... 2021-02-24T15:16:20.115 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 10 client.4317.objecter successfully canceled tick 2021-02-24T15:16:20.115 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 >> v1:172.21.15.181:6812/33484 conn(0x7fc23c031750 legacy=0x7fc23c033c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.116 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 >> v1:172.21.15.152:6789/0 conn(0x7fc25c0966a0 legacy=0x7fc25c1420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.116 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 shutdown_connections 2021-02-24T15:16:20.116 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 >> 172.21.15.152:0/1588907112 conn(0x7fc25c09ba40 msgr2=0x7fc25c09a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:20.116 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 shutdown_connections 2021-02-24T15:16:20.116 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 1 -- 172.21.15.152:0/1588907112 wait complete. 2021-02-24T15:16:20.117 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.113+0000 7fc261ff3700 1 librados: shutdown 2021-02-24T15:16:20.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.4 2021-02-24T15:16:20.127 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-02-24T15:16:20.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.253+0000 7f8aec651700 1 Processor -- start 2021-02-24T15:16:20.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.253+0000 7f8aec651700 1 -- start start 2021-02-24T15:16:20.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.253+0000 7f8aec651700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae412b0d0 con 0x7f8ae40613c0 2021-02-24T15:16:20.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.253+0000 7f8aec651700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae4098a60 con 0x7f8ae40679c0 2021-02-24T15:16:20.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.253+0000 7f8aec651700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae409a0b0 con 0x7f8ae4067e70 2021-02-24T15:16:20.266 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.254+0000 7f8aea3ed700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8ae40613c0 0x7f8ae412a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46142/0 (socket says 172.21.15.152:46142) 2021-02-24T15:16:20.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.254+0000 7f8aea3ed700 1 -- 172.21.15.152:0/757346373 learned_addr learned my addr 172.21.15.152:0/757346373 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:20.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.254+0000 7f8aeabee700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f8ae4067e70 0x7f8ae4133410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34618/0 (socket says 172.21.15.152:34618) 2021-02-24T15:16:20.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8aeabee700 1 -- 172.21.15.152:0/757346373 >> v1:172.21.15.152:6790/0 conn(0x7f8ae4067e70 legacy=0x7f8ae4133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8aea3ed700 1 -- 172.21.15.152:0/757346373 >> v1:172.21.15.152:6789/0 conn(0x7f8ae40613c0 legacy=0x7f8ae412a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae9bec700 1 -- 172.21.15.152:0/757346373 >> v1:172.21.15.181:6789/0 conn(0x7f8ae40679c0 legacy=0x7f8ae412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444808630 0 0) 0x7f8ae409a0b0 con 0x7f8ae4067e70 2021-02-24T15:16:20.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8acc003230 con 0x7f8ae4067e70 2021-02-24T15:16:20.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255491438 0 0) 0x7f8ae412b0d0 con 0x7f8ae40613c0 2021-02-24T15:16:20.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae409a0b0 con 0x7f8ae40613c0 2021-02-24T15:16:20.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361988937 0 0) 0x7f8ae4098a60 con 0x7f8ae40679c0 2021-02-24T15:16:20.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae412b0d0 con 0x7f8ae40679c0 2021-02-24T15:16:20.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2097220533 0 0) 0x7f8acc003230 con 0x7f8ae4067e70 2021-02-24T15:16:20.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 >> v1:172.21.15.181:6789/0 conn(0x7f8ae40679c0 legacy=0x7f8ae412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 >> v1:172.21.15.152:6789/0 conn(0x7f8ae40613c0 legacy=0x7f8ae412a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.256+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae409a350 con 0x7f8ae4067e70 2021-02-24T15:16:20.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.257+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8adc001db0 con 0x7f8ae4067e70 2021-02-24T15:16:20.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.257+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8adc001fd0 con 0x7f8ae4067e70 2021-02-24T15:16:20.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.257+0000 7f8ae93eb700 1 -- 172.21.15.152:0/757346373 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8adc004a10 con 0x7f8ae4067e70 2021-02-24T15:16:20.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.257+0000 7f8aec651700 1 -- 172.21.15.152:0/757346373 >> v1:172.21.15.152:6790/0 conn(0x7f8ae4067e70 legacy=0x7f8ae4133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.257+0000 7f8aec651700 1 -- 172.21.15.152:0/757346373 shutdown_connections 2021-02-24T15:16:20.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.257+0000 7f8aec651700 1 -- 172.21.15.152:0/757346373 >> 172.21.15.152:0/757346373 conn(0x7f8ae409a940 msgr2=0x7f8ae409ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:20.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.257+0000 7f8aec651700 1 -- 172.21.15.152:0/757346373 shutdown_connections 2021-02-24T15:16:20.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.257+0000 7f8aec651700 1 -- 172.21.15.152:0/757346373 wait complete. 2021-02-24T15:16:20.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.258+0000 7f8aec651700 1 librados: starting msgr at 2021-02-24T15:16:20.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.258+0000 7f8aec651700 1 librados: starting objecter 2021-02-24T15:16:20.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.258+0000 7f8aec651700 1 Processor -- start 2021-02-24T15:16:20.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.258+0000 7f8aec651700 1 -- start start 2021-02-24T15:16:20.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.258+0000 7f8aec651700 1 librados: setting wanted keys 2021-02-24T15:16:20.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.258+0000 7f8aec651700 1 librados: calling monclient init 2021-02-24T15:16:20.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.259+0000 7f8aec651700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae4120c50 con 0x7f8ae40613c0 2021-02-24T15:16:20.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.259+0000 7f8aec651700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae4120ef0 con 0x7f8ae40679c0 2021-02-24T15:16:20.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.259+0000 7f8aec651700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae4121190 con 0x7f8ae4067e70 2021-02-24T15:16:20.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.259+0000 7f8aea3ed700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8ae40613c0 0x7f8ae4138350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46146/0 (socket says 172.21.15.152:46146) 2021-02-24T15:16:20.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.259+0000 7f8aea3ed700 1 -- 172.21.15.152:0/919766158 learned_addr learned my addr 172.21.15.152:0/919766158 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:20.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8aea3ed700 1 -- 172.21.15.152:0/919766158 >> v1:172.21.15.152:6789/0 conn(0x7f8ae40613c0 legacy=0x7f8ae4138350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 10 client.?.objecter ms_handle_connect 0x7f8ae40613c0 2021-02-24T15:16:20.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8aeabee700 1 -- 172.21.15.152:0/919766158 >> v1:172.21.15.152:6790/0 conn(0x7f8ae4067e70 legacy=0x7f8ae4142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:20.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 10 client.?.objecter ms_handle_connect 0x7f8ae4067e70 2021-02-24T15:16:20.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:20.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ae9bec700 1 -- 172.21.15.152:0/919766158 >> v1:172.21.15.181:6789/0 conn(0x7f8ae40679c0 legacy=0x7f8ae4123650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150722614 0 0) 0x7f8ae4120c50 con 0x7f8ae40613c0 2021-02-24T15:16:20.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac4004bd0 con 0x7f8ae40613c0 2021-02-24T15:16:20.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 10 client.?.objecter ms_handle_connect 0x7f8ae40679c0 2021-02-24T15:16:20.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:20.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574256018 0 0) 0x7f8ae4121190 con 0x7f8ae4067e70 2021-02-24T15:16:20.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae4120c50 con 0x7f8ae4067e70 2021-02-24T15:16:20.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198889385 0 0) 0x7f8ae4120ef0 con 0x7f8ae40679c0 2021-02-24T15:16:20.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae4121190 con 0x7f8ae40679c0 2021-02-24T15:16:20.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1871177422 0 0) 0x7f8ac4004bd0 con 0x7f8ae40613c0 2021-02-24T15:16:20.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ae4120ef0 con 0x7f8ae40613c0 2021-02-24T15:16:20.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8ae00044f0 con 0x7f8ae40613c0 2021-02-24T15:16:20.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 852071770 0 0) 0x7f8ae4120c50 con 0x7f8ae4067e70 2021-02-24T15:16:20.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ac4004bd0 con 0x7f8ae4067e70 2021-02-24T15:16:20.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8adc004a10 con 0x7f8ae4067e70 2021-02-24T15:16:20.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 279807483 0 0) 0x7f8ae4121190 con 0x7f8ae40679c0 2021-02-24T15:16:20.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ae4120c50 con 0x7f8ae40679c0 2021-02-24T15:16:20.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 486639053 0 0) 0x7f8ae4120ef0 con 0x7f8ae40613c0 2021-02-24T15:16:20.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 >> v1:172.21.15.152:6790/0 conn(0x7f8ae4067e70 legacy=0x7f8ae4142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 >> v1:172.21.15.181:6789/0 conn(0x7f8ae40679c0 legacy=0x7f8ae4123650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae4067750 con 0x7f8ae40613c0 2021-02-24T15:16:20.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae4123d60 con 0x7f8ae40613c0 2021-02-24T15:16:20.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.261+0000 7f8aec651700 10 client.4323.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:20.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.262+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae4066df0 con 0x7f8ae40613c0 2021-02-24T15:16:20.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.262+0000 7f8aec651700 1 librados: init done 2021-02-24T15:16:20.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.262+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8ae0004a00 con 0x7f8ae40613c0 2021-02-24T15:16:20.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.262+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8ae0004d10 con 0x7f8ae40613c0 2021-02-24T15:16:20.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.262+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f8ae0004e70 con 0x7f8ae40613c0 2021-02-24T15:16:20.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.262+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f8ae003aaf0 con 0x7f8ae40613c0 2021-02-24T15:16:20.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.262+0000 7f8ad27fc700 10 client.4323.objecter ms_dispatch 0x7f8ae4001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:20.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.262+0000 7f8ad27fc700 3 client.4323.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:20.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.262+0000 7f8ad27fc700 3 client.4323.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:20.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.263+0000 7f8ad27fc700 20 client.4323.objecter dump_active .. 0 homeless 2021-02-24T15:16:20.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.263+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac8004d60 con 0x7f8ae40613c0 2021-02-24T15:16:20.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.265+0000 7f8ad27fc700 10 client.4323.objecter ms_handle_connect 0x7f8ac40316c0 2021-02-24T15:16:20.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.267+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f8ae00128d0 con 0x7f8ae40613c0 2021-02-24T15:16:20.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.435+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8ac8005010 con 0x7f8ae40613c0 2021-02-24T15:16:20.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.435+0000 7f8ad27fc700 1 -- 172.21.15.152:0/919766158 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (unknown 2131975755 0 1444633209) 0x7f8ae00124c0 con 0x7f8ae40613c0 2021-02-24T15:16:20.438 INFO:teuthology.orchestra.run.smithi152.stdout:47244640260 2021-02-24T15:16:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 10 librados: watch_flush enter 2021-02-24T15:16:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 10 librados: watch_flush exit 2021-02-24T15:16:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 20 client.4323.objecter shutdown clearing up homeless session... 2021-02-24T15:16:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 10 client.4323.objecter successfully canceled tick 2021-02-24T15:16:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 >> v1:172.21.15.181:6812/33484 conn(0x7f8ac40316c0 legacy=0x7f8ac4033b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 >> v1:172.21.15.152:6789/0 conn(0x7f8ae40613c0 legacy=0x7f8ae4138350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 shutdown_connections 2021-02-24T15:16:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 >> 172.21.15.152:0/919766158 conn(0x7f8ae409a940 msgr2=0x7f8ae41244f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 shutdown_connections 2021-02-24T15:16:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 1 -- 172.21.15.152:0/919766158 wait complete. 2021-02-24T15:16:20.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.437+0000 7f8aec651700 1 librados: shutdown 2021-02-24T15:16:20.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.5 2021-02-24T15:16:20.450 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-02-24T15:16:20.450 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-24T15:16:20.566 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.565+0000 7f989ca30700 1 Processor -- start 2021-02-24T15:16:20.566 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.565+0000 7f989ca30700 1 -- start start 2021-02-24T15:16:20.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.566+0000 7f989ca30700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9898097520 con 0x7f9898131270 2021-02-24T15:16:20.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.566+0000 7f989ca30700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98980955e0 con 0x7f98980959f0 2021-02-24T15:16:20.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.566+0000 7f989ca30700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9898063db0 con 0x7f9898068310 2021-02-24T15:16:20.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.566+0000 7f9896d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9898131270 0x7f9898133660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46158/0 (socket says 172.21.15.152:46158) 2021-02-24T15:16:20.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.566+0000 7f989659c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f9898068310 0x7f9898096700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34630/0 (socket says 172.21.15.152:34630) 2021-02-24T15:16:20.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.566+0000 7f9896d9d700 1 -- 172.21.15.152:0/3621422840 learned_addr learned my addr 172.21.15.152:0/3621422840 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:20.571 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989659c700 1 -- 172.21.15.152:0/3621422840 >> v1:172.21.15.152:6790/0 conn(0x7f9898068310 legacy=0x7f9898096700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.571 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f9896d9d700 1 -- 172.21.15.152:0/3621422840 >> v1:172.21.15.152:6789/0 conn(0x7f9898131270 legacy=0x7f9898133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.571 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f9895d9b700 1 -- 172.21.15.152:0/3621422840 >> v1:172.21.15.181:6789/0 conn(0x7f98980959f0 legacy=0x7f9898096e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.571 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042338421 0 0) 0x7f9898063db0 con 0x7f9898068310 2021-02-24T15:16:20.572 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f987c003230 con 0x7f9898068310 2021-02-24T15:16:20.572 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595640868 0 0) 0x7f9898097520 con 0x7f9898131270 2021-02-24T15:16:20.572 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9898063db0 con 0x7f9898131270 2021-02-24T15:16:20.572 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137342944 0 0) 0x7f98980955e0 con 0x7f98980959f0 2021-02-24T15:16:20.573 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9898097520 con 0x7f98980959f0 2021-02-24T15:16:20.573 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 351171487 0 0) 0x7f9898063db0 con 0x7f9898131270 2021-02-24T15:16:20.573 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 >> v1:172.21.15.152:6790/0 conn(0x7f9898068310 legacy=0x7f9898096700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.573 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 >> v1:172.21.15.181:6789/0 conn(0x7f98980959f0 legacy=0x7f9898096e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898064050 con 0x7f9898131270 2021-02-24T15:16:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.568+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9890001cb0 con 0x7f9898131270 2021-02-24T15:16:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.569+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9890001fc0 con 0x7f9898131270 2021-02-24T15:16:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.569+0000 7f989559a700 1 -- 172.21.15.152:0/3621422840 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9890004ad0 con 0x7f9898131270 2021-02-24T15:16:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.569+0000 7f989ca30700 1 -- 172.21.15.152:0/3621422840 >> v1:172.21.15.152:6789/0 conn(0x7f9898131270 legacy=0x7f9898133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.569+0000 7f989ca30700 1 -- 172.21.15.152:0/3621422840 shutdown_connections 2021-02-24T15:16:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.569+0000 7f989ca30700 1 -- 172.21.15.152:0/3621422840 >> 172.21.15.152:0/3621422840 conn(0x7f989809ba40 msgr2=0x7f989809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:20.577 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.569+0000 7f989ca30700 1 -- 172.21.15.152:0/3621422840 shutdown_connections 2021-02-24T15:16:20.577 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.569+0000 7f989ca30700 1 -- 172.21.15.152:0/3621422840 wait complete. 2021-02-24T15:16:20.577 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f989ca30700 1 librados: starting msgr at 2021-02-24T15:16:20.577 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f989ca30700 1 librados: starting objecter 2021-02-24T15:16:20.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f989ca30700 1 Processor -- start 2021-02-24T15:16:20.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f989ca30700 1 -- start start 2021-02-24T15:16:20.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f989ca30700 1 librados: setting wanted keys 2021-02-24T15:16:20.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f989ca30700 1 librados: calling monclient init 2021-02-24T15:16:20.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f989ca30700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989813a3e0 con 0x7f98980959f0 2021-02-24T15:16:20.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f989ca30700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989812ae40 con 0x7f9898068310 2021-02-24T15:16:20.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f989ca30700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9898114ea0 con 0x7f9898131270 2021-02-24T15:16:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f9895d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f98980959f0 0x7f989812a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46162/0 (socket says 172.21.15.152:46162) 2021-02-24T15:16:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f9895d9b700 1 -- 172.21.15.152:0/2720000736 learned_addr learned my addr 172.21.15.152:0/2720000736 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.570+0000 7f9896d9d700 1 --1- 172.21.15.152:0/2720000736 >> v1:172.21.15.152:6790/0 conn(0x7f9898131270 0x7f9898141fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34640/0 (socket says 172.21.15.152:34640) 2021-02-24T15:16:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f9896d9d700 1 -- 172.21.15.152:0/2720000736 >> v1:172.21.15.152:6790/0 conn(0x7f9898131270 legacy=0x7f9898141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f9895d9b700 1 -- 172.21.15.152:0/2720000736 >> v1:172.21.15.152:6789/0 conn(0x7f98980959f0 legacy=0x7f989812a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 10 client.?.objecter ms_handle_connect 0x7f9898131270 2021-02-24T15:16:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 10 client.?.objecter ms_handle_connect 0x7f98980959f0 2021-02-24T15:16:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:20.585 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870544051 0 0) 0x7f9898114ea0 con 0x7f9898131270 2021-02-24T15:16:20.585 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9874004bd0 con 0x7f9898131270 2021-02-24T15:16:20.586 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325200988 0 0) 0x7f989813a3e0 con 0x7f98980959f0 2021-02-24T15:16:20.586 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9898114ea0 con 0x7f98980959f0 2021-02-24T15:16:20.587 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 10 client.?.objecter ms_handle_connect 0x7f9898068310 2021-02-24T15:16:20.587 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f989659c700 1 -- 172.21.15.152:0/2720000736 >> v1:172.21.15.181:6789/0 conn(0x7f9898068310 legacy=0x7f9898139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.587 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:20.587 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2739884635 0 0) 0x7f9898114ea0 con 0x7f98980959f0 2021-02-24T15:16:20.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f989813a3e0 con 0x7f98980959f0 2021-02-24T15:16:20.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f988c001c40 con 0x7f98980959f0 2021-02-24T15:16:20.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1465053288 0 0) 0x7f9874004bd0 con 0x7f9898131270 2021-02-24T15:16:20.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9898114ea0 con 0x7f9898131270 2021-02-24T15:16:20.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9890001c70 con 0x7f9898131270 2021-02-24T15:16:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597051073 0 0) 0x7f989812ae40 con 0x7f9898068310 2021-02-24T15:16:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9874004bd0 con 0x7f9898068310 2021-02-24T15:16:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3943058737 0 0) 0x7f989813a3e0 con 0x7f98980959f0 2021-02-24T15:16:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 >> v1:172.21.15.152:6790/0 conn(0x7f9898131270 legacy=0x7f9898141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 >> v1:172.21.15.181:6789/0 conn(0x7f9898068310 legacy=0x7f9898139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898115140 con 0x7f98980959f0 2021-02-24T15:16:20.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9898062f30 con 0x7f98980959f0 2021-02-24T15:16:20.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f989ca30700 10 client.4329.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:20.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9898113b30 con 0x7f98980959f0 2021-02-24T15:16:20.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f989ca30700 1 librados: init done 2021-02-24T15:16:20.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f988c002370 con 0x7f98980959f0 2021-02-24T15:16:20.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.573+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f988c002680 con 0x7f98980959f0 2021-02-24T15:16:20.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.574+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f988c002820 con 0x7f98980959f0 2021-02-24T15:16:20.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.574+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9878004d60 con 0x7f98980959f0 2021-02-24T15:16:20.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.574+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f988c03a970 con 0x7f98980959f0 2021-02-24T15:16:20.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.574+0000 7f98867fc700 10 client.4329.objecter ms_dispatch 0x7f9898001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:20.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.574+0000 7f98867fc700 3 client.4329.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:20.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.574+0000 7f98867fc700 3 client.4329.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:20.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.574+0000 7f98867fc700 20 client.4329.objecter dump_active .. 0 homeless 2021-02-24T15:16:20.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.577+0000 7f98867fc700 10 client.4329.objecter ms_handle_connect 0x7f9874031610 2021-02-24T15:16:20.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.578+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f988c012750 con 0x7f98980959f0 2021-02-24T15:16:20.742 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.740+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 --> v1:172.21.15.181:6812/33484 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9878000b50 con 0x7f9874031610 2021-02-24T15:16:20.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.742+0000 7f98867fc700 1 -- 172.21.15.152:0/2720000736 <== mgr.4104 v1:172.21.15.181:6812/33484 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+36851 (unknown 2965378022 0 2138235389) 0x7f9878000b50 con 0x7f9874031610 2021-02-24T15:16:20.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 10 librados: watch_flush enter 2021-02-24T15:16:20.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 10 librados: watch_flush exit 2021-02-24T15:16:20.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 20 client.4329.objecter shutdown clearing up homeless session... 2021-02-24T15:16:20.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 10 client.4329.objecter successfully canceled tick 2021-02-24T15:16:20.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 >> v1:172.21.15.181:6812/33484 conn(0x7f9874031610 legacy=0x7f9874033ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 >> v1:172.21.15.152:6789/0 conn(0x7f98980959f0 legacy=0x7f989812a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 shutdown_connections 2021-02-24T15:16:20.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 >> 172.21.15.152:0/2720000736 conn(0x7f989809ba40 msgr2=0x7f989809b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:20.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 shutdown_connections 2021-02-24T15:16:20.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 1 -- 172.21.15.152:0/2720000736 wait complete. 2021-02-24T15:16:20.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.744+0000 7f989ca30700 1 librados: shutdown 2021-02-24T15:16:20.754 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2021-02-24T15:16:20.754 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:20.757 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-02-24T15:16:20.612657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29608,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":566201432,"statfs":{"total":579820584960,"available":579790266368,"internally_reserved":0,"allocated":778240,"data_stored":230365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.146059+0000","last_change":"2021-02-24T15:16:14.141537+0000","last_active":"2021-02-24T15:16:14.146059+0000","last_peered":"2021-02-24T15:16:14.146059+0000","last_clean":"2021-02-24T15:16:14.146059+0000","last_became_active":"2021-02-24T15:16:14.141253+0000","last_became_peered":"2021-02-24T15:16:14.141253+0000","last_unstale":"2021-02-24T15:16:14.146059+0000","last_undegraded":"2021-02-24T15:16:14.146059+0000","last_fullsized":"2021-02-24T15:16:14.146059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.150994+0000","last_change":"2021-02-24T15:16:14.149350+0000","last_active":"2021-02-24T15:16:14.150994+0000","last_peered":"2021-02-24T15:16:14.150994+0000","last_clean":"2021-02-24T15:16:14.150994+0000","last_became_active":"2021-02-24T15:16:14.149044+0000","last_became_peered":"2021-02-24T15:16:14.149044+0000","last_unstale":"2021-02-24T15:16:14.150994+0000","last_undegraded":"2021-02-24T15:16:14.150994+0000","last_fullsized":"2021-02-24T15:16:14.150994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.146067+0000","last_change":"2021-02-24T15:16:14.142203+0000","last_active":"2021-02-24T15:16:14.146067+0000","last_peered":"2021-02-24T15:16:14.146067+0000","last_clean":"2021-02-24T15:16:14.146067+0000","last_became_active":"2021-02-24T15:16:14.141603+0000","last_became_peered":"2021-02-24T15:16:14.141603+0000","last_unstale":"2021-02-24T15:16:14.146067+0000","last_undegraded":"2021-02-24T15:16:14.146067+0000","last_fullsized":"2021-02-24T15:16:14.146067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.141135+0000","last_change":"2021-02-24T15:16:14.139802+0000","last_active":"2021-02-24T15:16:14.141135+0000","last_peered":"2021-02-24T15:16:14.141135+0000","last_clean":"2021-02-24T15:16:14.141135+0000","last_became_active":"2021-02-24T15:16:14.139441+0000","last_became_peered":"2021-02-24T15:16:14.139441+0000","last_unstale":"2021-02-24T15:16:14.141135+0000","last_undegraded":"2021-02-24T15:16:14.141135+0000","last_fullsized":"2021-02-24T15:16:14.141135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.138317+0000","last_change":"2021-02-24T15:16:13.177107+0000","last_active":"2021-02-24T15:16:14.138317+0000","last_peered":"2021-02-24T15:16:14.138317+0000","last_clean":"2021-02-24T15:16:14.138317+0000","last_became_active":"2021-02-24T15:16:13.176756+0000","last_became_peered":"2021-02-24T15:16:13.176756+0000","last_unstale":"2021-02-24T15:16:14.138317+0000","last_undegraded":"2021-02-24T15:16:14.138317+0000","last_fullsized":"2021-02-24T15:16:14.138317+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:12.122205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:12.122205+0000","last_clean_scrub_stamp":"2021-02-24T15:16:12.122205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.148549+0000","last_change":"2021-02-24T15:16:14.144094+0000","last_active":"2021-02-24T15:16:14.148549+0000","last_peered":"2021-02-24T15:16:14.148549+0000","last_clean":"2021-02-24T15:16:14.148549+0000","last_became_active":"2021-02-24T15:16:14.143785+0000","last_became_peered":"2021-02-24T15:16:14.143785+0000","last_unstale":"2021-02-24T15:16:14.148549+0000","last_undegraded":"2021-02-24T15:16:14.148549+0000","last_fullsized":"2021-02-24T15:16:14.148549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.140100+0000","last_change":"2021-02-24T15:16:14.138399+0000","last_active":"2021-02-24T15:16:14.140100+0000","last_peered":"2021-02-24T15:16:14.140100+0000","last_clean":"2021-02-24T15:16:14.140100+0000","last_became_active":"2021-02-24T15:16:14.138094+0000","last_became_peered":"2021-02-24T15:16:14.138094+0000","last_unstale":"2021-02-24T15:16:14.140100+0000","last_undegraded":"2021-02-24T15:16:14.140100+0000","last_fullsized":"2021-02-24T15:16:14.140100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.148365+0000","last_change":"2021-02-24T15:16:14.141474+0000","last_active":"2021-02-24T15:16:14.148365+0000","last_peered":"2021-02-24T15:16:14.148365+0000","last_clean":"2021-02-24T15:16:14.148365+0000","last_became_active":"2021-02-24T15:16:14.141185+0000","last_became_peered":"2021-02-24T15:16:14.141185+0000","last_unstale":"2021-02-24T15:16:14.148365+0000","last_undegraded":"2021-02-24T15:16:14.148365+0000","last_fullsized":"2021-02-24T15:16:14.148365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.140534+0000","last_change":"2021-02-24T15:16:14.138984+0000","last_active":"2021-02-24T15:16:14.140534+0000","last_peered":"2021-02-24T15:16:14.140534+0000","last_clean":"2021-02-24T15:16:14.140534+0000","last_became_active":"2021-02-24T15:16:14.138636+0000","last_became_peered":"2021-02-24T15:16:14.138636+0000","last_unstale":"2021-02-24T15:16:14.140534+0000","last_undegraded":"2021-02-24T15:16:14.140534+0000","last_fullsized":"2021-02-24T15:16:14.140534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4932,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366908,"statfs":{"total":96636764160,"available":96631713792,"internally_reserved":0,"allocated":126976,"data_stored":37793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4932,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366908,"statfs":{"total":96636764160,"available":96631713792,"internally_reserved":0,"allocated":126976,"data_stored":37752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]}]}} 2021-02-24T15:16:20.759 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-24T15:16:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.876+0000 7f9b6f59e700 1 Processor -- start 2021-02-24T15:16:20.877 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.876+0000 7f9b6f59e700 1 -- start start 2021-02-24T15:16:20.878 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.876+0000 7f9b6f59e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b70063aa0 con 0x7f9b7012d150 2021-02-24T15:16:20.878 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.876+0000 7f9b6f59e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b70093e50 con 0x7f9b70130c60 2021-02-24T15:16:20.878 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.876+0000 7f9b6f59e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b70063cf0 con 0x7f9b700681d0 2021-02-24T15:16:20.879 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.876+0000 7f9b6dd9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9b7012d150 0x7f9b7012f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46168/0 (socket says 172.21.15.152:46168) 2021-02-24T15:16:20.879 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.876+0000 7f9b6e59c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f9b700681d0 0x7f9b70063070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34644/0 (socket says 172.21.15.152:34644) 2021-02-24T15:16:20.879 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.876+0000 7f9b6dd9b700 1 -- 172.21.15.152:0/4109145782 learned_addr learned my addr 172.21.15.152:0/4109145782 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:20.882 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6e59c700 1 -- 172.21.15.152:0/4109145782 >> v1:172.21.15.152:6790/0 conn(0x7f9b700681d0 legacy=0x7f9b70063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.883 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6dd9b700 1 -- 172.21.15.152:0/4109145782 >> v1:172.21.15.152:6789/0 conn(0x7f9b7012d150 legacy=0x7f9b7012f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.883 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870073993 0 0) 0x7f9b70063cf0 con 0x7f9b700681d0 2021-02-24T15:16:20.883 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b50003230 con 0x7f9b700681d0 2021-02-24T15:16:20.883 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567133337 0 0) 0x7f9b70063aa0 con 0x7f9b7012d150 2021-02-24T15:16:20.884 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b70063cf0 con 0x7f9b7012d150 2021-02-24T15:16:20.884 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6ed9d700 1 -- 172.21.15.152:0/4109145782 >> v1:172.21.15.181:6789/0 conn(0x7f9b70130c60 legacy=0x7f9b70133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.884 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969737276 0 0) 0x7f9b680017e0 con 0x7f9b70130c60 2021-02-24T15:16:20.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b70063aa0 con 0x7f9b70130c60 2021-02-24T15:16:20.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3795274621 0 0) 0x7f9b70063cf0 con 0x7f9b7012d150 2021-02-24T15:16:20.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 >> v1:172.21.15.152:6790/0 conn(0x7f9b700681d0 legacy=0x7f9b70063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 >> v1:172.21.15.181:6789/0 conn(0x7f9b70130c60 legacy=0x7f9b70133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b70063fb0 con 0x7f9b7012d150 2021-02-24T15:16:20.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9b58001930 con 0x7f9b7012d150 2021-02-24T15:16:20.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9b58001c40 con 0x7f9b7012d150 2021-02-24T15:16:20.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.879+0000 7f9b6d59a700 1 -- 172.21.15.152:0/4109145782 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9b58004750 con 0x7f9b7012d150 2021-02-24T15:16:20.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 -- 172.21.15.152:0/4109145782 >> v1:172.21.15.152:6789/0 conn(0x7f9b7012d150 legacy=0x7f9b7012f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 -- 172.21.15.152:0/4109145782 shutdown_connections 2021-02-24T15:16:20.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 -- 172.21.15.152:0/4109145782 >> 172.21.15.152:0/4109145782 conn(0x7f9b7009b950 msgr2=0x7f9b7009bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:20.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 -- 172.21.15.152:0/4109145782 shutdown_connections 2021-02-24T15:16:20.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 -- 172.21.15.152:0/4109145782 wait complete. 2021-02-24T15:16:20.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 librados: starting msgr at 2021-02-24T15:16:20.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 librados: starting objecter 2021-02-24T15:16:20.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 Processor -- start 2021-02-24T15:16:20.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 -- start start 2021-02-24T15:16:20.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 librados: setting wanted keys 2021-02-24T15:16:20.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.880+0000 7f9b6f59e700 1 librados: calling monclient init 2021-02-24T15:16:20.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.881+0000 7f9b6f59e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b700987d0 con 0x7f9b7012d150 2021-02-24T15:16:20.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.881+0000 7f9b6f59e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b70129160 con 0x7f9b700681d0 2021-02-24T15:16:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.881+0000 7f9b6f59e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b70098f80 con 0x7f9b70130c60 2021-02-24T15:16:20.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.881+0000 7f9b6dd9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9b7012d150 0x7f9b70139e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46172/0 (socket says 172.21.15.152:46172) 2021-02-24T15:16:20.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.881+0000 7f9b6dd9b700 1 -- 172.21.15.152:0/2162088473 learned_addr learned my addr 172.21.15.152:0/2162088473 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:20.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b6dd9b700 1 -- 172.21.15.152:0/2162088473 >> v1:172.21.15.152:6789/0 conn(0x7f9b7012d150 legacy=0x7f9b70139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 10 client.?.objecter ms_handle_connect 0x7f9b7012d150 2021-02-24T15:16:20.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b6ed9d700 1 -- 172.21.15.152:0/2162088473 >> v1:172.21.15.152:6790/0 conn(0x7f9b70130c60 legacy=0x7f9b701421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:20.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 10 client.?.objecter ms_handle_connect 0x7f9b70130c60 2021-02-24T15:16:20.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:20.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390635921 0 0) 0x7f9b700987d0 con 0x7f9b7012d150 2021-02-24T15:16:20.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b6e59c700 1 -- 172.21.15.152:0/2162088473 >> v1:172.21.15.181:6789/0 conn(0x7f9b700681d0 legacy=0x7f9b7012c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:20.902 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b54004bd0 con 0x7f9b7012d150 2021-02-24T15:16:20.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 10 client.?.objecter ms_handle_connect 0x7f9b700681d0 2021-02-24T15:16:20.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:20.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900238498 0 0) 0x7f9b70098f80 con 0x7f9b70130c60 2021-02-24T15:16:20.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b700987d0 con 0x7f9b70130c60 2021-02-24T15:16:20.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742064850 0 0) 0x7f9b70129160 con 0x7f9b700681d0 2021-02-24T15:16:20.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b70098f80 con 0x7f9b700681d0 2021-02-24T15:16:20.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3414005236 0 0) 0x7f9b54004bd0 con 0x7f9b7012d150 2021-02-24T15:16:20.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9b70129160 con 0x7f9b7012d150 2021-02-24T15:16:20.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.883+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9b580018f0 con 0x7f9b7012d150 2021-02-24T15:16:20.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1213632164 0 0) 0x7f9b700987d0 con 0x7f9b70130c60 2021-02-24T15:16:20.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9b54004bd0 con 0x7f9b70130c60 2021-02-24T15:16:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9b68001f10 con 0x7f9b70130c60 2021-02-24T15:16:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2618065420 0 0) 0x7f9b70129160 con 0x7f9b7012d150 2021-02-24T15:16:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 >> v1:172.21.15.152:6790/0 conn(0x7f9b70130c60 legacy=0x7f9b701421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 >> v1:172.21.15.181:6789/0 conn(0x7f9b700681d0 legacy=0x7f9b7012c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b70127c80 con 0x7f9b7012d150 2021-02-24T15:16:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7012cd40 con 0x7f9b7012d150 2021-02-24T15:16:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b6f59e700 10 client.4335.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7013a6f0 con 0x7f9b7012d150 2021-02-24T15:16:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b6f59e700 1 librados: init done 2021-02-24T15:16:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9b58004d80 con 0x7f9b7012d150 2021-02-24T15:16:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9b58004ef0 con 0x7f9b7012d150 2021-02-24T15:16:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.884+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f9b5800d9f0 con 0x7f9b7012d150 2021-02-24T15:16:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.885+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f9b5803ab20 con 0x7f9b7012d150 2021-02-24T15:16:20.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.885+0000 7f9b667fc700 10 client.4335.objecter ms_dispatch 0x7f9b70001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:20.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.885+0000 7f9b667fc700 3 client.4335.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:20.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.885+0000 7f9b667fc700 3 client.4335.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:20.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.885+0000 7f9b667fc700 20 client.4335.objecter dump_active .. 0 homeless 2021-02-24T15:16:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.885+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b48004d60 con 0x7f9b7012d150 2021-02-24T15:16:20.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.887+0000 7f9b667fc700 10 client.4335.objecter ms_handle_connect 0x7f9b54031410 2021-02-24T15:16:20.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:20.889+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f9b58012a20 con 0x7f9b7012d150 2021-02-24T15:16:21.054 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.053+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 --> v1:172.21.15.181:6812/33484 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b48000b50 con 0x7f9b54031410 2021-02-24T15:16:21.056 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.055+0000 7f9b667fc700 1 -- 172.21.15.152:0/2162088473 <== mgr.4104 v1:172.21.15.181:6812/33484 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+36851 (unknown 2965378022 0 2138235389) 0x7f9b48000b50 con 0x7f9b54031410 2021-02-24T15:16:21.056 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:21.058 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 10 librados: watch_flush enter 2021-02-24T15:16:21.058 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 10 librados: watch_flush exit 2021-02-24T15:16:21.058 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 20 client.4335.objecter shutdown clearing up homeless session... 2021-02-24T15:16:21.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 10 client.4335.objecter successfully canceled tick 2021-02-24T15:16:21.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 >> v1:172.21.15.181:6812/33484 conn(0x7f9b54031410 legacy=0x7f9b540338d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 >> v1:172.21.15.152:6789/0 conn(0x7f9b7012d150 legacy=0x7f9b70139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 shutdown_connections 2021-02-24T15:16:21.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 >> 172.21.15.152:0/2162088473 conn(0x7f9b7009b950 msgr2=0x7f9b70065e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:21.060 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 shutdown_connections 2021-02-24T15:16:21.060 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 1 -- 172.21.15.152:0/2162088473 wait complete. 2021-02-24T15:16:21.060 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.056+0000 7f9b6f59e700 1 librados: shutdown 2021-02-24T15:16:21.060 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2021-02-24T15:16:21.068 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-02-24T15:16:20.612657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29608,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":566201432,"statfs":{"total":579820584960,"available":579790266368,"internally_reserved":0,"allocated":778240,"data_stored":230365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.146059+0000","last_change":"2021-02-24T15:16:14.141537+0000","last_active":"2021-02-24T15:16:14.146059+0000","last_peered":"2021-02-24T15:16:14.146059+0000","last_clean":"2021-02-24T15:16:14.146059+0000","last_became_active":"2021-02-24T15:16:14.141253+0000","last_became_peered":"2021-02-24T15:16:14.141253+0000","last_unstale":"2021-02-24T15:16:14.146059+0000","last_undegraded":"2021-02-24T15:16:14.146059+0000","last_fullsized":"2021-02-24T15:16:14.146059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.150994+0000","last_change":"2021-02-24T15:16:14.149350+0000","last_active":"2021-02-24T15:16:14.150994+0000","last_peered":"2021-02-24T15:16:14.150994+0000","last_clean":"2021-02-24T15:16:14.150994+0000","last_became_active":"2021-02-24T15:16:14.149044+0000","last_became_peered":"2021-02-24T15:16:14.149044+0000","last_unstale":"2021-02-24T15:16:14.150994+0000","last_undegraded":"2021-02-24T15:16:14.150994+0000","last_fullsized":"2021-02-24T15:16:14.150994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.146067+0000","last_change":"2021-02-24T15:16:14.142203+0000","last_active":"2021-02-24T15:16:14.146067+0000","last_peered":"2021-02-24T15:16:14.146067+0000","last_clean":"2021-02-24T15:16:14.146067+0000","last_became_active":"2021-02-24T15:16:14.141603+0000","last_became_peered":"2021-02-24T15:16:14.141603+0000","last_unstale":"2021-02-24T15:16:14.146067+0000","last_undegraded":"2021-02-24T15:16:14.146067+0000","last_fullsized":"2021-02-24T15:16:14.146067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.141135+0000","last_change":"2021-02-24T15:16:14.139802+0000","last_active":"2021-02-24T15:16:14.141135+0000","last_peered":"2021-02-24T15:16:14.141135+0000","last_clean":"2021-02-24T15:16:14.141135+0000","last_became_active":"2021-02-24T15:16:14.139441+0000","last_became_peered":"2021-02-24T15:16:14.139441+0000","last_unstale":"2021-02-24T15:16:14.141135+0000","last_undegraded":"2021-02-24T15:16:14.141135+0000","last_fullsized":"2021-02-24T15:16:14.141135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.138317+0000","last_change":"2021-02-24T15:16:13.177107+0000","last_active":"2021-02-24T15:16:14.138317+0000","last_peered":"2021-02-24T15:16:14.138317+0000","last_clean":"2021-02-24T15:16:14.138317+0000","last_became_active":"2021-02-24T15:16:13.176756+0000","last_became_peered":"2021-02-24T15:16:13.176756+0000","last_unstale":"2021-02-24T15:16:14.138317+0000","last_undegraded":"2021-02-24T15:16:14.138317+0000","last_fullsized":"2021-02-24T15:16:14.138317+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:12.122205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:12.122205+0000","last_clean_scrub_stamp":"2021-02-24T15:16:12.122205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.148549+0000","last_change":"2021-02-24T15:16:14.144094+0000","last_active":"2021-02-24T15:16:14.148549+0000","last_peered":"2021-02-24T15:16:14.148549+0000","last_clean":"2021-02-24T15:16:14.148549+0000","last_became_active":"2021-02-24T15:16:14.143785+0000","last_became_peered":"2021-02-24T15:16:14.143785+0000","last_unstale":"2021-02-24T15:16:14.148549+0000","last_undegraded":"2021-02-24T15:16:14.148549+0000","last_fullsized":"2021-02-24T15:16:14.148549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.140100+0000","last_change":"2021-02-24T15:16:14.138399+0000","last_active":"2021-02-24T15:16:14.140100+0000","last_peered":"2021-02-24T15:16:14.140100+0000","last_clean":"2021-02-24T15:16:14.140100+0000","last_became_active":"2021-02-24T15:16:14.138094+0000","last_became_peered":"2021-02-24T15:16:14.138094+0000","last_unstale":"2021-02-24T15:16:14.140100+0000","last_undegraded":"2021-02-24T15:16:14.140100+0000","last_fullsized":"2021-02-24T15:16:14.140100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.148365+0000","last_change":"2021-02-24T15:16:14.141474+0000","last_active":"2021-02-24T15:16:14.148365+0000","last_peered":"2021-02-24T15:16:14.148365+0000","last_clean":"2021-02-24T15:16:14.148365+0000","last_became_active":"2021-02-24T15:16:14.141185+0000","last_became_peered":"2021-02-24T15:16:14.141185+0000","last_unstale":"2021-02-24T15:16:14.148365+0000","last_undegraded":"2021-02-24T15:16:14.148365+0000","last_fullsized":"2021-02-24T15:16:14.148365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.140534+0000","last_change":"2021-02-24T15:16:14.138984+0000","last_active":"2021-02-24T15:16:14.140534+0000","last_peered":"2021-02-24T15:16:14.140534+0000","last_clean":"2021-02-24T15:16:14.140534+0000","last_became_active":"2021-02-24T15:16:14.138636+0000","last_became_peered":"2021-02-24T15:16:14.138636+0000","last_unstale":"2021-02-24T15:16:14.140534+0000","last_undegraded":"2021-02-24T15:16:14.140534+0000","last_fullsized":"2021-02-24T15:16:14.140534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4932,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366908,"statfs":{"total":96636764160,"available":96631713792,"internally_reserved":0,"allocated":126976,"data_stored":37793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4932,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366908,"statfs":{"total":96636764160,"available":96631713792,"internally_reserved":0,"allocated":126976,"data_stored":37752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]}]}} 2021-02-24T15:16:21.070 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-02-24T15:16:21.072 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-02-24T15:16:21.072 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-02-24T15:16:21.072 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-24T15:16:21.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.190+0000 7faed8825700 1 Processor -- start 2021-02-24T15:16:21.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.190+0000 7faed8825700 1 -- start start 2021-02-24T15:16:21.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.191+0000 7faed8825700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed412b0d0 con 0x7faed40679c0 2021-02-24T15:16:21.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.191+0000 7faed8825700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed4098a60 con 0x7faed40613c0 2021-02-24T15:16:21.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.191+0000 7faed8825700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed409a0b0 con 0x7faed4067e70 2021-02-24T15:16:21.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.191+0000 7faed2d9d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7faed4067e70 0x7faed4133410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34658/0 (socket says 172.21.15.152:34658) 2021-02-24T15:16:21.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.191+0000 7faed1d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7faed40679c0 0x7faed412fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46178/0 (socket says 172.21.15.152:46178) 2021-02-24T15:16:21.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.191+0000 7faed2d9d700 1 -- 172.21.15.152:0/3337934166 learned_addr learned my addr 172.21.15.152:0/3337934166 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:21.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.191+0000 7faed259c700 1 -- 172.21.15.152:0/3337934166 >> v1:172.21.15.181:6789/0 conn(0x7faed40613c0 legacy=0x7faed412a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-24T15:16:21.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.191+0000 7faed259c700 1 -- 172.21.15.152:0/3337934166 >> v1:172.21.15.181:6789/0 conn(0x7faed40613c0 legacy=0x7faed412a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-24T15:16:21.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.191+0000 7faed259c700 1 --1- 172.21.15.152:0/3337934166 >> v1:172.21.15.181:6789/0 conn(0x7faed40613c0 0x7faed412a9c0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2021-02-24T15:16:21.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed1d9b700 1 -- 172.21.15.152:0/3337934166 >> v1:172.21.15.152:6789/0 conn(0x7faed40679c0 legacy=0x7faed412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.198 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed2d9d700 1 -- 172.21.15.152:0/3337934166 >> v1:172.21.15.152:6790/0 conn(0x7faed4067e70 legacy=0x7faed4133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.199 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359780256 0 0) 0x7faed412b0d0 con 0x7faed40679c0 2021-02-24T15:16:21.199 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb8003230 con 0x7faed40679c0 2021-02-24T15:16:21.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925338873 0 0) 0x7faed409a0b0 con 0x7faed4067e70 2021-02-24T15:16:21.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed412b0d0 con 0x7faed4067e70 2021-02-24T15:16:21.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3984940568 0 0) 0x7faed412b0d0 con 0x7faed4067e70 2021-02-24T15:16:21.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 >> v1:172.21.15.181:6789/0 conn(0x7faed40613c0 legacy=0x7faed412a9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:16:21.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 >> v1:172.21.15.152:6789/0 conn(0x7faed40679c0 legacy=0x7faed412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed409a350 con 0x7faed4067e70 2021-02-24T15:16:21.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.193+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faecc001c20 con 0x7faed4067e70 2021-02-24T15:16:21.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.194+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faecc001ef0 con 0x7faed4067e70 2021-02-24T15:16:21.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.194+0000 7faed159a700 1 -- 172.21.15.152:0/3337934166 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faecc004930 con 0x7faed4067e70 2021-02-24T15:16:21.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.194+0000 7faed8825700 1 -- 172.21.15.152:0/3337934166 >> v1:172.21.15.152:6790/0 conn(0x7faed4067e70 legacy=0x7faed4133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.194+0000 7faed8825700 1 -- 172.21.15.152:0/3337934166 shutdown_connections 2021-02-24T15:16:21.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.194+0000 7faed8825700 1 -- 172.21.15.152:0/3337934166 >> 172.21.15.152:0/3337934166 conn(0x7faed409a940 msgr2=0x7faed409ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:21.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.194+0000 7faed8825700 1 -- 172.21.15.152:0/3337934166 shutdown_connections 2021-02-24T15:16:21.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.194+0000 7faed8825700 1 -- 172.21.15.152:0/3337934166 wait complete. 2021-02-24T15:16:21.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.195+0000 7faed8825700 1 librados: starting msgr at 2021-02-24T15:16:21.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.195+0000 7faed8825700 1 librados: starting objecter 2021-02-24T15:16:21.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.195+0000 7faed8825700 1 Processor -- start 2021-02-24T15:16:21.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.195+0000 7faed8825700 1 -- start start 2021-02-24T15:16:21.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.195+0000 7faed8825700 1 librados: setting wanted keys 2021-02-24T15:16:21.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.195+0000 7faed8825700 1 librados: calling monclient init 2021-02-24T15:16:21.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.195+0000 7faed8825700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed413ac30 con 0x7faed40679c0 2021-02-24T15:16:21.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.195+0000 7faed8825700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed413a4a0 con 0x7faed40613c0 2021-02-24T15:16:21.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.195+0000 7faed8825700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed4122d00 con 0x7faed4067e70 2021-02-24T15:16:21.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.196+0000 7faed2d9d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7faed4067e70 0x7faed41420e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34664/0 (socket says 172.21.15.152:34664) 2021-02-24T15:16:21.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.196+0000 7faed2d9d700 1 -- 172.21.15.152:0/1930535528 learned_addr learned my addr 172.21.15.152:0/1930535528 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:21.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.196+0000 7faed1d9b700 1 --1- 172.21.15.152:0/1930535528 >> v1:172.21.15.152:6789/0 conn(0x7faed40679c0 0x7faed4124450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46186/0 (socket says 172.21.15.152:46186) 2021-02-24T15:16:21.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faed2d9d700 1 -- 172.21.15.152:0/1930535528 >> v1:172.21.15.152:6790/0 conn(0x7faed4067e70 legacy=0x7faed41420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 10 client.?.objecter ms_handle_connect 0x7faed4067e70 2021-02-24T15:16:21.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:21.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faed1d9b700 1 -- 172.21.15.152:0/1930535528 >> v1:172.21.15.152:6789/0 conn(0x7faed40679c0 legacy=0x7faed4124450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 10 client.?.objecter ms_handle_connect 0x7faed40679c0 2021-02-24T15:16:21.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:21.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500403974 0 0) 0x7faed4122d00 con 0x7faed4067e70 2021-02-24T15:16:21.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb0004bd0 con 0x7faed4067e70 2021-02-24T15:16:21.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621351292 0 0) 0x7faed413ac30 con 0x7faed40679c0 2021-02-24T15:16:21.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed4122d00 con 0x7faed40679c0 2021-02-24T15:16:21.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 10 client.?.objecter ms_handle_connect 0x7faed40613c0 2021-02-24T15:16:21.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:21.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faed259c700 1 -- 172.21.15.152:0/1930535528 >> v1:172.21.15.181:6789/0 conn(0x7faed40613c0 legacy=0x7faed4139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2548398784 0 0) 0x7faeb0004bd0 con 0x7faed4067e70 2021-02-24T15:16:21.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faed413ac30 con 0x7faed4067e70 2021-02-24T15:16:21.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faecc004870 con 0x7faed4067e70 2021-02-24T15:16:21.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2281834620 0 0) 0x7faed4122d00 con 0x7faed40679c0 2021-02-24T15:16:21.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faeb0004bd0 con 0x7faed40679c0 2021-02-24T15:16:21.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907737566 0 0) 0x7faed413a4a0 con 0x7faed40613c0 2021-02-24T15:16:21.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed4122d00 con 0x7faed40613c0 2021-02-24T15:16:21.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faec8001c60 con 0x7faed40679c0 2021-02-24T15:16:21.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1478432838 0 0) 0x7faed413ac30 con 0x7faed4067e70 2021-02-24T15:16:21.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 >> v1:172.21.15.181:6789/0 conn(0x7faed40613c0 legacy=0x7faed4139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 >> v1:172.21.15.152:6789/0 conn(0x7faed40679c0 legacy=0x7faed4124450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed4122fa0 con 0x7faed4067e70 2021-02-24T15:16:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed4120e30 con 0x7faed4067e70 2021-02-24T15:16:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faed8825700 10 client.4337.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faed4124b60 con 0x7faed4067e70 2021-02-24T15:16:21.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faed8825700 1 librados: init done 2021-02-24T15:16:21.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faecc005000 con 0x7faed4067e70 2021-02-24T15:16:21.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.198+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faecc005170 con 0x7faed4067e70 2021-02-24T15:16:21.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.199+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7faecc00dc70 con 0x7faed4067e70 2021-02-24T15:16:21.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.199+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7faecc03ad50 con 0x7faed4067e70 2021-02-24T15:16:21.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.199+0000 7faec27fc700 10 client.4337.objecter ms_dispatch 0x7faed4001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:21.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.199+0000 7faec27fc700 3 client.4337.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:21.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.199+0000 7faec27fc700 3 client.4337.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:21.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.199+0000 7faec27fc700 20 client.4337.objecter dump_active .. 0 homeless 2021-02-24T15:16:21.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.199+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb4004d60 con 0x7faed4067e70 2021-02-24T15:16:21.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.202+0000 7faec27fc700 10 client.4337.objecter ms_handle_connect 0x7faeb00316e0 2021-02-24T15:16:21.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.204+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7faecc012b90 con 0x7faed4067e70 2021-02-24T15:16:21.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.439+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faeb4005590 con 0x7faed4067e70 2021-02-24T15:16:21.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.439+0000 7faec27fc700 1 -- 172.21.15.152:0/1930535528 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7faecc012780 con 0x7faed4067e70 2021-02-24T15:16:21.441 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:21.441 INFO:teuthology.orchestra.run.smithi152.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-02-24T15:16:21.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 10 librados: watch_flush enter 2021-02-24T15:16:21.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 10 librados: watch_flush exit 2021-02-24T15:16:21.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 20 client.4337.objecter shutdown clearing up homeless session... 2021-02-24T15:16:21.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 10 client.4337.objecter successfully canceled tick 2021-02-24T15:16:21.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 >> v1:172.21.15.181:6812/33484 conn(0x7faeb00316e0 legacy=0x7faeb0033ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 >> v1:172.21.15.152:6790/0 conn(0x7faed4067e70 legacy=0x7faed41420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 shutdown_connections 2021-02-24T15:16:21.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 >> 172.21.15.152:0/1930535528 conn(0x7faed409a940 msgr2=0x7faed4097310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:21.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 shutdown_connections 2021-02-24T15:16:21.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 1 -- 172.21.15.152:0/1930535528 wait complete. 2021-02-24T15:16:21.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.441+0000 7faed8825700 1 librados: shutdown 2021-02-24T15:16:21.453 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-02-24T15:16:21.454 INFO:teuthology.run_tasks:Running task mon_thrash... 2021-02-24T15:16:21.472 INFO:tasks.mon_thrash:Beginning mon_thrash... 2021-02-24T15:16:21.473 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-24T15:16:21.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.589+0000 7fc0abda8700 1 Processor -- start 2021-02-24T15:16:21.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.589+0000 7fc0abda8700 1 -- start start 2021-02-24T15:16:21.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.590+0000 7fc0abda8700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a412b0d0 con 0x7fc0a40679c0 2021-02-24T15:16:21.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.590+0000 7fc0abda8700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a4098a60 con 0x7fc0a40613c0 2021-02-24T15:16:21.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.590+0000 7fc0abda8700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a409a0b0 con 0x7fc0a4067e70 2021-02-24T15:16:21.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.590+0000 7fc0a9343700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc0a40679c0 0x7fc0a412fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46194/0 (socket says 172.21.15.152:46194) 2021-02-24T15:16:21.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.590+0000 7fc0a9343700 1 -- 172.21.15.152:0/1464631313 learned_addr learned my addr 172.21.15.152:0/1464631313 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:21.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.590+0000 7fc0aa345700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc0a4067e70 0x7fc0a4133410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34672/0 (socket says 172.21.15.152:34672) 2021-02-24T15:16:21.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a9343700 1 -- 172.21.15.152:0/1464631313 >> v1:172.21.15.152:6789/0 conn(0x7fc0a40679c0 legacy=0x7fc0a412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0aa345700 1 -- 172.21.15.152:0/1464631313 >> v1:172.21.15.152:6790/0 conn(0x7fc0a4067e70 legacy=0x7fc0a4133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880273254 0 0) 0x7fc0a412b0d0 con 0x7fc0a40679c0 2021-02-24T15:16:21.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a9b44700 1 -- 172.21.15.152:0/1464631313 >> v1:172.21.15.181:6789/0 conn(0x7fc0a40613c0 legacy=0x7fc0a412a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc08c003230 con 0x7fc0a40679c0 2021-02-24T15:16:21.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840447594 0 0) 0x7fc0a409a0b0 con 0x7fc0a4067e70 2021-02-24T15:16:21.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a412b0d0 con 0x7fc0a4067e70 2021-02-24T15:16:21.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 273026919 0 0) 0x7fc08c003230 con 0x7fc0a40679c0 2021-02-24T15:16:21.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 >> v1:172.21.15.152:6790/0 conn(0x7fc0a4067e70 legacy=0x7fc0a4133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 >> v1:172.21.15.181:6789/0 conn(0x7fc0a40613c0 legacy=0x7fc0a412a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a409a350 con 0x7fc0a40679c0 2021-02-24T15:16:21.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.592+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc094001930 con 0x7fc0a40679c0 2021-02-24T15:16:21.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.593+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc094001c40 con 0x7fc0a40679c0 2021-02-24T15:16:21.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.593+0000 7fc0a8b42700 1 -- 172.21.15.152:0/1464631313 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc094004750 con 0x7fc0a40679c0 2021-02-24T15:16:21.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.593+0000 7fc0abda8700 1 -- 172.21.15.152:0/1464631313 >> v1:172.21.15.152:6789/0 conn(0x7fc0a40679c0 legacy=0x7fc0a412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.593+0000 7fc0abda8700 1 -- 172.21.15.152:0/1464631313 shutdown_connections 2021-02-24T15:16:21.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.593+0000 7fc0abda8700 1 -- 172.21.15.152:0/1464631313 >> 172.21.15.152:0/1464631313 conn(0x7fc0a409a940 msgr2=0x7fc0a409ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:21.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.593+0000 7fc0abda8700 1 -- 172.21.15.152:0/1464631313 shutdown_connections 2021-02-24T15:16:21.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.593+0000 7fc0abda8700 1 -- 172.21.15.152:0/1464631313 wait complete. 2021-02-24T15:16:21.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.594+0000 7fc0abda8700 1 librados: starting msgr at 2021-02-24T15:16:21.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.594+0000 7fc0abda8700 1 librados: starting objecter 2021-02-24T15:16:21.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.594+0000 7fc0abda8700 1 Processor -- start 2021-02-24T15:16:21.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.594+0000 7fc0abda8700 1 -- start start 2021-02-24T15:16:21.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.594+0000 7fc0abda8700 1 librados: setting wanted keys 2021-02-24T15:16:21.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.594+0000 7fc0abda8700 1 librados: calling monclient init 2021-02-24T15:16:21.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.594+0000 7fc0abda8700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a41224d0 con 0x7fc0a40679c0 2021-02-24T15:16:21.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.594+0000 7fc0abda8700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a4121870 con 0x7fc0a4067e70 2021-02-24T15:16:21.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.594+0000 7fc0abda8700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a4120500 con 0x7fc0a40613c0 2021-02-24T15:16:21.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.595+0000 7fc0a9343700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc0a40679c0 0x7fc0a411e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46200/0 (socket says 172.21.15.152:46200) 2021-02-24T15:16:21.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.595+0000 7fc0a9b44700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc0a40613c0 0x7fc0a411e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34674/0 (socket says 172.21.15.152:34674) 2021-02-24T15:16:21.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.595+0000 7fc0a9343700 1 -- 172.21.15.152:0/2911669275 learned_addr learned my addr 172.21.15.152:0/2911669275 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:21.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc0a9b44700 1 -- 172.21.15.152:0/2911669275 >> v1:172.21.15.152:6790/0 conn(0x7fc0a40613c0 legacy=0x7fc0a411e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc0a9343700 1 -- 172.21.15.152:0/2911669275 >> v1:172.21.15.152:6789/0 conn(0x7fc0a40679c0 legacy=0x7fc0a411e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 10 client.?.objecter ms_handle_connect 0x7fc0a40613c0 2021-02-24T15:16:21.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:21.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 10 client.?.objecter ms_handle_connect 0x7fc0a40679c0 2021-02-24T15:16:21.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:21.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753008816 0 0) 0x7fc0a4120500 con 0x7fc0a40613c0 2021-02-24T15:16:21.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc084004bd0 con 0x7fc0a40613c0 2021-02-24T15:16:21.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311000449 0 0) 0x7fc0a41224d0 con 0x7fc0a40679c0 2021-02-24T15:16:21.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a4120500 con 0x7fc0a40679c0 2021-02-24T15:16:21.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 10 client.?.objecter ms_handle_connect 0x7fc0a4067e70 2021-02-24T15:16:21.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:21.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc0aa345700 1 -- 172.21.15.152:0/2911669275 >> v1:172.21.15.181:6789/0 conn(0x7fc0a4067e70 legacy=0x7fc0a41422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3344375087 0 0) 0x7fc084004bd0 con 0x7fc0a40613c0 2021-02-24T15:16:21.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc0a41224d0 con 0x7fc0a40613c0 2021-02-24T15:16:21.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc0a0001ba0 con 0x7fc0a40613c0 2021-02-24T15:16:21.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3445430495 0 0) 0x7fc0a4120500 con 0x7fc0a40679c0 2021-02-24T15:16:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc084004bd0 con 0x7fc0a40679c0 2021-02-24T15:16:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479556662 0 0) 0x7fc0a4121870 con 0x7fc0a4067e70 2021-02-24T15:16:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a4120500 con 0x7fc0a4067e70 2021-02-24T15:16:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc0940018f0 con 0x7fc0a40679c0 2021-02-24T15:16:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1219958489 0 0) 0x7fc0a41224d0 con 0x7fc0a40613c0 2021-02-24T15:16:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 >> v1:172.21.15.181:6789/0 conn(0x7fc0a4067e70 legacy=0x7fc0a41422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 >> v1:172.21.15.152:6789/0 conn(0x7fc0a40679c0 legacy=0x7fc0a411e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4120690 con 0x7fc0a40613c0 2021-02-24T15:16:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a4123870 con 0x7fc0a40613c0 2021-02-24T15:16:21.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc0a0002230 con 0x7fc0a40613c0 2021-02-24T15:16:21.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.597+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc0a0002540 con 0x7fc0a40613c0 2021-02-24T15:16:21.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc0abda8700 10 client.4343.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:21.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4123ce0 con 0x7fc0a40613c0 2021-02-24T15:16:21.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc0abda8700 1 librados: init done 2021-02-24T15:16:21.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fc0a0002760 con 0x7fc0a40613c0 2021-02-24T15:16:21.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7fc0a003a8c0 con 0x7fc0a40613c0 2021-02-24T15:16:21.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc091ffb700 10 client.4343.objecter ms_dispatch 0x7fc0a4001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:21.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc091ffb700 3 client.4343.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:21.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc091ffb700 3 client.4343.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:21.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc091ffb700 20 client.4343.objecter dump_active .. 0 homeless 2021-02-24T15:16:21.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.598+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a4126040 con 0x7fc0a40613c0 2021-02-24T15:16:21.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.601+0000 7fc091ffb700 10 client.4343.objecter ms_handle_connect 0x7fc084031690 2021-02-24T15:16:21.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.602+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fc0a0012700 con 0x7fc0a40613c0 2021-02-24T15:16:21.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.771+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0a4058400 con 0x7fc0a40613c0 2021-02-24T15:16:21.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.771+0000 7fc091ffb700 1 -- 172.21.15.152:0/2911669275 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10026 (unknown 4221056075 0 1209689785) 0x7fc0a00122f0 con 0x7fc0a40613c0 2021-02-24T15:16:21.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:21.774 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":15,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","created":"2021-02-24T15:16:02.232967+0000","modified":"2021-02-24T15:16:15.137619+0000","last_up_change":"2021-02-24T15:16:11.121140+0000","last_in_change":"2021-02-24T15:16:11.121140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-24T15:16:11.157287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-24T15:16:12.361586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a72c3535-e891-4444-bf97-dc6fae0ad363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6801","nonce":33735}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6803","nonce":33735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6807","nonce":33735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6805","nonce":33735}]},"public_addr":"172.21.15.152:6801/33735","cluster_addr":"172.21.15.152:6803/33735","heartbeat_back_addr":"172.21.15.152:6807/33735","heartbeat_front_addr":"172.21.15.152:6805/33735","state":["exists","up"]},{"osd":1,"uuid":"008b3230-90b6-4bee-8218-c422a983151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6800","nonce":33736}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6802","nonce":33736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6806","nonce":33736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6804","nonce":33736}]},"public_addr":"172.21.15.152:6800/33736","cluster_addr":"172.21.15.152:6802/33736","heartbeat_back_addr":"172.21.15.152:6806/33736","heartbeat_front_addr":"172.21.15.152:6804/33736","state":["exists","up"]},{"osd":2,"uuid":"b91de7c8-a67a-45d6-8643-8578d6b60c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6808","nonce":33737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6809","nonce":33737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6811","nonce":33737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6810","nonce":33737}]},"public_addr":"172.21.15.152:6808/33737","cluster_addr":"172.21.15.152:6809/33737","heartbeat_back_addr":"172.21.15.152:6811/33737","heartbeat_front_addr":"172.21.15.152:6810/33737","state":["exists","up"]},{"osd":3,"uuid":"cc030322-1a40-4f32-9ea3-48d755deaca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":33937}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":33937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":33937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":33937}]},"public_addr":"172.21.15.181:6801/33937","cluster_addr":"172.21.15.181:6803/33937","heartbeat_back_addr":"172.21.15.181:6807/33937","heartbeat_front_addr":"172.21.15.181:6805/33937","state":["exists","up"]},{"osd":4,"uuid":"3022f9f3-8ca8-403a-863a-41c661302f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":33938}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":33938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":33938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":33938}]},"public_addr":"172.21.15.181:6800/33938","cluster_addr":"172.21.15.181:6802/33938","heartbeat_back_addr":"172.21.15.181:6806/33938","heartbeat_front_addr":"172.21.15.181:6804/33938","state":["exists","up"]},{"osd":5,"uuid":"a6762546-97f4-409d-bebb-411eb5fba3db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":33963}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":33963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":33963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":33963}]},"public_addr":"172.21.15.181:6808/33963","cluster_addr":"172.21.15.181:6809/33963","heartbeat_back_addr":"172.21.15.181:6811/33963","heartbeat_front_addr":"172.21.15.181:6810/33963","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.364038+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.333681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.341529+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.302404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.368253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-24T15:16:09.356384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-24T15:16:21.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 10 librados: watch_flush enter 2021-02-24T15:16:21.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 10 librados: watch_flush exit 2021-02-24T15:16:21.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 20 client.4343.objecter shutdown clearing up homeless session... 2021-02-24T15:16:21.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 10 client.4343.objecter successfully canceled tick 2021-02-24T15:16:21.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 >> v1:172.21.15.181:6812/33484 conn(0x7fc084031690 legacy=0x7fc084033b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 >> v1:172.21.15.152:6790/0 conn(0x7fc0a40613c0 legacy=0x7fc0a411e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 shutdown_connections 2021-02-24T15:16:21.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 >> 172.21.15.152:0/2911669275 conn(0x7fc0a409a940 msgr2=0x7fc0a41268f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:21.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 shutdown_connections 2021-02-24T15:16:21.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 1 -- 172.21.15.152:0/2911669275 wait complete. 2021-02-24T15:16:21.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.773+0000 7fc0abda8700 1 librados: shutdown 2021-02-24T15:16:21.786 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-24T15:16:11.157287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-24T15:16:12.361586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-24T15:16:21.786 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-24T15:16:21.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.904+0000 7f11a1919700 1 Processor -- start 2021-02-24T15:16:21.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.904+0000 7f11a1919700 1 -- start start 2021-02-24T15:16:21.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.905+0000 7f11a1919700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c09a040 con 0x7f119c0684b0 2021-02-24T15:16:21.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.905+0000 7f11a1919700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c09a2e0 con 0x7f119c127c80 2021-02-24T15:16:21.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.905+0000 7f11a1919700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c128060 con 0x7f119c1310d0 2021-02-24T15:16:21.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.905+0000 7f119b7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f119c1310d0 0x7f119c1334c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34682/0 (socket says 172.21.15.152:34682) 2021-02-24T15:16:21.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.905+0000 7f119b7fe700 1 -- 172.21.15.152:0/3164118573 learned_addr learned my addr 172.21.15.152:0/3164118573 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:21.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.907+0000 7f119b7fe700 1 -- 172.21.15.152:0/3164118573 >> v1:172.21.15.152:6790/0 conn(0x7f119c1310d0 legacy=0x7f119c1334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.907+0000 7f119a7fc700 1 -- 172.21.15.152:0/3164118573 >> v1:172.21.15.152:6789/0 conn(0x7f119c0684b0 legacy=0x7f119c12f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.907+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127912310 0 0) 0x7f119c128060 con 0x7f119c1310d0 2021-02-24T15:16:21.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.907+0000 7f119affd700 1 -- 172.21.15.152:0/3164118573 >> v1:172.21.15.181:6789/0 conn(0x7f119c127c80 legacy=0x7f119c067900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.907+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1188003230 con 0x7f119c1310d0 2021-02-24T15:16:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.907+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916290862 0 0) 0x7f119c09a040 con 0x7f119c0684b0 2021-02-24T15:16:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f119c128060 con 0x7f119c0684b0 2021-02-24T15:16:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3358405025 0 0) 0x7f119c128060 con 0x7f119c0684b0 2021-02-24T15:16:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 >> v1:172.21.15.152:6790/0 conn(0x7f119c1310d0 legacy=0x7f119c1334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 >> v1:172.21.15.181:6789/0 conn(0x7f119c127c80 legacy=0x7f119c067900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c099820 con 0x7f119c0684b0 2021-02-24T15:16:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1190001980 con 0x7f119c0684b0 2021-02-24T15:16:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1190001c90 con 0x7f119c0684b0 2021-02-24T15:16:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f1199ffb700 1 -- 172.21.15.152:0/3164118573 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1190002060 con 0x7f119c0684b0 2021-02-24T15:16:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f11a1919700 1 -- 172.21.15.152:0/3164118573 >> v1:172.21.15.152:6789/0 conn(0x7f119c0684b0 legacy=0x7f119c12f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f11a1919700 1 -- 172.21.15.152:0/3164118573 shutdown_connections 2021-02-24T15:16:21.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f11a1919700 1 -- 172.21.15.152:0/3164118573 >> 172.21.15.152:0/3164118573 conn(0x7f119c09a870 msgr2=0x7f119c09ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:21.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f11a1919700 1 -- 172.21.15.152:0/3164118573 shutdown_connections 2021-02-24T15:16:21.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.908+0000 7f11a1919700 1 -- 172.21.15.152:0/3164118573 wait complete. 2021-02-24T15:16:21.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.909+0000 7f11a1919700 1 librados: starting msgr at 2021-02-24T15:16:21.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.909+0000 7f11a1919700 1 librados: starting objecter 2021-02-24T15:16:21.918 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.909+0000 7f11a1919700 1 Processor -- start 2021-02-24T15:16:21.918 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.909+0000 7f11a1919700 1 -- start start 2021-02-24T15:16:21.918 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.909+0000 7f11a1919700 1 librados: setting wanted keys 2021-02-24T15:16:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.909+0000 7f11a1919700 1 librados: calling monclient init 2021-02-24T15:16:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.910+0000 7f11a1919700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c130df0 con 0x7f119c0684b0 2021-02-24T15:16:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.910+0000 7f11a1919700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c129d80 con 0x7f119c1310d0 2021-02-24T15:16:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.910+0000 7f11a1919700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c12a020 con 0x7f119c127c80 2021-02-24T15:16:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.910+0000 7f119a7fc700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f119c127c80 0x7f119c1398f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34690/0 (socket says 172.21.15.152:34690) 2021-02-24T15:16:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.910+0000 7f119a7fc700 1 -- 172.21.15.152:0/1128967612 learned_addr learned my addr 172.21.15.152:0/1128967612 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.912+0000 7f119affd700 1 -- 172.21.15.152:0/1128967612 >> v1:172.21.15.152:6789/0 conn(0x7f119c0684b0 legacy=0x7f119c12fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.912+0000 7f119a7fc700 1 -- 172.21.15.152:0/1128967612 >> v1:172.21.15.152:6790/0 conn(0x7f119c127c80 legacy=0x7f119c1398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.912+0000 7f1182ffd700 10 client.?.objecter ms_handle_connect 0x7f119c0684b0 2021-02-24T15:16:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.912+0000 7f1182ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:21.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.912+0000 7f1182ffd700 10 client.?.objecter ms_handle_connect 0x7f119c127c80 2021-02-24T15:16:21.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.912+0000 7f1182ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:21.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.912+0000 7f1182ffd700 10 client.?.objecter ms_handle_connect 0x7f119c1310d0 2021-02-24T15:16:21.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.912+0000 7f1182ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:21.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.912+0000 7f119b7fe700 1 -- 172.21.15.152:0/1128967612 >> v1:172.21.15.181:6789/0 conn(0x7f119c1310d0 legacy=0x7f119c141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:21.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397082529 0 0) 0x7f119c130df0 con 0x7f119c0684b0 2021-02-24T15:16:21.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117c004bd0 con 0x7f119c0684b0 2021-02-24T15:16:21.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901401203 0 0) 0x7f119c129d80 con 0x7f119c1310d0 2021-02-24T15:16:21.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f119c130df0 con 0x7f119c1310d0 2021-02-24T15:16:21.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199732086 0 0) 0x7f119c12a020 con 0x7f119c127c80 2021-02-24T15:16:21.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f119c129d80 con 0x7f119c127c80 2021-02-24T15:16:21.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3314480336 0 0) 0x7f117c004bd0 con 0x7f119c0684b0 2021-02-24T15:16:21.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f119c12a020 con 0x7f119c0684b0 2021-02-24T15:16:21.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f118c001cb0 con 0x7f119c0684b0 2021-02-24T15:16:21.925 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2831877091 0 0) 0x7f119c129d80 con 0x7f119c127c80 2021-02-24T15:16:21.925 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f117c004bd0 con 0x7f119c127c80 2021-02-24T15:16:21.925 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3713200822 0 0) 0x7f119c130df0 con 0x7f119c1310d0 2021-02-24T15:16:21.925 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f119c129d80 con 0x7f119c1310d0 2021-02-24T15:16:21.925 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1190001940 con 0x7f119c127c80 2021-02-24T15:16:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1194001fe0 con 0x7f119c1310d0 2021-02-24T15:16:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 642186915 0 0) 0x7f119c12a020 con 0x7f119c0684b0 2021-02-24T15:16:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 >> v1:172.21.15.152:6790/0 conn(0x7f119c127c80 legacy=0x7f119c1398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 >> v1:172.21.15.181:6789/0 conn(0x7f119c1310d0 legacy=0x7f119c141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c12a2c0 con 0x7f119c0684b0 2021-02-24T15:16:21.927 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c130160 con 0x7f119c0684b0 2021-02-24T15:16:21.927 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f11a1919700 10 client.4353.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:21.927 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c13a000 con 0x7f119c0684b0 2021-02-24T15:16:21.927 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f11a1919700 1 librados: init done 2021-02-24T15:16:21.927 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f118c002450 con 0x7f119c0684b0 2021-02-24T15:16:21.928 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.913+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f118c002760 con 0x7f119c0684b0 2021-02-24T15:16:21.928 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.914+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f118c002940 con 0x7f119c0684b0 2021-02-24T15:16:21.928 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.914+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f118c03aa00 con 0x7f119c0684b0 2021-02-24T15:16:21.928 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.914+0000 7f1182ffd700 10 client.4353.objecter ms_dispatch 0x7f119c001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:21.928 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.914+0000 7f1182ffd700 3 client.4353.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:21.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.914+0000 7f1182ffd700 3 client.4353.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:21.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.914+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1174004d60 con 0x7f119c0684b0 2021-02-24T15:16:21.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.914+0000 7f1182ffd700 20 client.4353.objecter dump_active .. 0 homeless 2021-02-24T15:16:21.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.917+0000 7f1182ffd700 10 client.4353.objecter ms_handle_connect 0x7f117c031830 2021-02-24T15:16:21.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:21.918+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f118c012840 con 0x7f119c0684b0 2021-02-24T15:16:22.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.088+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1174005590 con 0x7f119c0684b0 2021-02-24T15:16:22.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.088+0000 7f1182ffd700 1 -- 172.21.15.152:0/1128967612 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v15) v1 ==== 110+0+10 (unknown 1134451309 0 2170607528) 0x7f118c012430 con 0x7f119c0684b0 2021-02-24T15:16:22.090 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2021-02-24T15:16:22.091 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 10 librados: watch_flush enter 2021-02-24T15:16:22.091 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 10 librados: watch_flush exit 2021-02-24T15:16:22.091 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 20 client.4353.objecter shutdown clearing up homeless session... 2021-02-24T15:16:22.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 10 client.4353.objecter successfully canceled tick 2021-02-24T15:16:22.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 >> v1:172.21.15.181:6812/33484 conn(0x7f117c031830 legacy=0x7f117c033cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 >> v1:172.21.15.152:6789/0 conn(0x7f119c0684b0 legacy=0x7f119c12fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 shutdown_connections 2021-02-24T15:16:22.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 >> 172.21.15.152:0/1128967612 conn(0x7f119c09a870 msgr2=0x7f119c124380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:22.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 shutdown_connections 2021-02-24T15:16:22.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 1 -- 172.21.15.152:0/1128967612 wait complete. 2021-02-24T15:16:22.094 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.090+0000 7f11a1919700 1 librados: shutdown 2021-02-24T15:16:22.104 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-24T15:16:22.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.227+0000 7f902c648700 1 Processor -- start 2021-02-24T15:16:22.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.227+0000 7f902c648700 1 -- start start 2021-02-24T15:16:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.227+0000 7f902c648700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024099bc0 con 0x7f9024098f30 2021-02-24T15:16:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.227+0000 7f902c648700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024062300 con 0x7f902412adc0 2021-02-24T15:16:22.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.227+0000 7f902c648700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024099df0 con 0x7f90240613c0 2021-02-24T15:16:22.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.227+0000 7f902abe5700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9024098f30 0x7f9024133370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46220/0 (socket says 172.21.15.152:46220) 2021-02-24T15:16:22.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.227+0000 7f902a3e4700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f90240613c0 0x7f90240679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34696/0 (socket says 172.21.15.152:34696) 2021-02-24T15:16:22.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.227+0000 7f902abe5700 1 -- 172.21.15.152:0/4035123257 learned_addr learned my addr 172.21.15.152:0/4035123257 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:22.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f902abe5700 1 -- 172.21.15.152:0/4035123257 >> v1:172.21.15.152:6789/0 conn(0x7f9024098f30 legacy=0x7f9024133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f902a3e4700 1 -- 172.21.15.152:0/4035123257 >> v1:172.21.15.152:6790/0 conn(0x7f90240613c0 legacy=0x7f90240679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279354169 0 0) 0x7f9024099bc0 con 0x7f9024098f30 2021-02-24T15:16:22.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f900c003230 con 0x7f9024098f30 2021-02-24T15:16:22.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121707674 0 0) 0x7f9024099df0 con 0x7f90240613c0 2021-02-24T15:16:22.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9024099bc0 con 0x7f90240613c0 2021-02-24T15:16:22.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f9029be3700 1 -- 172.21.15.152:0/4035123257 >> v1:172.21.15.181:6789/0 conn(0x7f902412adc0 legacy=0x7f902412fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3325525309 0 0) 0x7f9024099bc0 con 0x7f90240613c0 2021-02-24T15:16:22.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 >> v1:172.21.15.181:6789/0 conn(0x7f902412adc0 legacy=0x7f902412fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 >> v1:172.21.15.152:6789/0 conn(0x7f9024098f30 legacy=0x7f9024133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902409a090 con 0x7f90240613c0 2021-02-24T15:16:22.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9020001970 con 0x7f90240613c0 2021-02-24T15:16:22.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9020001c80 con 0x7f90240613c0 2021-02-24T15:16:22.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.230+0000 7f90293e2700 1 -- 172.21.15.152:0/4035123257 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9020004690 con 0x7f90240613c0 2021-02-24T15:16:22.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.231+0000 7f902c648700 1 -- 172.21.15.152:0/4035123257 >> v1:172.21.15.152:6790/0 conn(0x7f90240613c0 legacy=0x7f90240679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.231+0000 7f902c648700 1 -- 172.21.15.152:0/4035123257 shutdown_connections 2021-02-24T15:16:22.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.231+0000 7f902c648700 1 -- 172.21.15.152:0/4035123257 >> 172.21.15.152:0/4035123257 conn(0x7f902409a9c0 msgr2=0x7f902409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:22.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.231+0000 7f902c648700 1 -- 172.21.15.152:0/4035123257 shutdown_connections 2021-02-24T15:16:22.239 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.231+0000 7f902c648700 1 -- 172.21.15.152:0/4035123257 wait complete. 2021-02-24T15:16:22.239 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.231+0000 7f902c648700 1 librados: starting msgr at 2021-02-24T15:16:22.239 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.231+0000 7f902c648700 1 librados: starting objecter 2021-02-24T15:16:22.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.232+0000 7f902c648700 1 Processor -- start 2021-02-24T15:16:22.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.232+0000 7f902c648700 1 -- start start 2021-02-24T15:16:22.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.232+0000 7f902c648700 1 librados: setting wanted keys 2021-02-24T15:16:22.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.232+0000 7f902c648700 1 librados: calling monclient init 2021-02-24T15:16:22.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.232+0000 7f902c648700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024099390 con 0x7f90240613c0 2021-02-24T15:16:22.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.232+0000 7f902c648700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024122c10 con 0x7f902412adc0 2021-02-24T15:16:22.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.232+0000 7f902c648700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024122eb0 con 0x7f9024098f30 2021-02-24T15:16:22.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.232+0000 7f9029be3700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f9024098f30 0x7f9024124360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34702/0 (socket says 172.21.15.152:34702) 2021-02-24T15:16:22.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.232+0000 7f9029be3700 1 -- 172.21.15.152:0/1557373874 learned_addr learned my addr 172.21.15.152:0/1557373874 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:22.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.234+0000 7f9029be3700 1 -- 172.21.15.152:0/1557373874 >> v1:172.21.15.152:6790/0 conn(0x7f9024098f30 legacy=0x7f9024124360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.234+0000 7f90127fc700 10 client.?.objecter ms_handle_connect 0x7f9024098f30 2021-02-24T15:16:22.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.234+0000 7f902a3e4700 1 -- 172.21.15.152:0/1557373874 >> v1:172.21.15.152:6789/0 conn(0x7f90240613c0 legacy=0x7f9024139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.234+0000 7f90127fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.234+0000 7f90127fc700 10 client.?.objecter ms_handle_connect 0x7f90240613c0 2021-02-24T15:16:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.234+0000 7f90127fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:22.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.234+0000 7f90127fc700 10 client.?.objecter ms_handle_connect 0x7f902412adc0 2021-02-24T15:16:22.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.234+0000 7f90127fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.234+0000 7f902abe5700 1 -- 172.21.15.152:0/1557373874 >> v1:172.21.15.181:6789/0 conn(0x7f902412adc0 legacy=0x7f9024142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760529466 0 0) 0x7f9024122eb0 con 0x7f9024098f30 2021-02-24T15:16:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9004004bd0 con 0x7f9024098f30 2021-02-24T15:16:22.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239526713 0 0) 0x7f9024099390 con 0x7f90240613c0 2021-02-24T15:16:22.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9024122eb0 con 0x7f90240613c0 2021-02-24T15:16:22.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206464342 0 0) 0x7f9024122c10 con 0x7f902412adc0 2021-02-24T15:16:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9024099390 con 0x7f902412adc0 2021-02-24T15:16:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2281713217 0 0) 0x7f9004004bd0 con 0x7f9024098f30 2021-02-24T15:16:22.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9024122c10 con 0x7f9024098f30 2021-02-24T15:16:22.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9014001c90 con 0x7f9024098f30 2021-02-24T15:16:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1326396426 0 0) 0x7f9024122eb0 con 0x7f90240613c0 2021-02-24T15:16:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9004004bd0 con 0x7f90240613c0 2021-02-24T15:16:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f90200044f0 con 0x7f90240613c0 2021-02-24T15:16:22.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2059861966 0 0) 0x7f9024099390 con 0x7f902412adc0 2021-02-24T15:16:22.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9024122eb0 con 0x7f902412adc0 2021-02-24T15:16:22.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f901c001fe0 con 0x7f902412adc0 2021-02-24T15:16:22.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4073362885 0 0) 0x7f9024122c10 con 0x7f9024098f30 2021-02-24T15:16:22.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 >> v1:172.21.15.181:6789/0 conn(0x7f902412adc0 legacy=0x7f9024142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 >> v1:172.21.15.152:6789/0 conn(0x7f90240613c0 legacy=0x7f9024139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024120d60 con 0x7f9024098f30 2021-02-24T15:16:22.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902413a420 con 0x7f9024098f30 2021-02-24T15:16:22.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f902c648700 10 client.4355.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:22.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9024124c30 con 0x7f9024098f30 2021-02-24T15:16:22.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f902c648700 1 librados: init done 2021-02-24T15:16:22.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9014002330 con 0x7f9024098f30 2021-02-24T15:16:22.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.235+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9014002640 con 0x7f9024098f30 2021-02-24T15:16:22.266 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.236+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f9014002820 con 0x7f9024098f30 2021-02-24T15:16:22.266 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.236+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f901403a8f0 con 0x7f9024098f30 2021-02-24T15:16:22.266 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.236+0000 7f90127fc700 10 client.4355.objecter ms_dispatch 0x7f9024001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:22.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.236+0000 7f90127fc700 3 client.4355.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:22.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.236+0000 7f90127fc700 3 client.4355.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:22.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.236+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9008004d60 con 0x7f9024098f30 2021-02-24T15:16:22.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.236+0000 7f90127fc700 20 client.4355.objecter dump_active .. 0 homeless 2021-02-24T15:16:22.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.239+0000 7f90127fc700 10 client.4355.objecter ms_handle_connect 0x7f90040318d0 2021-02-24T15:16:22.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.240+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f9014012730 con 0x7f9024098f30 2021-02-24T15:16:22.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.412+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9008005590 con 0x7f9024098f30 2021-02-24T15:16:22.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.413+0000 7f90127fc700 1 -- 172.21.15.152:0/1557373874 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (unknown 946793192 0 265718887) 0x7f9014012320 con 0x7f9024098f30 2021-02-24T15:16:22.414 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 8 2021-02-24T15:16:22.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.414+0000 7f902c648700 10 librados: watch_flush enter 2021-02-24T15:16:22.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.414+0000 7f902c648700 10 librados: watch_flush exit 2021-02-24T15:16:22.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.414+0000 7f902c648700 20 client.4355.objecter shutdown clearing up homeless session... 2021-02-24T15:16:22.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.414+0000 7f902c648700 10 client.4355.objecter successfully canceled tick 2021-02-24T15:16:22.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.414+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 >> v1:172.21.15.181:6812/33484 conn(0x7f90040318d0 legacy=0x7f9004033d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.414+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 >> v1:172.21.15.152:6790/0 conn(0x7f9024098f30 legacy=0x7f9024124360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.414+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 shutdown_connections 2021-02-24T15:16:22.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.414+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 >> 172.21.15.152:0/1557373874 conn(0x7f902409a9c0 msgr2=0x7f9024129750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:22.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.415+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 shutdown_connections 2021-02-24T15:16:22.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.415+0000 7f902c648700 1 -- 172.21.15.152:0/1557373874 wait complete. 2021-02-24T15:16:22.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.415+0000 7f902c648700 1 librados: shutdown 2021-02-24T15:16:22.427 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2021-02-24T15:16:22.427 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-24T15:16:22.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.544+0000 7f149d45f700 1 Processor -- start 2021-02-24T15:16:22.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.544+0000 7f149d45f700 1 -- start start 2021-02-24T15:16:22.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.545+0000 7f149d45f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1498092e60 con 0x7f1498095930 2021-02-24T15:16:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.545+0000 7f149d45f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1498091f30 con 0x7f1498094e40 2021-02-24T15:16:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.545+0000 7f149d45f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14980921d0 con 0x7f1498091110 2021-02-24T15:16:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.545+0000 7f14977fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1498095930 0x7f149812f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46238/0 (socket says 172.21.15.152:46238) 2021-02-24T15:16:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.545+0000 7f14967fc700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f1498091110 0x7f1498095220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34712/0 (socket says 172.21.15.152:34712) 2021-02-24T15:16:22.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.545+0000 7f14977fe700 1 -- 172.21.15.152:0/2455246566 learned_addr learned my addr 172.21.15.152:0/2455246566 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:22.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.547+0000 7f14977fe700 1 -- 172.21.15.152:0/2455246566 >> v1:172.21.15.152:6789/0 conn(0x7f1498095930 legacy=0x7f149812f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.547+0000 7f14967fc700 1 -- 172.21.15.152:0/2455246566 >> v1:172.21.15.152:6790/0 conn(0x7f1498091110 legacy=0x7f1498095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.547+0000 7f1496ffd700 1 -- 172.21.15.152:0/2455246566 >> v1:172.21.15.181:6789/0 conn(0x7f1498094e40 legacy=0x7f1498092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.547+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184849478 0 0) 0x7f14980921d0 con 0x7f1498091110 2021-02-24T15:16:22.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.547+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1484003230 con 0x7f1498091110 2021-02-24T15:16:22.552 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.547+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485991109 0 0) 0x7f1498092e60 con 0x7f1498095930 2021-02-24T15:16:22.552 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.547+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14980921d0 con 0x7f1498095930 2021-02-24T15:16:22.552 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.547+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181260062 0 0) 0x7f1498091f30 con 0x7f1498094e40 2021-02-24T15:16:22.552 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.547+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1498092e60 con 0x7f1498094e40 2021-02-24T15:16:22.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2221305789 0 0) 0x7f1484003230 con 0x7f1498091110 2021-02-24T15:16:22.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 >> v1:172.21.15.181:6789/0 conn(0x7f1498094e40 legacy=0x7f1498092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 >> v1:172.21.15.152:6789/0 conn(0x7f1498095930 legacy=0x7f149812f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1498091590 con 0x7f1498091110 2021-02-24T15:16:22.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f148c0019f0 con 0x7f1498091110 2021-02-24T15:16:22.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f148c001c90 con 0x7f1498091110 2021-02-24T15:16:22.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f1495ffb700 1 -- 172.21.15.152:0/2455246566 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f148c004690 con 0x7f1498091110 2021-02-24T15:16:22.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f149d45f700 1 -- 172.21.15.152:0/2455246566 >> v1:172.21.15.152:6790/0 conn(0x7f1498091110 legacy=0x7f1498095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f149d45f700 1 -- 172.21.15.152:0/2455246566 shutdown_connections 2021-02-24T15:16:22.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f149d45f700 1 -- 172.21.15.152:0/2455246566 >> 172.21.15.152:0/2455246566 conn(0x7f14980999a0 msgr2=0x7f1498099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:22.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f149d45f700 1 -- 172.21.15.152:0/2455246566 shutdown_connections 2021-02-24T15:16:22.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.548+0000 7f149d45f700 1 -- 172.21.15.152:0/2455246566 wait complete. 2021-02-24T15:16:22.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.549+0000 7f149d45f700 1 librados: starting msgr at 2021-02-24T15:16:22.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.549+0000 7f149d45f700 1 librados: starting objecter 2021-02-24T15:16:22.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.549+0000 7f149d45f700 1 Processor -- start 2021-02-24T15:16:22.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.549+0000 7f149d45f700 1 -- start start 2021-02-24T15:16:22.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.549+0000 7f149d45f700 1 librados: setting wanted keys 2021-02-24T15:16:22.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.549+0000 7f149d45f700 1 librados: calling monclient init 2021-02-24T15:16:22.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.550+0000 7f149d45f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1498067a50 con 0x7f1498091110 2021-02-24T15:16:22.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.550+0000 7f149d45f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1498067000 con 0x7f1498095930 2021-02-24T15:16:22.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.550+0000 7f149d45f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1498132340 con 0x7f1498094e40 2021-02-24T15:16:22.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.550+0000 7f1496ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1498091110 0x7f1498115ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46240/0 (socket says 172.21.15.152:46240) 2021-02-24T15:16:22.561 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.550+0000 7f1496ffd700 1 -- 172.21.15.152:0/604391359 learned_addr learned my addr 172.21.15.152:0/604391359 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:22.562 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f1496ffd700 1 -- 172.21.15.152:0/604391359 >> v1:172.21.15.152:6789/0 conn(0x7f1498091110 legacy=0x7f1498115ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.562 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f14967fc700 1 -- 172.21.15.152:0/604391359 >> v1:172.21.15.152:6790/0 conn(0x7f1498094e40 legacy=0x7f1498131c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.562 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 10 client.?.objecter ms_handle_connect 0x7f1498091110 2021-02-24T15:16:22.563 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:22.563 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 10 client.?.objecter ms_handle_connect 0x7f1498094e40 2021-02-24T15:16:22.563 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:22.564 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f14977fe700 1 -- 172.21.15.152:0/604391359 >> v1:172.21.15.181:6789/0 conn(0x7f1498095930 legacy=0x7f149813fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.565 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 10 client.?.objecter ms_handle_connect 0x7f1498095930 2021-02-24T15:16:22.565 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:22.565 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631385893 0 0) 0x7f1498067a50 con 0x7f1498091110 2021-02-24T15:16:22.566 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1478004bd0 con 0x7f1498091110 2021-02-24T15:16:22.566 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454859279 0 0) 0x7f1498067000 con 0x7f1498095930 2021-02-24T15:16:22.566 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1498067a50 con 0x7f1498095930 2021-02-24T15:16:22.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3373854816 0 0) 0x7f1478004bd0 con 0x7f1498091110 2021-02-24T15:16:22.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1498067000 con 0x7f1498091110 2021-02-24T15:16:22.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1488001960 con 0x7f1498091110 2021-02-24T15:16:22.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 753387157 0 0) 0x7f1498067a50 con 0x7f1498095930 2021-02-24T15:16:22.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1478004bd0 con 0x7f1498095930 2021-02-24T15:16:22.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1490002060 con 0x7f1498095930 2021-02-24T15:16:22.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 618550514 0 0) 0x7f1498067000 con 0x7f1498091110 2021-02-24T15:16:22.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 >> v1:172.21.15.152:6790/0 conn(0x7f1498094e40 legacy=0x7f1498131c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 >> v1:172.21.15.181:6789/0 conn(0x7f1498095930 legacy=0x7f149813fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14981193b0 con 0x7f1498091110 2021-02-24T15:16:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.552+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14981180f0 con 0x7f1498091110 2021-02-24T15:16:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f149d45f700 10 client.4365.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1498116ca0 con 0x7f1498091110 2021-02-24T15:16:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f149d45f700 1 librados: init done 2021-02-24T15:16:22.570 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1488002330 con 0x7f1498091110 2021-02-24T15:16:22.570 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1488002640 con 0x7f1498091110 2021-02-24T15:16:22.570 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f1488002820 con 0x7f1498091110 2021-02-24T15:16:22.570 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f148803a990 con 0x7f1498091110 2021-02-24T15:16:22.570 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f147effd700 10 client.4365.objecter ms_dispatch 0x7f1498001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:22.571 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f147effd700 3 client.4365.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:22.571 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f147effd700 3 client.4365.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:22.571 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.553+0000 7f147effd700 20 client.4365.objecter dump_active .. 0 homeless 2021-02-24T15:16:22.571 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.554+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1470004d60 con 0x7f1498091110 2021-02-24T15:16:22.571 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.556+0000 7f147effd700 10 client.4365.objecter ms_handle_connect 0x7f1478031640 2021-02-24T15:16:22.572 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.558+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f14880127d0 con 0x7f1498091110 2021-02-24T15:16:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.721+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 --> v1:172.21.15.181:6812/33484 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1470000b50 con 0x7f1478031640 2021-02-24T15:16:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.723+0000 7f147effd700 1 -- 172.21.15.152:0/604391359 <== mgr.4104 v1:172.21.15.181:6812/33484 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+36827 (unknown 2965378022 0 2099383207) 0x7f1470000b50 con 0x7f1478031640 2021-02-24T15:16:22.725 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:22.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 10 librados: watch_flush enter 2021-02-24T15:16:22.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 10 librados: watch_flush exit 2021-02-24T15:16:22.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 20 client.4365.objecter shutdown clearing up homeless session... 2021-02-24T15:16:22.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 10 client.4365.objecter successfully canceled tick 2021-02-24T15:16:22.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 >> v1:172.21.15.181:6812/33484 conn(0x7f1478031640 legacy=0x7f1478033b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 >> v1:172.21.15.152:6789/0 conn(0x7f1498091110 legacy=0x7f1498115ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 shutdown_connections 2021-02-24T15:16:22.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 >> 172.21.15.152:0/604391359 conn(0x7f14980999a0 msgr2=0x7f1498066530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:22.729 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 shutdown_connections 2021-02-24T15:16:22.729 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 1 -- 172.21.15.152:0/604391359 wait complete. 2021-02-24T15:16:22.729 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.725+0000 7f149d45f700 1 librados: shutdown 2021-02-24T15:16:22.729 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2021-02-24T15:16:22.737 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2021-02-24T15:16:22.613188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29608,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":566201432,"statfs":{"total":579820584960,"available":579790266368,"internally_reserved":0,"allocated":778240,"data_stored":230365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.146059+0000","last_change":"2021-02-24T15:16:14.141537+0000","last_active":"2021-02-24T15:16:14.146059+0000","last_peered":"2021-02-24T15:16:14.146059+0000","last_clean":"2021-02-24T15:16:14.146059+0000","last_became_active":"2021-02-24T15:16:14.141253+0000","last_became_peered":"2021-02-24T15:16:14.141253+0000","last_unstale":"2021-02-24T15:16:14.146059+0000","last_undegraded":"2021-02-24T15:16:14.146059+0000","last_fullsized":"2021-02-24T15:16:14.146059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.150994+0000","last_change":"2021-02-24T15:16:14.149350+0000","last_active":"2021-02-24T15:16:14.150994+0000","last_peered":"2021-02-24T15:16:14.150994+0000","last_clean":"2021-02-24T15:16:14.150994+0000","last_became_active":"2021-02-24T15:16:14.149044+0000","last_became_peered":"2021-02-24T15:16:14.149044+0000","last_unstale":"2021-02-24T15:16:14.150994+0000","last_undegraded":"2021-02-24T15:16:14.150994+0000","last_fullsized":"2021-02-24T15:16:14.150994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.146067+0000","last_change":"2021-02-24T15:16:14.142203+0000","last_active":"2021-02-24T15:16:14.146067+0000","last_peered":"2021-02-24T15:16:14.146067+0000","last_clean":"2021-02-24T15:16:14.146067+0000","last_became_active":"2021-02-24T15:16:14.141603+0000","last_became_peered":"2021-02-24T15:16:14.141603+0000","last_unstale":"2021-02-24T15:16:14.146067+0000","last_undegraded":"2021-02-24T15:16:14.146067+0000","last_fullsized":"2021-02-24T15:16:14.146067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.141135+0000","last_change":"2021-02-24T15:16:14.139802+0000","last_active":"2021-02-24T15:16:14.141135+0000","last_peered":"2021-02-24T15:16:14.141135+0000","last_clean":"2021-02-24T15:16:14.141135+0000","last_became_active":"2021-02-24T15:16:14.139441+0000","last_became_peered":"2021-02-24T15:16:14.139441+0000","last_unstale":"2021-02-24T15:16:14.141135+0000","last_undegraded":"2021-02-24T15:16:14.141135+0000","last_fullsized":"2021-02-24T15:16:14.141135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.138317+0000","last_change":"2021-02-24T15:16:13.177107+0000","last_active":"2021-02-24T15:16:14.138317+0000","last_peered":"2021-02-24T15:16:14.138317+0000","last_clean":"2021-02-24T15:16:14.138317+0000","last_became_active":"2021-02-24T15:16:13.176756+0000","last_became_peered":"2021-02-24T15:16:13.176756+0000","last_unstale":"2021-02-24T15:16:14.138317+0000","last_undegraded":"2021-02-24T15:16:14.138317+0000","last_fullsized":"2021-02-24T15:16:14.138317+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:12.122205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:12.122205+0000","last_clean_scrub_stamp":"2021-02-24T15:16:12.122205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.148549+0000","last_change":"2021-02-24T15:16:14.144094+0000","last_active":"2021-02-24T15:16:14.148549+0000","last_peered":"2021-02-24T15:16:14.148549+0000","last_clean":"2021-02-24T15:16:14.148549+0000","last_became_active":"2021-02-24T15:16:14.143785+0000","last_became_peered":"2021-02-24T15:16:14.143785+0000","last_unstale":"2021-02-24T15:16:14.148549+0000","last_undegraded":"2021-02-24T15:16:14.148549+0000","last_fullsized":"2021-02-24T15:16:14.148549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.140100+0000","last_change":"2021-02-24T15:16:14.138399+0000","last_active":"2021-02-24T15:16:14.140100+0000","last_peered":"2021-02-24T15:16:14.140100+0000","last_clean":"2021-02-24T15:16:14.140100+0000","last_became_active":"2021-02-24T15:16:14.138094+0000","last_became_peered":"2021-02-24T15:16:14.138094+0000","last_unstale":"2021-02-24T15:16:14.140100+0000","last_undegraded":"2021-02-24T15:16:14.140100+0000","last_fullsized":"2021-02-24T15:16:14.140100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.148365+0000","last_change":"2021-02-24T15:16:14.141474+0000","last_active":"2021-02-24T15:16:14.148365+0000","last_peered":"2021-02-24T15:16:14.148365+0000","last_clean":"2021-02-24T15:16:14.148365+0000","last_became_active":"2021-02-24T15:16:14.141185+0000","last_became_peered":"2021-02-24T15:16:14.141185+0000","last_unstale":"2021-02-24T15:16:14.148365+0000","last_undegraded":"2021-02-24T15:16:14.148365+0000","last_fullsized":"2021-02-24T15:16:14.148365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.140534+0000","last_change":"2021-02-24T15:16:14.138984+0000","last_active":"2021-02-24T15:16:14.140534+0000","last_peered":"2021-02-24T15:16:14.140534+0000","last_clean":"2021-02-24T15:16:14.140534+0000","last_became_active":"2021-02-24T15:16:14.138636+0000","last_became_peered":"2021-02-24T15:16:14.138636+0000","last_unstale":"2021-02-24T15:16:14.140534+0000","last_undegraded":"2021-02-24T15:16:14.140534+0000","last_fullsized":"2021-02-24T15:16:14.140534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4932,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366908,"statfs":{"total":96636764160,"available":96631713792,"internally_reserved":0,"allocated":126976,"data_stored":37793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4932,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366908,"statfs":{"total":96636764160,"available":96631713792,"internally_reserved":0,"allocated":126976,"data_stored":37752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]}]}} 2021-02-24T15:16:22.739 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-24T15:16:22.859 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.858+0000 7ff3c0485700 1 Processor -- start 2021-02-24T15:16:22.859 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.858+0000 7ff3c0485700 1 -- start start 2021-02-24T15:16:22.860 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.859+0000 7ff3c0485700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b8062660 con 0x7ff3b80966a0 2021-02-24T15:16:22.860 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.859+0000 7ff3c0485700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b8063af0 con 0x7ff3b8095bb0 2021-02-24T15:16:22.861 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.859+0000 7ff3c0485700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b8063d90 con 0x7ff3b8068410 2021-02-24T15:16:22.861 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.859+0000 7ff3bea22700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff3b8068410 0x7ff3b8133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34728/0 (socket says 172.21.15.152:34728) 2021-02-24T15:16:22.861 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.859+0000 7ff3bea22700 1 -- 172.21.15.152:0/2014365589 learned_addr learned my addr 172.21.15.152:0/2014365589 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:22.861 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.859+0000 7ff3be221700 1 --1- 172.21.15.152:0/2014365589 >> v1:172.21.15.152:6789/0 conn(0x7ff3b80966a0 0x7ff3b8096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46248/0 (socket says 172.21.15.152:46248) 2021-02-24T15:16:22.864 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bea22700 1 -- 172.21.15.152:0/2014365589 >> v1:172.21.15.152:6790/0 conn(0x7ff3b8068410 legacy=0x7ff3b8133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.864 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3be221700 1 -- 172.21.15.152:0/2014365589 >> v1:172.21.15.152:6789/0 conn(0x7ff3b80966a0 legacy=0x7ff3b8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.864 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479955163 0 0) 0x7ff3b8062660 con 0x7ff3b80966a0 2021-02-24T15:16:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a0003230 con 0x7ff3b80966a0 2021-02-24T15:16:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bda20700 1 -- 172.21.15.152:0/2014365589 >> v1:172.21.15.181:6789/0 conn(0x7ff3b8095bb0 legacy=0x7ff3b8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914808850 0 0) 0x7ff3b8063d90 con 0x7ff3b8068410 2021-02-24T15:16:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b8062660 con 0x7ff3b8068410 2021-02-24T15:16:22.866 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599535991 0 0) 0x7ff3b8063af0 con 0x7ff3b8095bb0 2021-02-24T15:16:22.866 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b8063d90 con 0x7ff3b8095bb0 2021-02-24T15:16:22.866 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 905388618 0 0) 0x7ff3a0003230 con 0x7ff3b80966a0 2021-02-24T15:16:22.866 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 >> v1:172.21.15.152:6790/0 conn(0x7ff3b8068410 legacy=0x7ff3b8133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.867 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 >> v1:172.21.15.181:6789/0 conn(0x7ff3b8095bb0 legacy=0x7ff3b8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.867 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8064030 con 0x7ff3b80966a0 2021-02-24T15:16:22.867 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff3a8001860 con 0x7ff3b80966a0 2021-02-24T15:16:22.867 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff3a8001b70 con 0x7ff3b80966a0 2021-02-24T15:16:22.867 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.861+0000 7ff3bd21f700 1 -- 172.21.15.152:0/2014365589 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff3a80044f0 con 0x7ff3b80966a0 2021-02-24T15:16:22.868 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.862+0000 7ff3c0485700 1 -- 172.21.15.152:0/2014365589 >> v1:172.21.15.152:6789/0 conn(0x7ff3b80966a0 legacy=0x7ff3b8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.868 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.862+0000 7ff3c0485700 1 -- 172.21.15.152:0/2014365589 shutdown_connections 2021-02-24T15:16:22.868 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.862+0000 7ff3c0485700 1 -- 172.21.15.152:0/2014365589 >> 172.21.15.152:0/2014365589 conn(0x7ff3b809ba40 msgr2=0x7ff3b809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:22.868 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.862+0000 7ff3c0485700 1 -- 172.21.15.152:0/2014365589 shutdown_connections 2021-02-24T15:16:22.868 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.862+0000 7ff3c0485700 1 -- 172.21.15.152:0/2014365589 wait complete. 2021-02-24T15:16:22.869 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3c0485700 1 librados: starting msgr at 2021-02-24T15:16:22.869 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3c0485700 1 librados: starting objecter 2021-02-24T15:16:22.869 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3c0485700 1 Processor -- start 2021-02-24T15:16:22.870 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3c0485700 1 -- start start 2021-02-24T15:16:22.870 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3c0485700 1 librados: setting wanted keys 2021-02-24T15:16:22.870 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3c0485700 1 librados: calling monclient init 2021-02-24T15:16:22.870 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3c0485700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b8063010 con 0x7ff3b80966a0 2021-02-24T15:16:22.871 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3c0485700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b8067420 con 0x7ff3b8095bb0 2021-02-24T15:16:22.871 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3c0485700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b8134410 con 0x7ff3b8068410 2021-02-24T15:16:22.871 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3be221700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff3b8068410 0x7ff3b8133d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34730/0 (socket says 172.21.15.152:34730) 2021-02-24T15:16:22.871 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.863+0000 7ff3be221700 1 -- 172.21.15.152:0/775887876 learned_addr learned my addr 172.21.15.152:0/775887876 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:22.874 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.865+0000 7ff3bea22700 1 -- 172.21.15.152:0/775887876 >> v1:172.21.15.152:6789/0 conn(0x7ff3b80966a0 legacy=0x7ff3b8142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.874 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.865+0000 7ff3a67fc700 10 client.?.objecter ms_handle_connect 0x7ff3b80966a0 2021-02-24T15:16:22.875 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.865+0000 7ff3a67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:22.875 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.865+0000 7ff3be221700 1 -- 172.21.15.152:0/775887876 >> v1:172.21.15.152:6790/0 conn(0x7ff3b8068410 legacy=0x7ff3b8133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.875 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.865+0000 7ff3a67fc700 10 client.?.objecter ms_handle_connect 0x7ff3b8068410 2021-02-24T15:16:22.875 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.865+0000 7ff3a67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:22.876 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.865+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310866158 0 0) 0x7ff3b8063010 con 0x7ff3b80966a0 2021-02-24T15:16:22.876 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff398004bd0 con 0x7ff3b80966a0 2021-02-24T15:16:22.876 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881258861 0 0) 0x7ff3b8134410 con 0x7ff3b8068410 2021-02-24T15:16:22.876 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3bda20700 1 -- 172.21.15.152:0/775887876 >> v1:172.21.15.181:6789/0 conn(0x7ff3b8095bb0 legacy=0x7ff3b813a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:22.877 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b8063010 con 0x7ff3b8068410 2021-02-24T15:16:22.877 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 10 client.?.objecter ms_handle_connect 0x7ff3b8095bb0 2021-02-24T15:16:22.877 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:22.877 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340948522 0 0) 0x7ff3b8067420 con 0x7ff3b8095bb0 2021-02-24T15:16:22.877 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b8134410 con 0x7ff3b8095bb0 2021-02-24T15:16:22.878 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2265413697 0 0) 0x7ff398004bd0 con 0x7ff3b80966a0 2021-02-24T15:16:22.878 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff3b8067420 con 0x7ff3b80966a0 2021-02-24T15:16:22.878 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff3b0001cd0 con 0x7ff3b80966a0 2021-02-24T15:16:22.878 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4197295332 0 0) 0x7ff3b8063010 con 0x7ff3b8068410 2021-02-24T15:16:22.878 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff398004bd0 con 0x7ff3b8068410 2021-02-24T15:16:22.879 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff3a80044f0 con 0x7ff3b8068410 2021-02-24T15:16:22.879 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3712719047 0 0) 0x7ff3b8134410 con 0x7ff3b8095bb0 2021-02-24T15:16:22.879 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff3b8063010 con 0x7ff3b8095bb0 2021-02-24T15:16:22.880 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff3b4001be0 con 0x7ff3b8095bb0 2021-02-24T15:16:22.880 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1749188701 0 0) 0x7ff3b8067420 con 0x7ff3b80966a0 2021-02-24T15:16:22.880 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 >> v1:172.21.15.152:6790/0 conn(0x7ff3b8068410 legacy=0x7ff3b8133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.880 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 >> v1:172.21.15.181:6789/0 conn(0x7ff3b8095bb0 legacy=0x7ff3b813a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:22.880 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b811b6e0 con 0x7ff3b80966a0 2021-02-24T15:16:22.881 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b813a7d0 con 0x7ff3b80966a0 2021-02-24T15:16:22.882 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3c0485700 10 client.4371.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:22.882 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b811a210 con 0x7ff3b80966a0 2021-02-24T15:16:22.883 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3c0485700 1 librados: init done 2021-02-24T15:16:22.883 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff3b0004c70 con 0x7ff3b80966a0 2021-02-24T15:16:22.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.866+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff3b0004f80 con 0x7ff3b80966a0 2021-02-24T15:16:22.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.867+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff3b0005160 con 0x7ff3b80966a0 2021-02-24T15:16:22.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.867+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7ff3b003ad20 con 0x7ff3b80966a0 2021-02-24T15:16:22.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.867+0000 7ff3a67fc700 10 client.4371.objecter ms_dispatch 0x7ff3b8001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:22.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.867+0000 7ff3a67fc700 3 client.4371.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:22.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.867+0000 7ff3a67fc700 3 client.4371.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:22.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.867+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39c004d60 con 0x7ff3b80966a0 2021-02-24T15:16:22.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.867+0000 7ff3a67fc700 20 client.4371.objecter dump_active .. 0 homeless 2021-02-24T15:16:22.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.869+0000 7ff3a67fc700 10 client.4371.objecter ms_handle_connect 0x7ff398031890 2021-02-24T15:16:22.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:22.871+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7ff3b0012b00 con 0x7ff3b80966a0 2021-02-24T15:16:23.037 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.036+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 --> v1:172.21.15.181:6812/33484 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff39c000b50 con 0x7ff398031890 2021-02-24T15:16:23.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.038+0000 7ff3a67fc700 1 -- 172.21.15.152:0/775887876 <== mgr.4104 v1:172.21.15.181:6812/33484 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+36827 (unknown 2965378022 0 2099383207) 0x7ff39c000b50 con 0x7ff398031890 2021-02-24T15:16:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: 2021-02-24T15:16:23.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 10 librados: watch_flush enter 2021-02-24T15:16:23.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 10 librados: watch_flush exit 2021-02-24T15:16:23.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 20 client.4371.objecter shutdown clearing up homeless session... 2021-02-24T15:16:23.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 10 client.4371.objecter successfully canceled tick 2021-02-24T15:16:23.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 >> v1:172.21.15.181:6812/33484 conn(0x7ff398031890 legacy=0x7ff398033d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.042 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 >> v1:172.21.15.152:6789/0 conn(0x7ff3b80966a0 legacy=0x7ff3b8142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.042 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 shutdown_connections 2021-02-24T15:16:23.042 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 >> 172.21.15.152:0/775887876 conn(0x7ff3b809ba40 msgr2=0x7ff3b809a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:23.043 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 shutdown_connections 2021-02-24T15:16:23.044 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 1 -- 172.21.15.152:0/775887876 wait complete. 2021-02-24T15:16:23.044 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.039+0000 7ff3c0485700 1 librados: shutdown 2021-02-24T15:16:23.044 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2021-02-24T15:16:23.051 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2021-02-24T15:16:22.613188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29608,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":566201432,"statfs":{"total":579820584960,"available":579790266368,"internally_reserved":0,"allocated":778240,"data_stored":230365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.146059+0000","last_change":"2021-02-24T15:16:14.141537+0000","last_active":"2021-02-24T15:16:14.146059+0000","last_peered":"2021-02-24T15:16:14.146059+0000","last_clean":"2021-02-24T15:16:14.146059+0000","last_became_active":"2021-02-24T15:16:14.141253+0000","last_became_peered":"2021-02-24T15:16:14.141253+0000","last_unstale":"2021-02-24T15:16:14.146059+0000","last_undegraded":"2021-02-24T15:16:14.146059+0000","last_fullsized":"2021-02-24T15:16:14.146059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.150994+0000","last_change":"2021-02-24T15:16:14.149350+0000","last_active":"2021-02-24T15:16:14.150994+0000","last_peered":"2021-02-24T15:16:14.150994+0000","last_clean":"2021-02-24T15:16:14.150994+0000","last_became_active":"2021-02-24T15:16:14.149044+0000","last_became_peered":"2021-02-24T15:16:14.149044+0000","last_unstale":"2021-02-24T15:16:14.150994+0000","last_undegraded":"2021-02-24T15:16:14.150994+0000","last_fullsized":"2021-02-24T15:16:14.150994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.146067+0000","last_change":"2021-02-24T15:16:14.142203+0000","last_active":"2021-02-24T15:16:14.146067+0000","last_peered":"2021-02-24T15:16:14.146067+0000","last_clean":"2021-02-24T15:16:14.146067+0000","last_became_active":"2021-02-24T15:16:14.141603+0000","last_became_peered":"2021-02-24T15:16:14.141603+0000","last_unstale":"2021-02-24T15:16:14.146067+0000","last_undegraded":"2021-02-24T15:16:14.146067+0000","last_fullsized":"2021-02-24T15:16:14.146067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.141135+0000","last_change":"2021-02-24T15:16:14.139802+0000","last_active":"2021-02-24T15:16:14.141135+0000","last_peered":"2021-02-24T15:16:14.141135+0000","last_clean":"2021-02-24T15:16:14.141135+0000","last_became_active":"2021-02-24T15:16:14.139441+0000","last_became_peered":"2021-02-24T15:16:14.139441+0000","last_unstale":"2021-02-24T15:16:14.141135+0000","last_undegraded":"2021-02-24T15:16:14.141135+0000","last_fullsized":"2021-02-24T15:16:14.141135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.138317+0000","last_change":"2021-02-24T15:16:13.177107+0000","last_active":"2021-02-24T15:16:14.138317+0000","last_peered":"2021-02-24T15:16:14.138317+0000","last_clean":"2021-02-24T15:16:14.138317+0000","last_became_active":"2021-02-24T15:16:13.176756+0000","last_became_peered":"2021-02-24T15:16:13.176756+0000","last_unstale":"2021-02-24T15:16:14.138317+0000","last_undegraded":"2021-02-24T15:16:14.138317+0000","last_fullsized":"2021-02-24T15:16:14.138317+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:12.122205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:12.122205+0000","last_clean_scrub_stamp":"2021-02-24T15:16:12.122205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.148549+0000","last_change":"2021-02-24T15:16:14.144094+0000","last_active":"2021-02-24T15:16:14.148549+0000","last_peered":"2021-02-24T15:16:14.148549+0000","last_clean":"2021-02-24T15:16:14.148549+0000","last_became_active":"2021-02-24T15:16:14.143785+0000","last_became_peered":"2021-02-24T15:16:14.143785+0000","last_unstale":"2021-02-24T15:16:14.148549+0000","last_undegraded":"2021-02-24T15:16:14.148549+0000","last_fullsized":"2021-02-24T15:16:14.148549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.140100+0000","last_change":"2021-02-24T15:16:14.138399+0000","last_active":"2021-02-24T15:16:14.140100+0000","last_peered":"2021-02-24T15:16:14.140100+0000","last_clean":"2021-02-24T15:16:14.140100+0000","last_became_active":"2021-02-24T15:16:14.138094+0000","last_became_peered":"2021-02-24T15:16:14.138094+0000","last_unstale":"2021-02-24T15:16:14.140100+0000","last_undegraded":"2021-02-24T15:16:14.140100+0000","last_fullsized":"2021-02-24T15:16:14.140100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.148365+0000","last_change":"2021-02-24T15:16:14.141474+0000","last_active":"2021-02-24T15:16:14.148365+0000","last_peered":"2021-02-24T15:16:14.148365+0000","last_clean":"2021-02-24T15:16:14.148365+0000","last_became_active":"2021-02-24T15:16:14.141185+0000","last_became_peered":"2021-02-24T15:16:14.141185+0000","last_unstale":"2021-02-24T15:16:14.148365+0000","last_undegraded":"2021-02-24T15:16:14.148365+0000","last_fullsized":"2021-02-24T15:16:14.148365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-24T15:16:14.140534+0000","last_change":"2021-02-24T15:16:14.138984+0000","last_active":"2021-02-24T15:16:14.140534+0000","last_peered":"2021-02-24T15:16:14.140534+0000","last_clean":"2021-02-24T15:16:14.140534+0000","last_became_active":"2021-02-24T15:16:14.138636+0000","last_became_peered":"2021-02-24T15:16:14.138636+0000","last_unstale":"2021-02-24T15:16:14.140534+0000","last_undegraded":"2021-02-24T15:16:14.140534+0000","last_fullsized":"2021-02-24T15:16:14.140534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-24T15:16:13.127536+0000","last_clean_scrub_stamp":"2021-02-24T15:16:13.127536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4932,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366908,"statfs":{"total":96636764160,"available":96631713792,"internally_reserved":0,"allocated":126976,"data_stored":37793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4932,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366908,"statfs":{"total":96636764160,"available":96631713792,"internally_reserved":0,"allocated":126976,"data_stored":37752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":38705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]}]}} 2021-02-24T15:16:23.052 INFO:tasks.mon_thrash.ceph_manager:clean! 2021-02-24T15:16:23.053 DEBUG:tasks.mon_thrash:Yielding 2021-02-24T15:16:23.053 INFO:teuthology.run_tasks:Running task workunit... 2021-02-24T15:16:23.091 INFO:tasks.workunit:Pulling workunits from ref c089f21ba7ed78502aadcbf90668ca79817e877e 2021-02-24T15:16:23.092 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-02-24T15:16:23.093 DEBUG:teuthology.orchestra.run.smithi181:> stat -- /home/ubuntu/cephtest/mnt.0 2021-02-24T15:16:23.094 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2021-02-24T15:16:23.094 INFO:tasks.mon_thrash.mon_thrasher:seed: 1614179783, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2021-02-24T15:16:23.094 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:16:23.094 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:16:23.112 INFO:teuthology.orchestra.run.smithi181.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-24T15:16:23.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-24T15:16:23.113 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-02-24T15:16:23.169 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-02-24T15:16:23.170 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-02-24T15:16:23.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.210+0000 7ff26e36e700 1 Processor -- start 2021-02-24T15:16:23.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.210+0000 7ff26e36e700 1 -- start start 2021-02-24T15:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.210+0000 7ff26e36e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff268062660 con 0x7ff2680966a0 2021-02-24T15:16:23.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.210+0000 7ff26e36e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff268063af0 con 0x7ff268095bb0 2021-02-24T15:16:23.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.210+0000 7ff26e36e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff268063d90 con 0x7ff268068410 2021-02-24T15:16:23.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.210+0000 7ff267fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff2680966a0 0x7ff268096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46262/0 (socket says 172.21.15.152:46262) 2021-02-24T15:16:23.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.210+0000 7ff26c90b700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff268068410 0x7ff268133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34742/0 (socket says 172.21.15.152:34742) 2021-02-24T15:16:23.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.210+0000 7ff267fff700 1 -- 172.21.15.152:0/2719292502 learned_addr learned my addr 172.21.15.152:0/2719292502 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:23.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff26c90b700 1 -- 172.21.15.152:0/2719292502 >> v1:172.21.15.152:6790/0 conn(0x7ff268068410 legacy=0x7ff268133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff267fff700 1 -- 172.21.15.152:0/2719292502 >> v1:172.21.15.152:6789/0 conn(0x7ff2680966a0 legacy=0x7ff268096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff2677fe700 1 -- 172.21.15.152:0/2719292502 >> v1:172.21.15.181:6789/0 conn(0x7ff268095bb0 legacy=0x7ff268130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135390955 0 0) 0x7ff268062660 con 0x7ff2680966a0 2021-02-24T15:16:23.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff254003230 con 0x7ff2680966a0 2021-02-24T15:16:23.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202117307 0 0) 0x7ff268063d90 con 0x7ff268068410 2021-02-24T15:16:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff268062660 con 0x7ff268068410 2021-02-24T15:16:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945938751 0 0) 0x7ff268063af0 con 0x7ff268095bb0 2021-02-24T15:16:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff268063d90 con 0x7ff268095bb0 2021-02-24T15:16:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1889066004 0 0) 0x7ff254003230 con 0x7ff2680966a0 2021-02-24T15:16:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 >> v1:172.21.15.152:6790/0 conn(0x7ff268068410 legacy=0x7ff268133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 >> v1:172.21.15.181:6789/0 conn(0x7ff268095bb0 legacy=0x7ff268130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268064030 con 0x7ff2680966a0 2021-02-24T15:16:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff25c001930 con 0x7ff2680966a0 2021-02-24T15:16:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff25c001c50 con 0x7ff2680966a0 2021-02-24T15:16:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.213+0000 7ff266ffd700 1 -- 172.21.15.152:0/2719292502 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff25c004750 con 0x7ff2680966a0 2021-02-24T15:16:23.222 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.214+0000 7ff26e36e700 1 -- 172.21.15.152:0/2719292502 >> v1:172.21.15.152:6789/0 conn(0x7ff2680966a0 legacy=0x7ff268096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.214+0000 7ff26e36e700 1 -- 172.21.15.152:0/2719292502 shutdown_connections 2021-02-24T15:16:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.214+0000 7ff26e36e700 1 -- 172.21.15.152:0/2719292502 >> 172.21.15.152:0/2719292502 conn(0x7ff26809ba40 msgr2=0x7ff26809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.214+0000 7ff26e36e700 1 -- 172.21.15.152:0/2719292502 shutdown_connections 2021-02-24T15:16:23.224 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.214+0000 7ff26e36e700 1 -- 172.21.15.152:0/2719292502 wait complete. 2021-02-24T15:16:23.224 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.214+0000 7ff26e36e700 1 librados: starting msgr at 2021-02-24T15:16:23.224 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.214+0000 7ff26e36e700 1 librados: starting objecter 2021-02-24T15:16:23.224 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.214+0000 7ff26e36e700 1 Processor -- start 2021-02-24T15:16:23.224 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.215+0000 7ff26e36e700 1 -- start start 2021-02-24T15:16:23.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.215+0000 7ff26e36e700 1 librados: setting wanted keys 2021-02-24T15:16:23.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.215+0000 7ff26e36e700 1 librados: calling monclient init 2021-02-24T15:16:23.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.215+0000 7ff26e36e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff268091760 con 0x7ff2680966a0 2021-02-24T15:16:23.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.215+0000 7ff26e36e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26813ef10 con 0x7ff268095bb0 2021-02-24T15:16:23.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.215+0000 7ff26e36e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2680937f0 con 0x7ff268068410 2021-02-24T15:16:23.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.215+0000 7ff26c90b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff2680966a0 0x7ff2681464a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46272/0 (socket says 172.21.15.152:46272) 2021-02-24T15:16:23.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.215+0000 7ff26c90b700 1 -- 172.21.15.152:0/1679693435 learned_addr learned my addr 172.21.15.152:0/1679693435 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:23.232 INFO:tasks.workunit:timeout=3h 2021-02-24T15:16:23.232 INFO:tasks.workunit:cleanup=True 2021-02-24T15:16:23.232 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.217+0000 7ff267fff700 1 -- 172.21.15.152:0/1679693435 >> v1:172.21.15.152:6790/0 conn(0x7ff268068410 legacy=0x7ff26813e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.217+0000 7ff26c90b700 1 -- 172.21.15.152:0/1679693435 >> v1:172.21.15.152:6789/0 conn(0x7ff2680966a0 legacy=0x7ff2681464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.217+0000 7ff24ffff700 10 client.?.objecter ms_handle_connect 0x7ff268068410 2021-02-24T15:16:23.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.217+0000 7ff24ffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:23.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.217+0000 7ff24ffff700 10 client.?.objecter ms_handle_connect 0x7ff2680966a0 2021-02-24T15:16:23.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.217+0000 7ff24ffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:23.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092721803 0 0) 0x7ff2680937f0 con 0x7ff268068410 2021-02-24T15:16:23.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff248004bd0 con 0x7ff268068410 2021-02-24T15:16:23.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223837195 0 0) 0x7ff268091760 con 0x7ff2680966a0 2021-02-24T15:16:23.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2680937f0 con 0x7ff2680966a0 2021-02-24T15:16:23.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 10 client.?.objecter ms_handle_connect 0x7ff268095bb0 2021-02-24T15:16:23.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:23.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff2677fe700 1 -- 172.21.15.152:0/1679693435 >> v1:172.21.15.181:6789/0 conn(0x7ff268095bb0 legacy=0x7ff26813e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2244008843 0 0) 0x7ff2680937f0 con 0x7ff2680966a0 2021-02-24T15:16:23.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff268091760 con 0x7ff2680966a0 2021-02-24T15:16:23.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff260001d10 con 0x7ff2680966a0 2021-02-24T15:16:23.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1570484363 0 0) 0x7ff268091760 con 0x7ff2680966a0 2021-02-24T15:16:23.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 >> v1:172.21.15.152:6790/0 conn(0x7ff268068410 legacy=0x7ff26813e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 >> v1:172.21.15.181:6789/0 conn(0x7ff268095bb0 legacy=0x7ff26813e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268063010 con 0x7ff2680966a0 2021-02-24T15:16:23.237 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2680674a0 con 0x7ff2680966a0 2021-02-24T15:16:23.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff26e36e700 10 client.4377.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:23.238 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2680921e0 con 0x7ff2680966a0 2021-02-24T15:16:23.239 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.218+0000 7ff26e36e700 1 librados: init done 2021-02-24T15:16:23.239 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.219+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2680924d0 con 0x7ff2680966a0 2021-02-24T15:16:23.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.220+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff260004c20 con 0x7ff2680966a0 2021-02-24T15:16:23.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.220+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff260004f30 con 0x7ff2680966a0 2021-02-24T15:16:23.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.220+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff260005110 con 0x7ff2680966a0 2021-02-24T15:16:23.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.221+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7ff26003ac40 con 0x7ff2680966a0 2021-02-24T15:16:23.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.221+0000 7ff24ffff700 10 client.4377.objecter ms_dispatch 0x7ff268001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:23.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.221+0000 7ff24ffff700 3 client.4377.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:23.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.221+0000 7ff24ffff700 3 client.4377.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:23.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.221+0000 7ff24ffff700 20 client.4377.objecter dump_active .. 0 homeless 2021-02-24T15:16:23.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.223+0000 7ff24ffff700 10 client.4377.objecter ms_handle_connect 0x7ff2480314f0 2021-02-24T15:16:23.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.224+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7ff260012a20 con 0x7ff2680966a0 2021-02-24T15:16:23.245 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c089f21ba7ed78502aadcbf90668ca79817e877e 2021-02-24T15:16:23.285 INFO:tasks.workunit.client.0.smithi181.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-02-24T15:16:23.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.459+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff268058400 con 0x7ff2680966a0 2021-02-24T15:16:23.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.460+0000 7ff24ffff700 1 -- 172.21.15.152:0/1679693435 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 2738988176) 0x7ff260012610 con 0x7ff2680966a0 2021-02-24T15:16:23.461 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:16:23.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.461+0000 7ff26e36e700 10 librados: watch_flush enter 2021-02-24T15:16:23.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.461+0000 7ff26e36e700 10 librados: watch_flush exit 2021-02-24T15:16:23.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.461+0000 7ff26e36e700 20 client.4377.objecter shutdown clearing up homeless session... 2021-02-24T15:16:23.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.461+0000 7ff26e36e700 10 client.4377.objecter successfully canceled tick 2021-02-24T15:16:23.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.461+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 >> v1:172.21.15.181:6812/33484 conn(0x7ff2480314f0 legacy=0x7ff2480339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.461+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 >> v1:172.21.15.152:6789/0 conn(0x7ff2680966a0 legacy=0x7ff2681464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.461+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 shutdown_connections 2021-02-24T15:16:23.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.461+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 >> 172.21.15.152:0/1679693435 conn(0x7ff26809ba40 msgr2=0x7ff26809a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:23.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.462+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 shutdown_connections 2021-02-24T15:16:23.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.462+0000 7ff26e36e700 1 -- 172.21.15.152:0/1679693435 wait complete. 2021-02-24T15:16:23.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.462+0000 7ff26e36e700 1 librados: shutdown 2021-02-24T15:16:23.476 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:16:23.476 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-02-24T15:16:23.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:16:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.593+0000 7f52e1a14700 1 Processor -- start 2021-02-24T15:16:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.593+0000 7f52e1a14700 1 -- start start 2021-02-24T15:16:23.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.594+0000 7f52e1a14700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc097d40 con 0x7f52dc099340 2021-02-24T15:16:23.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.594+0000 7f52e1a14700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc063d00 con 0x7f52dc062da0 2021-02-24T15:16:23.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.594+0000 7f52e1a14700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc097980 con 0x7f52dc063220 2021-02-24T15:16:23.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.594+0000 7f52db7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f52dc063220 0x7f52dc133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34752/0 (socket says 172.21.15.152:34752) 2021-02-24T15:16:23.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.594+0000 7f52db7fe700 1 -- 172.21.15.152:0/2494657487 learned_addr learned my addr 172.21.15.152:0/2494657487 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52db7fe700 1 -- 172.21.15.152:0/2494657487 >> v1:172.21.15.152:6790/0 conn(0x7f52dc063220 legacy=0x7f52dc133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52daffd700 1 -- 172.21.15.152:0/2494657487 >> v1:172.21.15.152:6789/0 conn(0x7f52dc099340 legacy=0x7f52dc097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096691112 0 0) 0x7f52dc097980 con 0x7f52dc063220 2021-02-24T15:16:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c8003230 con 0x7f52dc063220 2021-02-24T15:16:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055256406 0 0) 0x7f52dc097d40 con 0x7f52dc099340 2021-02-24T15:16:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52dc097980 con 0x7f52dc099340 2021-02-24T15:16:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52da7fc700 1 -- 172.21.15.152:0/2494657487 >> v1:172.21.15.181:6789/0 conn(0x7f52dc062da0 legacy=0x7f52dc12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4019227475 0 0) 0x7f52c8003230 con 0x7f52dc063220 2021-02-24T15:16:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 >> v1:172.21.15.181:6789/0 conn(0x7f52dc062da0 legacy=0x7f52dc12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 >> v1:172.21.15.152:6789/0 conn(0x7f52dc099340 legacy=0x7f52dc097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc08fac0 con 0x7f52dc063220 2021-02-24T15:16:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52d4001d70 con 0x7f52dc063220 2021-02-24T15:16:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52db7fe700 1 --1- 172.21.15.152:0/2494657487 >> v1:172.21.15.152:6790/0 conn(0x7f52dc063220 0x7f52dc133440 :-1 s=OPENED pgs=121 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f52d4004ad0 mon_map magic: 0 v1 2021-02-24T15:16:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.596+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f52d4001fe0 con 0x7f52dc063220 2021-02-24T15:16:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.597+0000 7f52e1a14700 1 -- 172.21.15.152:0/2494657487 >> v1:172.21.15.152:6790/0 conn(0x7f52dc063220 legacy=0x7f52dc133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.597+0000 7f52d9ffb700 1 -- 172.21.15.152:0/2494657487 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52d4004ad0 con 0x7f52dc063220 2021-02-24T15:16:23.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.597+0000 7f52e1a14700 1 -- 172.21.15.152:0/2494657487 shutdown_connections 2021-02-24T15:16:23.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.597+0000 7f52e1a14700 1 -- 172.21.15.152:0/2494657487 >> 172.21.15.152:0/2494657487 conn(0x7f52dc09dcc0 msgr2=0x7f52dc09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:23.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.597+0000 7f52e1a14700 1 -- 172.21.15.152:0/2494657487 shutdown_connections 2021-02-24T15:16:23.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.597+0000 7f52e1a14700 1 -- 172.21.15.152:0/2494657487 wait complete. 2021-02-24T15:16:23.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52e1a14700 1 librados: starting msgr at 2021-02-24T15:16:23.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52e1a14700 1 librados: starting objecter 2021-02-24T15:16:23.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52e1a14700 1 Processor -- start 2021-02-24T15:16:23.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52e1a14700 1 -- start start 2021-02-24T15:16:23.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52e1a14700 1 librados: setting wanted keys 2021-02-24T15:16:23.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52e1a14700 1 librados: calling monclient init 2021-02-24T15:16:23.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52e1a14700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc095920 con 0x7f52dc063220 2021-02-24T15:16:23.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52e1a14700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc093d60 con 0x7f52dc099340 2021-02-24T15:16:23.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52e1a14700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc095b90 con 0x7f52dc062da0 2021-02-24T15:16:23.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.598+0000 7f52daffd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f52dc062da0 0x7f52dc133780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34758/0 (socket says 172.21.15.152:34758) 2021-02-24T15:16:23.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.599+0000 7f52daffd700 1 -- 172.21.15.152:0/4169660894 learned_addr learned my addr 172.21.15.152:0/4169660894 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:23.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.599+0000 7f52da7fc700 1 --1- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6789/0 conn(0x7f52dc063220 0x7f52dc133e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46280/0 (socket says 172.21.15.152:46280) 2021-02-24T15:16:23.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52daffd700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6790/0 conn(0x7f52dc062da0 legacy=0x7f52dc133780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52da7fc700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6789/0 conn(0x7f52dc063220 legacy=0x7f52dc133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 10 client.?.objecter ms_handle_connect 0x7f52dc062da0 2021-02-24T15:16:23.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:23.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 10 client.?.objecter ms_handle_connect 0x7f52dc063220 2021-02-24T15:16:23.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:23.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662565392 0 0) 0x7f52dc095b90 con 0x7f52dc062da0 2021-02-24T15:16:23.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc004bd0 con 0x7f52dc062da0 2021-02-24T15:16:23.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798187303 0 0) 0x7f52dc095920 con 0x7f52dc063220 2021-02-24T15:16:23.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52dc095b90 con 0x7f52dc063220 2021-02-24T15:16:23.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 10 client.?.objecter ms_handle_connect 0x7f52dc099340 2021-02-24T15:16:23.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:23.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52db7fe700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.181:6789/0 conn(0x7f52dc099340 legacy=0x7f52dc142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2809138040 0 0) 0x7f52bc004bd0 con 0x7f52dc062da0 2021-02-24T15:16:23.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52dc095920 con 0x7f52dc062da0 2021-02-24T15:16:23.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52d0001c30 con 0x7f52dc062da0 2021-02-24T15:16:23.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3227866168 0 0) 0x7f52dc095b90 con 0x7f52dc063220 2021-02-24T15:16:23.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52bc004bd0 con 0x7f52dc063220 2021-02-24T15:16:23.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52cc001b60 con 0x7f52dc063220 2021-02-24T15:16:23.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677080181 0 0) 0x7f52dc093d60 con 0x7f52dc099340 2021-02-24T15:16:23.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52dc095b90 con 0x7f52dc099340 2021-02-24T15:16:23.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1691931989 0 0) 0x7f52dc095920 con 0x7f52dc062da0 2021-02-24T15:16:23.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.181:6789/0 conn(0x7f52dc099340 legacy=0x7f52dc142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6789/0 conn(0x7f52dc063220 legacy=0x7f52dc133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc095e30 con 0x7f52dc062da0 2021-02-24T15:16:23.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc0948a0 con 0x7f52dc062da0 2021-02-24T15:16:23.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52e1a14700 10 client.4376.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:23.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc0934a0 con 0x7f52dc062da0 2021-02-24T15:16:23.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52e1a14700 1 librados: init done 2021-02-24T15:16:23.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f52d00022f0 con 0x7f52dc062da0 2021-02-24T15:16:23.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.601+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52d0002600 con 0x7f52dc062da0 2021-02-24T15:16:23.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.602+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f52b4006550 con 0x7f52b40027f0 2021-02-24T15:16:23.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.602+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f52d00027e0 con 0x7f52dc062da0 2021-02-24T15:16:23.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.602+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f52d003a9c0 con 0x7f52dc062da0 2021-02-24T15:16:23.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.602+0000 7f52c2ffd700 10 client.4376.objecter ms_dispatch 0x7f52dc001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:23.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.602+0000 7f52c2ffd700 3 client.4376.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:23.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.602+0000 7f52c2ffd700 3 client.4376.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:23.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.602+0000 7f52c2ffd700 20 client.4376.objecter dump_active .. 0 homeless 2021-02-24T15:16:23.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.604+0000 7f52c2ffd700 10 client.4376.objecter ms_handle_connect 0x7f52b40027f0 2021-02-24T15:16:23.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.604+0000 7f52c2ffd700 10 client.4376.objecter resend_mon_ops 2021-02-24T15:16:23.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.604+0000 7f52da7fc700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6789/0 conn(0x7f52b40027f0 legacy=0x7f52b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.604+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040945899 0 0) 0x7f52b4006550 con 0x7f52b40027f0 2021-02-24T15:16:23.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.604+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52dc095920 con 0x7f52b40027f0 2021-02-24T15:16:23.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.605+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3307497102 0 0) 0x7f52dc095920 con 0x7f52b40027f0 2021-02-24T15:16:23.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.605+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52b4006550 con 0x7f52b40027f0 2021-02-24T15:16:23.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.605+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52cc0025b0 con 0x7f52b40027f0 2021-02-24T15:16:23.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.605+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3975059075 0 0) 0x7f52b4006550 con 0x7f52b40027f0 2021-02-24T15:16:23.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.605+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52b4009df0 con 0x7f52b40027f0 2021-02-24T15:16:23.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.605+0000 7f52c2ffd700 10 client.4376.objecter ms_handle_connect 0x7f52bc031810 2021-02-24T15:16:23.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.605+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f52cc002940 con 0x7f52b40027f0 2021-02-24T15:16:23.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.605+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6789/0 conn(0x7f52b40027f0 legacy=0x7f52b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.605+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6789/0 conn(0x7f52b40027f0 legacy=0x7f52b4004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:23.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.613+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f52b4007520 con 0x7f52b40068c0 2021-02-24T15:16:23.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.615+0000 7f52c2ffd700 10 client.4376.objecter ms_handle_connect 0x7f52b40068c0 2021-02-24T15:16:23.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.615+0000 7f52da7fc700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6789/0 conn(0x7f52b40068c0 legacy=0x7f52b4006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.615+0000 7f52c2ffd700 10 client.4376.objecter resend_mon_ops 2021-02-24T15:16:23.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.615+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127136398 0 0) 0x7f52b4007520 con 0x7f52b40068c0 2021-02-24T15:16:23.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.615+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b4006550 con 0x7f52b40068c0 2021-02-24T15:16:23.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1593659346 0 0) 0x7f52b4006550 con 0x7f52b40068c0 2021-02-24T15:16:23.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52b4007520 con 0x7f52b40068c0 2021-02-24T15:16:23.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52cc005670 con 0x7f52b40068c0 2021-02-24T15:16:23.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1044742222 0 0) 0x7f52b4007520 con 0x7f52b40068c0 2021-02-24T15:16:23.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f52b4008720 con 0x7f52b40068c0 2021-02-24T15:16:23.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3942 (unknown 0 0 962195866) 0x7f52cc0078d0 con 0x7f52b40068c0 2021-02-24T15:16:23.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6789/0 conn(0x7f52b40068c0 legacy=0x7f52b4006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52c2ffd700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6789/0 conn(0x7f52b40068c0 legacy=0x7f52b4006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:23.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52e1a14700 10 librados: watch_flush enter 2021-02-24T15:16:23.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52e1a14700 10 librados: watch_flush exit 2021-02-24T15:16:23.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52e1a14700 20 client.4376.objecter shutdown clearing up homeless session... 2021-02-24T15:16:23.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52e1a14700 10 client.4376.objecter successfully canceled tick 2021-02-24T15:16:23.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.181:6812/33484 conn(0x7f52bc031810 legacy=0x7f52bc033cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 >> v1:172.21.15.152:6790/0 conn(0x7f52dc062da0 legacy=0x7f52dc133780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52db7fe700 1 -- 172.21.15.152:0/4169660894 reap_dead start 2021-02-24T15:16:23.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52db7fe700 1 -- 172.21.15.152:0/4169660894 reap_dead start 2021-02-24T15:16:23.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 shutdown_connections 2021-02-24T15:16:23.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.616+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 >> 172.21.15.152:0/4169660894 conn(0x7f52dc09dcc0 msgr2=0x7f52dc09c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:23.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.617+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 shutdown_connections 2021-02-24T15:16:23.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.617+0000 7f52e1a14700 1 -- 172.21.15.152:0/4169660894 wait complete. 2021-02-24T15:16:23.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.617+0000 7f52e1a14700 1 librados: shutdown 2021-02-24T15:16:23.643 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:16:23.643 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:16:23.643 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:16:23.643 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:16:23.643 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 8, 2021-02-24T15:16:23.644 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:16:23.644 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:16:23.644 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:16:23.644 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:16:23.645 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.645 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 21, 2021-02-24T15:16:23.645 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:23.645 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:16:23.645 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:16:23.646 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:23.646 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:23.646 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:23.646 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:23.647 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:23.647 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:23.647 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:23.647 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:23.648 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:23.648 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.648 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:16:23.648 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:16:23.649 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:23.649 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:23.649 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:23.649 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:23.649 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:23.650 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:23.650 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:23.650 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:23.650 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:23.651 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.651 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:16:23.652 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:16:23.652 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:16:23.653 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:16:23.653 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:16:23.653 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:16:23.654 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:23.654 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:23.655 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:16:23.655 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:16:23.656 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:16:23.656 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:16:23.657 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:16:23.657 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:23.658 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:16:23.658 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:23.658 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:23.658 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:23.658 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:23.659 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:23.659 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:23.659 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:23.659 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:23.659 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:23.660 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.660 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:16:23.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.660 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:16:23.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.661 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:16:23.661 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:16:23.662 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:23.662 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:23.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.662 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:23.662 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:16:23.663 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:23.663 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.663 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.663 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:16:23.664 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:16:23.664 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:23.664 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:23.664 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:23.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.665 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:16:23.666 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:16:23.666 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:23.666 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:23.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.667 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:23.668 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:16:23.668 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:23.668 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.668 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.669 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:16:23.669 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:16:23.669 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:23.669 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:23.669 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:23.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.670 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:16:23.670 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:16:23.671 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:23.671 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:23.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.671 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:23.671 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:16:23.672 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:23.672 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.672 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.672 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:16:23.673 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:16:23.673 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:23.673 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:23.673 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:23.674 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.674 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.674 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:16:23.674 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:16:23.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.675 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:23.675 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:23.676 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:23.676 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.676 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.676 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:16:23.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.677 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:23.677 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:23.678 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:23.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.678 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.679 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:16:23.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.679 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:23.679 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:23.680 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:23.680 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.680 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.680 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:16:23.681 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:16:23.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:16:23.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.798+0000 7f76088af700 1 Processor -- start 2021-02-24T15:16:23.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.798+0000 7f76088af700 1 -- start start 2021-02-24T15:16:23.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.798+0000 7f76088af700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7604062660 con 0x7f7604068410 2021-02-24T15:16:23.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.798+0000 7f76088af700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7604063af0 con 0x7f76040966a0 2021-02-24T15:16:23.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.798+0000 7f76088af700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7604063d90 con 0x7f7604095bb0 2021-02-24T15:16:23.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.799+0000 7f7601d9b700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f7604095bb0 0x7f7604130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34768/0 (socket says 172.21.15.152:34768) 2021-02-24T15:16:23.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.799+0000 7f7602d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7604068410 0x7f7604133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46296/0 (socket says 172.21.15.152:46296) 2021-02-24T15:16:23.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.799+0000 7f7601d9b700 1 -- 172.21.15.152:0/73711129 learned_addr learned my addr 172.21.15.152:0/73711129 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f7601d9b700 1 -- 172.21.15.152:0/73711129 >> v1:172.21.15.152:6790/0 conn(0x7f7604095bb0 legacy=0x7f7604130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f7602d9d700 1 -- 172.21.15.152:0/73711129 >> v1:172.21.15.152:6789/0 conn(0x7f7604068410 legacy=0x7f7604133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183097722 0 0) 0x7f7604063d90 con 0x7f7604095bb0 2021-02-24T15:16:23.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e4003230 con 0x7f7604095bb0 2021-02-24T15:16:23.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899324466 0 0) 0x7f7604062660 con 0x7f7604068410 2021-02-24T15:16:23.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7604063d90 con 0x7f7604068410 2021-02-24T15:16:23.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760259c700 1 -- 172.21.15.152:0/73711129 >> v1:172.21.15.181:6789/0 conn(0x7f76040966a0 legacy=0x7f7604096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2078011413 0 0) 0x7f7604063d90 con 0x7f7604068410 2021-02-24T15:16:23.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 >> v1:172.21.15.152:6790/0 conn(0x7f7604095bb0 legacy=0x7f7604130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 >> v1:172.21.15.181:6789/0 conn(0x7f76040966a0 legacy=0x7f7604096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604064030 con 0x7f7604068410 2021-02-24T15:16:23.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75fc001d70 con 0x7f7604068410 2021-02-24T15:16:23.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f75fc002050 con 0x7f7604068410 2021-02-24T15:16:23.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.801+0000 7f760159a700 1 -- 172.21.15.152:0/73711129 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75fc004a10 con 0x7f7604068410 2021-02-24T15:16:23.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.802+0000 7f76088af700 1 -- 172.21.15.152:0/73711129 >> v1:172.21.15.152:6789/0 conn(0x7f7604068410 legacy=0x7f7604133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.802+0000 7f76088af700 1 -- 172.21.15.152:0/73711129 shutdown_connections 2021-02-24T15:16:23.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.802+0000 7f76088af700 1 -- 172.21.15.152:0/73711129 >> 172.21.15.152:0/73711129 conn(0x7f760409ba40 msgr2=0x7f760409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:23.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.802+0000 7f76088af700 1 -- 172.21.15.152:0/73711129 shutdown_connections 2021-02-24T15:16:23.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.802+0000 7f76088af700 1 -- 172.21.15.152:0/73711129 wait complete. 2021-02-24T15:16:23.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f76088af700 1 librados: starting msgr at 2021-02-24T15:16:23.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f76088af700 1 librados: starting objecter 2021-02-24T15:16:23.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f76088af700 1 Processor -- start 2021-02-24T15:16:23.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f76088af700 1 -- start start 2021-02-24T15:16:23.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f76088af700 1 librados: setting wanted keys 2021-02-24T15:16:23.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f76088af700 1 librados: calling monclient init 2021-02-24T15:16:23.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f76088af700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7604063010 con 0x7f7604095bb0 2021-02-24T15:16:23.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f76088af700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760411ab10 con 0x7f7604068410 2021-02-24T15:16:23.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f76088af700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7604067350 con 0x7f76040966a0 2021-02-24T15:16:23.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f7601d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7604095bb0 0x7f7604133c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46300/0 (socket says 172.21.15.152:46300) 2021-02-24T15:16:23.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.803+0000 7f7601d9b700 1 -- 172.21.15.152:0/3482787562 learned_addr learned my addr 172.21.15.152:0/3482787562 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:23.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.805+0000 7f7602d9d700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f76040966a0 legacy=0x7f7604142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.805+0000 7f75fa7fc700 10 client.?.objecter ms_handle_connect 0x7f76040966a0 2021-02-24T15:16:23.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.805+0000 7f75fa7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:23.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.805+0000 7f7601d9b700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6789/0 conn(0x7f7604095bb0 legacy=0x7f7604133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.805+0000 7f75fa7fc700 10 client.?.objecter ms_handle_connect 0x7f7604095bb0 2021-02-24T15:16:23.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.805+0000 7f75fa7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:23.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.805+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893732981 0 0) 0x7f7604067350 con 0x7f76040966a0 2021-02-24T15:16:23.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.805+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e8004bd0 con 0x7f76040966a0 2021-02-24T15:16:23.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.805+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123124735 0 0) 0x7f7604063010 con 0x7f7604095bb0 2021-02-24T15:16:23.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7604067350 con 0x7f7604095bb0 2021-02-24T15:16:23.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 10 client.?.objecter ms_handle_connect 0x7f7604068410 2021-02-24T15:16:23.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f760259c700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.181:6789/0 conn(0x7f7604068410 legacy=0x7f760413a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:23.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2877027364 0 0) 0x7f75e8004bd0 con 0x7f76040966a0 2021-02-24T15:16:23.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7604063010 con 0x7f76040966a0 2021-02-24T15:16:23.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75fc004a10 con 0x7f76040966a0 2021-02-24T15:16:23.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1754078954 0 0) 0x7f7604067350 con 0x7f7604095bb0 2021-02-24T15:16:23.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75e8004bd0 con 0x7f7604095bb0 2021-02-24T15:16:23.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014652247 0 0) 0x7f760411ab10 con 0x7f7604068410 2021-02-24T15:16:23.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7604067350 con 0x7f7604068410 2021-02-24T15:16:23.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75ec001bb0 con 0x7f7604095bb0 2021-02-24T15:16:23.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 6656383 0 0) 0x7f7604063010 con 0x7f76040966a0 2021-02-24T15:16:23.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.181:6789/0 conn(0x7f7604068410 legacy=0x7f760413a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6789/0 conn(0x7f7604095bb0 legacy=0x7f7604133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604134310 con 0x7f76040966a0 2021-02-24T15:16:23.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760411a110 con 0x7f76040966a0 2021-02-24T15:16:23.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f76088af700 10 client.4382.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:23.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7604118ad0 con 0x7f76040966a0 2021-02-24T15:16:23.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f76088af700 1 librados: init done 2021-02-24T15:16:23.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f75fc0018e0 con 0x7f76040966a0 2021-02-24T15:16:23.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.806+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75fc0052d0 con 0x7f76040966a0 2021-02-24T15:16:23.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.807+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f75fc00ddd0 con 0x7f76040966a0 2021-02-24T15:16:23.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.807+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f75dc006550 con 0x7f75dc0027f0 2021-02-24T15:16:23.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.807+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f75fc03ae10 con 0x7f76040966a0 2021-02-24T15:16:23.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.807+0000 7f75fa7fc700 10 client.4382.objecter ms_dispatch 0x7f7604001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:23.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.807+0000 7f75fa7fc700 3 client.4382.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:23.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.807+0000 7f75fa7fc700 3 client.4382.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:23.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.807+0000 7f75fa7fc700 20 client.4382.objecter dump_active .. 0 homeless 2021-02-24T15:16:23.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.809+0000 7f760259c700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0027f0 legacy=0x7f75dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.809+0000 7f75fa7fc700 10 client.4382.objecter ms_handle_connect 0x7f75dc0027f0 2021-02-24T15:16:23.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.809+0000 7f75fa7fc700 10 client.4382.objecter resend_mon_ops 2021-02-24T15:16:23.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.809+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158366293 0 0) 0x7f75dc006550 con 0x7f75dc0027f0 2021-02-24T15:16:23.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.809+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7604063010 con 0x7f75dc0027f0 2021-02-24T15:16:23.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.809+0000 7f75fa7fc700 10 client.4382.objecter ms_handle_connect 0x7f75e8031680 2021-02-24T15:16:23.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.809+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2990230326 0 0) 0x7f7604063010 con 0x7f75dc0027f0 2021-02-24T15:16:23.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.809+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75dc006550 con 0x7f75dc0027f0 2021-02-24T15:16:23.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.809+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75f4001a30 con 0x7f75dc0027f0 2021-02-24T15:16:23.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.810+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2381487890 0 0) 0x7f75dc006550 con 0x7f75dc0027f0 2021-02-24T15:16:23.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.810+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75dc009df0 con 0x7f75dc0027f0 2021-02-24T15:16:23.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.810+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f75f40054d0 con 0x7f75dc0027f0 2021-02-24T15:16:23.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.810+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0027f0 legacy=0x7f75dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.810+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0027f0 legacy=0x7f75dc004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:23.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.818+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f75dc007500 con 0x7f75dc0068a0 2021-02-24T15:16:23.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f760259c700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0068a0 legacy=0x7f75dc006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 10 client.4382.objecter ms_handle_connect 0x7f75dc0068a0 2021-02-24T15:16:23.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 10 client.4382.objecter resend_mon_ops 2021-02-24T15:16:23.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488593843 0 0) 0x7f75dc007500 con 0x7f75dc0068a0 2021-02-24T15:16:23.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75dc006550 con 0x7f75dc0068a0 2021-02-24T15:16:23.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 312751919 0 0) 0x7f75dc006550 con 0x7f75dc0068a0 2021-02-24T15:16:23.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75dc007500 con 0x7f75dc0068a0 2021-02-24T15:16:23.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75f4002300 con 0x7f75dc0068a0 2021-02-24T15:16:23.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f760259c700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0068a0 legacy=0x7f75dc006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-24T15:16:23.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f760259c700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0068a0 legacy=0x7f75dc006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:16:23.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f760259c700 1 --1- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0068a0 0x7f75dc006d30 :-1 s=OPENED pgs=126 cs=1 l=1).handle_message read tag failed 2021-02-24T15:16:23.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f760259c700 1 --1- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0068a0 0x7f75dc006d30 :-1 s=OPENED pgs=126 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:16:23.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0068a0 legacy=0x7f75dc006d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:23.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75dc0068a0 legacy=0x7f75dc006d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:23.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.820+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f75dc006550 con 0x7f75e8039400 2021-02-24T15:16:23.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.822+0000 7f760259c700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75e8039400 legacy=0x7f75e8037e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:23.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 10 client.4382.objecter ms_handle_connect 0x7f75e8039400 2021-02-24T15:16:23.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 10 client.4382.objecter resend_mon_ops 2021-02-24T15:16:23.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810689848 0 0) 0x7f75dc006550 con 0x7f75e8039400 2021-02-24T15:16:23.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7604063010 con 0x7f75e8039400 2021-02-24T15:16:23.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 773125751 0 0) 0x7f7604063010 con 0x7f75e8039400 2021-02-24T15:16:23.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75dc006550 con 0x7f75e8039400 2021-02-24T15:16:23.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75f40029e0 con 0x7f75e8039400 2021-02-24T15:16:23.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 200960669 0 0) 0x7f75dc006550 con 0x7f75e8039400 2021-02-24T15:16:23.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f75f40054d0 con 0x7f75e8039400 2021-02-24T15:16:23.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3940 (unknown 0 0 231036624) 0x7f75f4002bd0 con 0x7f75e8039400 2021-02-24T15:16:23.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75e8039400 legacy=0x7f75e8037e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f75fa7fc700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f75e8039400 legacy=0x7f75e8037e90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:23.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f7602d9d700 1 -- 172.21.15.152:0/3482787562 reap_dead start 2021-02-24T15:16:23.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.823+0000 7f76088af700 10 librados: watch_flush enter 2021-02-24T15:16:23.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 10 librados: watch_flush exit 2021-02-24T15:16:23.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 20 client.4382.objecter shutdown clearing up homeless session... 2021-02-24T15:16:23.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 10 client.4382.objecter successfully canceled tick 2021-02-24T15:16:23.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.181:6812/33484 conn(0x7f75e8031680 legacy=0x7f75e8033b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 >> v1:172.21.15.152:6790/0 conn(0x7f76040966a0 legacy=0x7f7604142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:23.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 shutdown_connections 2021-02-24T15:16:23.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 >> 172.21.15.152:0/3482787562 conn(0x7f760409ba40 msgr2=0x7f76041120a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:23.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 shutdown_connections 2021-02-24T15:16:23.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 1 -- 172.21.15.152:0/3482787562 wait complete. 2021-02-24T15:16:23.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.824+0000 7f76088af700 1 librados: shutdown 2021-02-24T15:16:23.848 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:16:23.848 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:16:23.849 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:16:23.849 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:16:23.849 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 8, 2021-02-24T15:16:23.849 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:16:23.849 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:16:23.850 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:16:23.850 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:16:23.850 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.850 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 21, 2021-02-24T15:16:23.851 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:23.851 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:16:23.851 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:16:23.851 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:23.851 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:23.852 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:23.852 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:23.852 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:23.852 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:23.852 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:23.853 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:23.853 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:23.853 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.853 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:16:23.853 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:16:23.854 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:23.854 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:23.854 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:23.854 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:23.855 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:23.855 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:23.855 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:23.855 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:23.855 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:23.856 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.856 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:16:23.856 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:16:23.856 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:16:23.857 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:16:23.857 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:16:23.857 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:16:23.857 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:23.858 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:23.858 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:16:23.858 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:16:23.858 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:16:23.858 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:16:23.859 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:16:23.859 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:23.859 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:16:23.859 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:23.859 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:23.860 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:23.860 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:23.860 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:23.860 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:23.861 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:23.861 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:23.861 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:23.861 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.861 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:16:23.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.862 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:16:23.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.862 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:16:23.862 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:16:23.863 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:23.863 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:23.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.863 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:23.863 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:16:23.864 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:23.864 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.864 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.865 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:16:23.865 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:16:23.865 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:23.865 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:23.865 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:23.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.866 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:16:23.866 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:16:23.866 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:23.867 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:23.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.867 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:23.867 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:16:23.867 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:23.868 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.868 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.868 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:16:23.868 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:16:23.869 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:23.869 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:23.869 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:23.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.870 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:16:23.870 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:16:23.870 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:23.870 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:23.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.871 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:23.871 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:16:23.871 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:23.872 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.872 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.872 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:16:23.873 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:16:23.873 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:23.873 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:23.873 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:23.873 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.874 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.875 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:16:23.875 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:16:23.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.875 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:23.876 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:23.876 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:23.876 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.876 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.877 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:16:23.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.877 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:23.877 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:23.877 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:16:23.878 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.878 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:23.878 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:16:23.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:23.878 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:23.879 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:23.879 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:16:23.879 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:23.879 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:23.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:23.880 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:16:23.880 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:16:23.880 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:16:24.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.997+0000 7ff9af2ac700 1 Processor -- start 2021-02-24T15:16:24.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.997+0000 7ff9af2ac700 1 -- start start 2021-02-24T15:16:24.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.998+0000 7ff9af2ac700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a80670e0 con 0x7ff9a8065150 2021-02-24T15:16:24.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.998+0000 7ff9af2ac700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a8067380 con 0x7ff9a8067eb0 2021-02-24T15:16:24.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.998+0000 7ff9af2ac700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a8067620 con 0x7ff9a8064660 2021-02-24T15:16:24.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.998+0000 7ff9ae2aa700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff9a8064660 0x7ff9a8064a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34788/0 (socket says 172.21.15.152:34788) 2021-02-24T15:16:24.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:23.998+0000 7ff9ae2aa700 1 -- 172.21.15.152:0/2854919684 learned_addr learned my addr 172.21.15.152:0/2854919684 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:24.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.000+0000 7ff9adaa9700 1 -- 172.21.15.152:0/2854919684 >> v1:172.21.15.152:6789/0 conn(0x7ff9a8065150 legacy=0x7ff9a812c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:24.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.000+0000 7ff9ae2aa700 1 -- 172.21.15.152:0/2854919684 >> v1:172.21.15.152:6790/0 conn(0x7ff9a8064660 legacy=0x7ff9a8064a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:24.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.000+0000 7ff9aeaab700 1 -- 172.21.15.152:0/2854919684 >> v1:172.21.15.181:6789/0 conn(0x7ff9a8067eb0 legacy=0x7ff9a81300f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:24.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.000+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197380391 0 0) 0x7ff9a80670e0 con 0x7ff9a8065150 2021-02-24T15:16:24.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.000+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff990003230 con 0x7ff9a8065150 2021-02-24T15:16:24.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.000+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983908406 0 0) 0x7ff9a8067620 con 0x7ff9a8064660 2021-02-24T15:16:24.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.000+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a80670e0 con 0x7ff9a8064660 2021-02-24T15:16:24.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803871523 0 0) 0x7ff9a8067380 con 0x7ff9a8067eb0 2021-02-24T15:16:24.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a8067620 con 0x7ff9a8067eb0 2021-02-24T15:16:24.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 272653894 0 0) 0x7ff9a80670e0 con 0x7ff9a8064660 2021-02-24T15:16:24.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 >> v1:172.21.15.181:6789/0 conn(0x7ff9a8067eb0 legacy=0x7ff9a81300f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:24.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 >> v1:172.21.15.152:6789/0 conn(0x7ff9a8065150 legacy=0x7ff9a812c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:24.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a8062950 con 0x7ff9a8064660 2021-02-24T15:16:24.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff9a40019f0 con 0x7ff9a8064660 2021-02-24T15:16:24.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff9a4001cd0 con 0x7ff9a8064660 2021-02-24T15:16:24.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9ad2a8700 1 -- 172.21.15.152:0/2854919684 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff9a4004750 con 0x7ff9a8064660 2021-02-24T15:16:24.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9af2ac700 1 -- 172.21.15.152:0/2854919684 >> v1:172.21.15.152:6790/0 conn(0x7ff9a8064660 legacy=0x7ff9a8064a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:24.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9af2ac700 1 -- 172.21.15.152:0/2854919684 shutdown_connections 2021-02-24T15:16:24.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9af2ac700 1 -- 172.21.15.152:0/2854919684 >> 172.21.15.152:0/2854919684 conn(0x7ff9a8099650 msgr2=0x7ff9a8099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:24.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9af2ac700 1 -- 172.21.15.152:0/2854919684 shutdown_connections 2021-02-24T15:16:24.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.001+0000 7ff9af2ac700 1 -- 172.21.15.152:0/2854919684 wait complete. 2021-02-24T15:16:24.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.002+0000 7ff9af2ac700 1 librados: starting msgr at 2021-02-24T15:16:24.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.002+0000 7ff9af2ac700 1 librados: starting objecter 2021-02-24T15:16:24.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.002+0000 7ff9af2ac700 1 Processor -- start 2021-02-24T15:16:24.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.002+0000 7ff9af2ac700 1 -- start start 2021-02-24T15:16:24.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.002+0000 7ff9af2ac700 1 librados: setting wanted keys 2021-02-24T15:16:24.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.002+0000 7ff9af2ac700 1 librados: calling monclient init 2021-02-24T15:16:24.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.003+0000 7ff9af2ac700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a80663c0 con 0x7ff9a8065150 2021-02-24T15:16:24.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.003+0000 7ff9af2ac700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a8114f60 con 0x7ff9a8067eb0 2021-02-24T15:16:24.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.003+0000 7ff9af2ac700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a8115200 con 0x7ff9a8064660 2021-02-24T15:16:24.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.003+0000 7ff9ae2aa700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff9a8064660 0x7ff9a8120fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34794/0 (socket says 172.21.15.152:34794) 2021-02-24T15:16:24.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.003+0000 7ff9ae2aa700 1 -- 172.21.15.152:0/720872935 learned_addr learned my addr 172.21.15.152:0/720872935 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:24.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.003+0000 7ff9ae2aa700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.152:6790/0 conn(0x7ff9a8064660 legacy=0x7ff9a8120fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-24T15:16:24.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.003+0000 7ff9ae2aa700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.152:6790/0 conn(0x7ff9a8064660 legacy=0x7ff9a8120fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:16:24.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.003+0000 7ff9ae2aa700 1 --1- 172.21.15.152:0/720872935 >> v1:172.21.15.152:6790/0 conn(0x7ff9a8064660 0x7ff9a8120fd0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-02-24T15:16:24.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.003+0000 7ff9ae2aa700 1 --1- 172.21.15.152:0/720872935 >> v1:172.21.15.152:6790/0 conn(0x7ff9a8064660 0x7ff9a8120fd0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-02-24T15:16:24.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9adaa9700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.152:6789/0 conn(0x7ff9a8065150 legacy=0x7ff9a81216e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:24.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 10 client.?.objecter ms_handle_connect 0x7ff9a8065150 2021-02-24T15:16:24.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:24.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697104364 0 0) 0x7ff9a80663c0 con 0x7ff9a8065150 2021-02-24T15:16:24.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9aeaab700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.181:6789/0 conn(0x7ff9a8067eb0 legacy=0x7ff9a81428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:24.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff988004bd0 con 0x7ff9a8065150 2021-02-24T15:16:24.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 10 client.?.objecter ms_handle_connect 0x7ff9a8067eb0 2021-02-24T15:16:24.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:24.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3464457176 0 0) 0x7ff988004bd0 con 0x7ff9a8065150 2021-02-24T15:16:24.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff9a80663c0 con 0x7ff9a8065150 2021-02-24T15:16:24.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff998001cb0 con 0x7ff9a8065150 2021-02-24T15:16:24.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004388953 0 0) 0x7ff9a8114f60 con 0x7ff9a8067eb0 2021-02-24T15:16:24.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff988004bd0 con 0x7ff9a8067eb0 2021-02-24T15:16:24.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 244709183 0 0) 0x7ff9a80663c0 con 0x7ff9a8065150 2021-02-24T15:16:24.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.152:6790/0 conn(0x7ff9a8064660 legacy=0x7ff9a8120fd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:24.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.181:6789/0 conn(0x7ff9a8067eb0 legacy=0x7ff9a81428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:24.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a81178e0 con 0x7ff9a8065150 2021-02-24T15:16:24.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a80954d0 con 0x7ff9a8065150 2021-02-24T15:16:24.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9af2ac700 10 client.4401.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:24.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a81155c0 con 0x7ff9a8065150 2021-02-24T15:16:24.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9af2ac700 1 librados: init done 2021-02-24T15:16:24.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff998002370 con 0x7ff9a8065150 2021-02-24T15:16:24.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.005+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff998002680 con 0x7ff9a8065150 2021-02-24T15:16:24.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.006+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff998002860 con 0x7ff9a8065150 2021-02-24T15:16:24.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.006+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff98c006550 con 0x7ff98c0027f0 2021-02-24T15:16:24.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.006+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7ff99803a930 con 0x7ff9a8065150 2021-02-24T15:16:24.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.006+0000 7ff9967fc700 10 client.4401.objecter ms_dispatch 0x7ff9a8001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:24.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.006+0000 7ff9967fc700 3 client.4401.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:24.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.006+0000 7ff9967fc700 3 client.4401.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:24.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.006+0000 7ff9967fc700 20 client.4401.objecter dump_active .. 0 homeless 2021-02-24T15:16:24.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.008+0000 7ff9967fc700 10 client.4401.objecter ms_handle_connect 0x7ff98c0027f0 2021-02-24T15:16:24.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.008+0000 7ff9967fc700 10 client.4401.objecter resend_mon_ops 2021-02-24T15:16:24.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.008+0000 7ff9ae2aa700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.181:6789/0 conn(0x7ff98c0027f0 legacy=0x7ff98c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:24.033 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888381819 0 0) 0x7ff98c006550 con 0x7ff98c0027f0 2021-02-24T15:16:24.033 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a80663c0 con 0x7ff98c0027f0 2021-02-24T15:16:24.033 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 10 client.4401.objecter ms_handle_connect 0x7ff988031400 2021-02-24T15:16:24.033 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3983526289 0 0) 0x7ff9a80663c0 con 0x7ff98c0027f0 2021-02-24T15:16:24.033 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff98c006550 con 0x7ff98c0027f0 2021-02-24T15:16:24.034 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff9a40044f0 con 0x7ff98c0027f0 2021-02-24T15:16:24.034 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2512843805 0 0) 0x7ff98c006550 con 0x7ff98c0027f0 2021-02-24T15:16:24.034 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff98c009df0 con 0x7ff98c0027f0 2021-02-24T15:16:24.045 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7ff9a40046e0 con 0x7ff98c0027f0 2021-02-24T15:16:24.046 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.009+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.181:6789/0 conn(0x7ff98c0027f0 legacy=0x7ff98c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:24.046 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.010+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.181:6789/0 conn(0x7ff98c0027f0 legacy=0x7ff98c004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:24.046 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.017+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff98c009a60 con 0x7ff98c008d80 2021-02-24T15:16:24.046 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9967fc700 10 client.4401.objecter ms_handle_connect 0x7ff98c008d80 2021-02-24T15:16:24.047 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9ae2aa700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.181:6789/0 conn(0x7ff98c008d80 legacy=0x7ff98c009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:24.047 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9967fc700 10 client.4401.objecter resend_mon_ops 2021-02-24T15:16:24.047 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261689799 0 0) 0x7ff98c009a60 con 0x7ff98c008d80 2021-02-24T15:16:24.047 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff98c006550 con 0x7ff98c008d80 2021-02-24T15:16:24.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1107386325 0 0) 0x7ff98c006550 con 0x7ff98c008d80 2021-02-24T15:16:24.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff98c009a60 con 0x7ff98c008d80 2021-02-24T15:16:24.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff9a4004e80 con 0x7ff98c008d80 2021-02-24T15:16:24.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 931479751 0 0) 0x7ff98c009a60 con 0x7ff98c008d80 2021-02-24T15:16:24.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.020+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff98c0086f0 con 0x7ff98c008d80 2021-02-24T15:16:24.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4110 (unknown 0 0 3270186835) 0x7ff9a4007200 con 0x7ff98c008d80 2021-02-24T15:16:24.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.181:6789/0 conn(0x7ff98c008d80 legacy=0x7ff98c009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:24.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9967fc700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.181:6789/0 conn(0x7ff98c008d80 legacy=0x7ff98c009210 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:24.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 10 librados: watch_flush enter 2021-02-24T15:16:24.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 10 librados: watch_flush exit 2021-02-24T15:16:24.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 20 client.4401.objecter shutdown clearing up homeless session... 2021-02-24T15:16:24.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 10 client.4401.objecter successfully canceled tick 2021-02-24T15:16:24.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.181:6812/33484 conn(0x7ff988031400 legacy=0x7ff9880338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:24.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 >> v1:172.21.15.152:6789/0 conn(0x7ff9a8065150 legacy=0x7ff9a81216e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:24.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9aeaab700 1 -- 172.21.15.152:0/720872935 reap_dead start 2021-02-24T15:16:24.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9aeaab700 1 -- 172.21.15.152:0/720872935 reap_dead start 2021-02-24T15:16:24.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 shutdown_connections 2021-02-24T15:16:24.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 >> 172.21.15.152:0/720872935 conn(0x7ff9a8099650 msgr2=0x7ff9a8097480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:24.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 shutdown_connections 2021-02-24T15:16:24.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 1 -- 172.21.15.152:0/720872935 wait complete. 2021-02-24T15:16:24.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:24.021+0000 7ff9af2ac700 1 librados: shutdown 2021-02-24T15:16:24.053 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:16:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:16:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:16:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:16:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 8, 2021-02-24T15:16:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:16:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:16:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:16:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:16:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 21, 2021-02-24T15:16:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:16:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:16:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:16:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:16:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:16:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:16:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:16:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:16:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:16:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:16:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:16:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:16:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:16:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:16:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:16:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:16:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:16:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:16:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:16:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:16:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:16:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:16:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:16:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:16:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:16:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:16:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:16:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:16:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:16:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:16:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:16:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:16:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:16:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:24.092 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:24.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:24.092 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:16:24.092 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:16:24.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.093 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:24.093 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:24.093 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:24.093 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:24.093 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:24.094 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:16:24.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.094 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:24.094 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:24.095 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:16:24.095 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:24.095 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:24.095 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:16:24.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.096 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:24.096 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:24.096 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:16:24.096 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:24.096 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:24.097 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:16:24.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:24.097 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:24.097 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:24.097 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:24.098 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:24.098 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:24.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:24.099 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:16:24.099 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:16:24.100 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2021-02-24T15:16:24.100 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2021-02-24T15:16:24.101 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2021-02-24T15:16:24.101 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2021-02-24T15:16:24.101 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-02-24T15:16:24.102 INFO:teuthology.orchestra.run:waiting for 300 2021-02-24T15:16:24.115 INFO:tasks.ceph.mon.b:Stopped 2021-02-24T15:16:24.115 INFO:tasks.mon_thrash:Sending STOP to mon c 2021-02-24T15:16:24.116 INFO:tasks.ceph.mon.c:Sent signal 19 2021-02-24T15:16:24.116 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2021-02-24T15:16:39.117 INFO:tasks.mon_thrash:Sending CONT to mon c 2021-02-24T15:16:39.119 INFO:tasks.ceph.mon.c:Sent signal 18 2021-02-24T15:16:39.120 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2021-02-24T15:16:39.120 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:16:39.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.248+0000 7f76f88a2700 1 Processor -- start 2021-02-24T15:16:39.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.248+0000 7f76f88a2700 1 -- start start 2021-02-24T15:16:39.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.249+0000 7f76f88a2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f4063aa0 con 0x7f76f4130c60 2021-02-24T15:16:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.249+0000 7f76f88a2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f4093e50 con 0x7f76f412d150 2021-02-24T15:16:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.249+0000 7f76f88a2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f4063cf0 con 0x7f76f40681d0 2021-02-24T15:16:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.249+0000 7f76f359e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f76f4130c60 0x7f76f4133050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46360/0 (socket says 172.21.15.152:46360) 2021-02-24T15:16:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.249+0000 7f76f259c700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76f412f540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.249+0000 7f76f359e700 1 -- 172.21.15.152:0/3845037685 learned_addr learned my addr 172.21.15.152:0/3845037685 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:39.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.251+0000 7f76f359e700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.152:6789/0 conn(0x7f76f4130c60 legacy=0x7f76f4133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:39.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.251+0000 7f76f2d9d700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.152:6790/0 conn(0x7f76f40681d0 legacy=0x7f76f4063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:39.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.450+0000 7f76f259c700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76f412f540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:39.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:39.851+0000 7f76f259c700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76f412f540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:40.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:40.652+0000 7f76f259c700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76f412f540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:42.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.249+0000 7f76f0d99700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.152:6790/0 conn(0x7f76f40681d0 legacy=0x7f76f4063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:42.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.249+0000 7f76f0d99700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76f412f540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:16:42.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.249+0000 7f76f0d99700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.152:6789/0 conn(0x7f76f4130c60 legacy=0x7f76f4133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:42.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.249+0000 7f76f0d99700 1 -- 172.21.15.152:0/3845037685 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f4063fb0 con 0x7f76d40034a0 2021-02-24T15:16:42.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.249+0000 7f76f0d99700 1 -- 172.21.15.152:0/3845037685 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d400f120 con 0x7f76f412d150 2021-02-24T15:16:42.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.249+0000 7f76f0d99700 1 -- 172.21.15.152:0/3845037685 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d4010330 con 0x7f76f40681d0 2021-02-24T15:16:42.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.249+0000 7f76f259c700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76d4009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:42.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.252+0000 7f76f359e700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.152:6790/0 conn(0x7f76f40681d0 legacy=0x7f76d400c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:42.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.252+0000 7f76f2d9d700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.152:6789/0 conn(0x7f76d40034a0 legacy=0x7f76d40058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:42.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.450+0000 7f76f259c700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76d4009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:42.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:42.851+0000 7f76f259c700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76d4009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:43.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:43.652+0000 7f76f259c700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76d4009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:44.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.129+0000 7f76f1d9b700 1 -- 172.21.15.152:0/3845037685 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767301471 0 0) 0x7f76f4063fb0 con 0x7f76d40034a0 2021-02-24T15:16:44.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.129+0000 7f76f1d9b700 1 -- 172.21.15.152:0/3845037685 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e0003230 con 0x7f76d40034a0 2021-02-24T15:16:44.131 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.129+0000 7f76f1d9b700 1 -- 172.21.15.152:0/3845037685 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1592847412 0 0) 0x7f76e0003230 con 0x7f76d40034a0 2021-02-24T15:16:44.131 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.129+0000 7f76f1d9b700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.152:6790/0 conn(0x7f76f40681d0 legacy=0x7f76d400c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.130+0000 7f76f1d9b700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.181:6789/0 conn(0x7f76f412d150 legacy=0x7f76d4009100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:16:44.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.130+0000 7f76f1d9b700 1 -- 172.21.15.152:0/3845037685 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d4011540 con 0x7f76d40034a0 2021-02-24T15:16:44.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.130+0000 7f76f1d9b700 1 -- 172.21.15.152:0/3845037685 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f76e4001900 con 0x7f76d40034a0 2021-02-24T15:16:44.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.130+0000 7f76f1d9b700 1 -- 172.21.15.152:0/3845037685 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f76e4001c10 con 0x7f76d40034a0 2021-02-24T15:16:44.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.130+0000 7f76f1d9b700 1 -- 172.21.15.152:0/3845037685 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f76e4002060 con 0x7f76d40034a0 2021-02-24T15:16:44.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.131+0000 7f76f88a2700 1 -- 172.21.15.152:0/3845037685 >> v1:172.21.15.152:6789/0 conn(0x7f76d40034a0 legacy=0x7f76d40058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.131+0000 7f76f88a2700 1 -- 172.21.15.152:0/3845037685 shutdown_connections 2021-02-24T15:16:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.131+0000 7f76f88a2700 1 -- 172.21.15.152:0/3845037685 >> 172.21.15.152:0/3845037685 conn(0x7f76f409b950 msgr2=0x7f76f409bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:44.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.131+0000 7f76f88a2700 1 -- 172.21.15.152:0/3845037685 shutdown_connections 2021-02-24T15:16:44.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.131+0000 7f76f88a2700 1 -- 172.21.15.152:0/3845037685 wait complete. 2021-02-24T15:16:44.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.133+0000 7f76f88a2700 1 librados: starting msgr at 2021-02-24T15:16:44.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.133+0000 7f76f88a2700 1 librados: starting objecter 2021-02-24T15:16:44.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.133+0000 7f76f88a2700 1 Processor -- start 2021-02-24T15:16:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.133+0000 7f76f88a2700 1 -- start start 2021-02-24T15:16:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.133+0000 7f76f88a2700 1 librados: setting wanted keys 2021-02-24T15:16:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.133+0000 7f76f88a2700 1 librados: calling monclient init 2021-02-24T15:16:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.134+0000 7f76f88a2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f413a8c0 con 0x7f76f412d150 2021-02-24T15:16:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.134+0000 7f76f88a2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f4115620 con 0x7f76f40681d0 2021-02-24T15:16:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.134+0000 7f76f88a2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f41158c0 con 0x7f76d40034a0 2021-02-24T15:16:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.134+0000 7f76f2d9d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f76d40034a0 0x7f76f413a1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34862/0 (socket says 172.21.15.152:34862) 2021-02-24T15:16:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.134+0000 7f76f2d9d700 1 -- 172.21.15.152:0/3777865728 learned_addr learned my addr 172.21.15.152:0/3777865728 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.134+0000 7f76f359e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f76f412d150 0x7f76f4142500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46390/0 (socket says 172.21.15.152:46390) 2021-02-24T15:16:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.134+0000 7f76f259c700 1 -- 172.21.15.152:0/3777865728 >> v1:172.21.15.181:6789/0 conn(0x7f76f40681d0 legacy=0x7f76f412a140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:44.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.136+0000 7f76f359e700 1 -- 172.21.15.152:0/3777865728 >> v1:172.21.15.152:6789/0 conn(0x7f76f412d150 legacy=0x7f76f4142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.136+0000 7f76daffd700 10 client.?.objecter ms_handle_connect 0x7f76f412d150 2021-02-24T15:16:44.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.136+0000 7f76daffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:44.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.136+0000 7f76daffd700 10 client.?.objecter ms_handle_connect 0x7f76d40034a0 2021-02-24T15:16:44.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.136+0000 7f76daffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:44.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.136+0000 7f76f2d9d700 1 -- 172.21.15.152:0/3777865728 >> v1:172.21.15.152:6790/0 conn(0x7f76d40034a0 legacy=0x7f76f413a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.137+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067187176 0 0) 0x7f76d4010330 con 0x7f76f412d150 2021-02-24T15:16:44.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.137+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d4002f90 con 0x7f76f412d150 2021-02-24T15:16:44.143 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.137+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3457550527 0 0) 0x7f76d4002f90 con 0x7f76f412d150 2021-02-24T15:16:44.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.137+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f76d4010330 con 0x7f76f412d150 2021-02-24T15:16:44.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.137+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f76ec001c70 con 0x7f76f412d150 2021-02-24T15:16:44.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.138+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1064746523 0 0) 0x7f76d4010330 con 0x7f76f412d150 2021-02-24T15:16:44.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.138+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 >> v1:172.21.15.152:6790/0 conn(0x7f76d40034a0 legacy=0x7f76f413a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.138+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 >> v1:172.21.15.181:6789/0 conn(0x7f76f40681d0 legacy=0x7f76f412a140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:16:44.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.138+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4115b60 con 0x7f76f412d150 2021-02-24T15:16:44.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.138+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f41139f0 con 0x7f76f412d150 2021-02-24T15:16:44.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.138+0000 7f76f88a2700 10 client.4407.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:44.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.138+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f413aef0 con 0x7f76f412d150 2021-02-24T15:16:44.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.138+0000 7f76f88a2700 1 librados: init done 2021-02-24T15:16:44.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.139+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f76ec0048f0 con 0x7f76f412d150 2021-02-24T15:16:44.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.139+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f76ec004c00 con 0x7f76f412d150 2021-02-24T15:16:44.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.139+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f76ec004d60 con 0x7f76f412d150 2021-02-24T15:16:44.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.140+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d0004d60 con 0x7f76f412d150 2021-02-24T15:16:44.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.140+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f76ec03a8a0 con 0x7f76f412d150 2021-02-24T15:16:44.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.140+0000 7f76daffd700 10 client.4407.objecter ms_dispatch 0x7f76f4001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:44.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.140+0000 7f76daffd700 3 client.4407.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:44.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.140+0000 7f76daffd700 3 client.4407.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.140+0000 7f76daffd700 20 client.4407.objecter dump_active .. 0 homeless 2021-02-24T15:16:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.142+0000 7f76daffd700 10 client.4407.objecter ms_handle_connect 0x7f76d4031cc0 2021-02-24T15:16:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.144+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f76ec012450 con 0x7f76f412d150 2021-02-24T15:16:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.382+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f76d0005590 con 0x7f76f412d150 2021-02-24T15:16:44.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.382+0000 7f76daffd700 1 -- 172.21.15.152:0/3777865728 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1336 (unknown 254746657 0 2359990399) 0x7f76ec010f70 con 0x7f76f412d150 2021-02-24T15:16:44.384 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":10,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:16:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 10 librados: watch_flush enter 2021-02-24T15:16:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 10 librados: watch_flush exit 2021-02-24T15:16:44.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 20 client.4407.objecter shutdown clearing up homeless session... 2021-02-24T15:16:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 10 client.4407.objecter successfully canceled tick 2021-02-24T15:16:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 >> v1:172.21.15.181:6812/33484 conn(0x7f76d4031cc0 legacy=0x7f76d4034180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 >> v1:172.21.15.152:6789/0 conn(0x7f76f412d150 legacy=0x7f76f4142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 shutdown_connections 2021-02-24T15:16:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 >> 172.21.15.152:0/3777865728 conn(0x7f76f409b950 msgr2=0x7f76f4066340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 shutdown_connections 2021-02-24T15:16:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 1 -- 172.21.15.152:0/3777865728 wait complete. 2021-02-24T15:16:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.384+0000 7f76f88a2700 1 librados: shutdown 2021-02-24T15:16:44.396 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2021-02-24T15:16:44.398 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:16:44.516 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.515+0000 7f15f6d2c700 1 Processor -- start 2021-02-24T15:16:44.516 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.515+0000 7f15f6d2c700 1 -- start start 2021-02-24T15:16:44.517 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.515+0000 7f15f6d2c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f012b0d0 con 0x7f15f0067e70 2021-02-24T15:16:44.517 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.515+0000 7f15f6d2c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f0098a60 con 0x7f15f00679c0 2021-02-24T15:16:44.517 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.515+0000 7f15f6d2c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f009a0b0 con 0x7f15f00613c0 2021-02-24T15:16:44.518 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.516+0000 7f15f52c9700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f15f0067e70 0x7f15f0133410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46398/0 (socket says 172.21.15.152:46398) 2021-02-24T15:16:44.518 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.516+0000 7f15f52c9700 1 -- 172.21.15.152:0/2999816554 learned_addr learned my addr 172.21.15.152:0/2999816554 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:44.518 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.516+0000 7f15f4ac8700 1 --1- 172.21.15.152:0/2999816554 >> v1:172.21.15.152:6790/0 conn(0x7f15f00613c0 0x7f15f012a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34870/0 (socket says 172.21.15.152:34870) 2021-02-24T15:16:44.518 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.516+0000 7f15effff700 1 -- 172.21.15.152:0/2999816554 >> v1:172.21.15.181:6789/0 conn(0x7f15f00679c0 legacy=0x7f15f012fce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:44.522 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15f52c9700 1 -- 172.21.15.152:0/2999816554 >> v1:172.21.15.152:6789/0 conn(0x7f15f0067e70 legacy=0x7f15f0133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.522 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15f4ac8700 1 -- 172.21.15.152:0/2999816554 >> v1:172.21.15.152:6790/0 conn(0x7f15f00613c0 legacy=0x7f15f012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.522 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978457797 0 0) 0x7f15f012b0d0 con 0x7f15f0067e70 2021-02-24T15:16:44.523 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d4003230 con 0x7f15f0067e70 2021-02-24T15:16:44.523 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739263053 0 0) 0x7f15f009a0b0 con 0x7f15f00613c0 2021-02-24T15:16:44.523 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f012b0d0 con 0x7f15f00613c0 2021-02-24T15:16:44.523 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2158672163 0 0) 0x7f15d4003230 con 0x7f15f0067e70 2021-02-24T15:16:44.524 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 >> v1:172.21.15.152:6790/0 conn(0x7f15f00613c0 legacy=0x7f15f012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.525 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 >> v1:172.21.15.181:6789/0 conn(0x7f15f00679c0 legacy=0x7f15f012fce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:16:44.525 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f009a350 con 0x7f15f0067e70 2021-02-24T15:16:44.525 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f15e8001cb0 con 0x7f15f0067e70 2021-02-24T15:16:44.526 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f15e8001fc0 con 0x7f15f0067e70 2021-02-24T15:16:44.526 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.518+0000 7f15ef7fe700 1 -- 172.21.15.152:0/2999816554 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f15e8004ad0 con 0x7f15f0067e70 2021-02-24T15:16:44.526 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.519+0000 7f15f6d2c700 1 -- 172.21.15.152:0/2999816554 >> v1:172.21.15.152:6789/0 conn(0x7f15f0067e70 legacy=0x7f15f0133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.526 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.519+0000 7f15f6d2c700 1 -- 172.21.15.152:0/2999816554 shutdown_connections 2021-02-24T15:16:44.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.519+0000 7f15f6d2c700 1 -- 172.21.15.152:0/2999816554 >> 172.21.15.152:0/2999816554 conn(0x7f15f009a940 msgr2=0x7f15f009ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:44.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.519+0000 7f15f6d2c700 1 -- 172.21.15.152:0/2999816554 shutdown_connections 2021-02-24T15:16:44.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.519+0000 7f15f6d2c700 1 -- 172.21.15.152:0/2999816554 wait complete. 2021-02-24T15:16:44.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.519+0000 7f15f6d2c700 1 librados: starting msgr at 2021-02-24T15:16:44.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.519+0000 7f15f6d2c700 1 librados: starting objecter 2021-02-24T15:16:44.528 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.519+0000 7f15f6d2c700 1 Processor -- start 2021-02-24T15:16:44.528 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15f6d2c700 1 -- start start 2021-02-24T15:16:44.528 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15f6d2c700 1 librados: setting wanted keys 2021-02-24T15:16:44.528 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15f6d2c700 1 librados: calling monclient init 2021-02-24T15:16:44.528 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15f6d2c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f012dc20 con 0x7f15f00679c0 2021-02-24T15:16:44.529 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15f6d2c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f0099480 con 0x7f15f0067e70 2021-02-24T15:16:44.529 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15f6d2c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f012f780 con 0x7f15f00613c0 2021-02-24T15:16:44.529 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15f4ac8700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f15f00613c0 0x7f15f0124290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34878/0 (socket says 172.21.15.152:34878) 2021-02-24T15:16:44.529 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15effff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f15f00679c0 0x7f15f01249a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46400/0 (socket says 172.21.15.152:46400) 2021-02-24T15:16:44.530 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15f4ac8700 1 -- 172.21.15.152:0/3172014723 learned_addr learned my addr 172.21.15.152:0/3172014723 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:44.530 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.520+0000 7f15f52c9700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.181:6789/0 conn(0x7f15f0067e70 legacy=0x7f15f0142210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:44.534 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.522+0000 7f15f4ac8700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6790/0 conn(0x7f15f00613c0 legacy=0x7f15f0124290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.535 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.522+0000 7f15ecff9700 10 client.?.objecter ms_handle_connect 0x7f15f00613c0 2021-02-24T15:16:44.539 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.522+0000 7f15ecff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:44.539 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.522+0000 7f15ecff9700 10 client.?.objecter ms_handle_connect 0x7f15f00679c0 2021-02-24T15:16:44.540 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.522+0000 7f15ecff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:44.540 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.522+0000 7f15effff700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6789/0 conn(0x7f15f00679c0 legacy=0x7f15f01249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.541 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.522+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992164308 0 0) 0x7f15f012f780 con 0x7f15f00613c0 2021-02-24T15:16:44.541 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d0004bd0 con 0x7f15f00613c0 2021-02-24T15:16:44.542 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408417866 0 0) 0x7f15f012dc20 con 0x7f15f00679c0 2021-02-24T15:16:44.542 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f012f780 con 0x7f15f00679c0 2021-02-24T15:16:44.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1393622743 0 0) 0x7f15d0004bd0 con 0x7f15f00613c0 2021-02-24T15:16:44.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15f012dc20 con 0x7f15f00613c0 2021-02-24T15:16:44.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f15e4001c00 con 0x7f15f00613c0 2021-02-24T15:16:44.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1921965881 0 0) 0x7f15f012f780 con 0x7f15f00679c0 2021-02-24T15:16:44.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15d0004bd0 con 0x7f15f00679c0 2021-02-24T15:16:44.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f15dc004180 con 0x7f15f00679c0 2021-02-24T15:16:44.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2669009746 0 0) 0x7f15f012dc20 con 0x7f15f00613c0 2021-02-24T15:16:44.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.181:6789/0 conn(0x7f15f0067e70 legacy=0x7f15f0142210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:16:44.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6789/0 conn(0x7f15f00679c0 legacy=0x7f15f01249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f012d5a0 con 0x7f15f00613c0 2021-02-24T15:16:44.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f0130130 con 0x7f15f00613c0 2021-02-24T15:16:44.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15f6d2c700 10 client.4400.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:44.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f012e240 con 0x7f15f00613c0 2021-02-24T15:16:44.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15f6d2c700 1 librados: init done 2021-02-24T15:16:44.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f15e40048e0 con 0x7f15f00613c0 2021-02-24T15:16:44.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.523+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f15e4004bf0 con 0x7f15f00613c0 2021-02-24T15:16:44.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.524+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f15e4004d50 con 0x7f15f00613c0 2021-02-24T15:16:44.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.524+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f15e403a9a0 con 0x7f15f00613c0 2021-02-24T15:16:44.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.524+0000 7f15ecff9700 10 client.4400.objecter ms_dispatch 0x7f15f0001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:44.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.524+0000 7f15ecff9700 3 client.4400.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:44.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.524+0000 7f15ecff9700 3 client.4400.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:44.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.524+0000 7f15ecff9700 20 client.4400.objecter dump_active .. 0 homeless 2021-02-24T15:16:44.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.524+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f15c8006550 con 0x7f15c80027f0 2021-02-24T15:16:44.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.526+0000 7f15ecff9700 10 client.4400.objecter ms_handle_connect 0x7f15c80027f0 2021-02-24T15:16:44.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.526+0000 7f15ecff9700 10 client.4400.objecter resend_mon_ops 2021-02-24T15:16:44.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.526+0000 7f15f52c9700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6789/0 conn(0x7f15c80027f0 legacy=0x7f15c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.526+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702791075 0 0) 0x7f15c8006550 con 0x7f15c80027f0 2021-02-24T15:16:44.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.526+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f012dc20 con 0x7f15c80027f0 2021-02-24T15:16:44.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.526+0000 7f15ecff9700 10 client.4400.objecter ms_handle_connect 0x7f15d0031700 2021-02-24T15:16:44.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.527+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3849628321 0 0) 0x7f15f012dc20 con 0x7f15c80027f0 2021-02-24T15:16:44.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.527+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15c8006550 con 0x7f15c80027f0 2021-02-24T15:16:44.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.527+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f15e80018c0 con 0x7f15c80027f0 2021-02-24T15:16:44.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.527+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3072895141 0 0) 0x7f15c8006550 con 0x7f15c80027f0 2021-02-24T15:16:44.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.527+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15c8009df0 con 0x7f15c80027f0 2021-02-24T15:16:44.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.527+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f15e8001a20 con 0x7f15c80027f0 2021-02-24T15:16:44.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.527+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6789/0 conn(0x7f15c80027f0 legacy=0x7f15c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.527+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6789/0 conn(0x7f15c80027f0 legacy=0x7f15c8004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:44.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.535+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f15c8009a80 con 0x7f15c8008da0 2021-02-24T15:16:44.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.537+0000 7f15ecff9700 10 client.4400.objecter ms_handle_connect 0x7f15c8008da0 2021-02-24T15:16:44.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.537+0000 7f15ecff9700 10 client.4400.objecter resend_mon_ops 2021-02-24T15:16:44.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.537+0000 7f15f52c9700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6789/0 conn(0x7f15c8008da0 legacy=0x7f15c8009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339280734 0 0) 0x7f15c8009a80 con 0x7f15c8008da0 2021-02-24T15:16:44.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c8006550 con 0x7f15c8008da0 2021-02-24T15:16:44.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 194326649 0 0) 0x7f15c8006550 con 0x7f15c8008da0 2021-02-24T15:16:44.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15c8009a80 con 0x7f15c8008da0 2021-02-24T15:16:44.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f15e80052a0 con 0x7f15c8008da0 2021-02-24T15:16:44.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2477351358 0 0) 0x7f15c8009a80 con 0x7f15c8008da0 2021-02-24T15:16:44.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f15c80086f0 con 0x7f15c8008da0 2021-02-24T15:16:44.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3931 (unknown 0 0 2204739389) 0x7f15e8006f70 con 0x7f15c8008da0 2021-02-24T15:16:44.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6789/0 conn(0x7f15c8008da0 legacy=0x7f15c8009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15ecff9700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6789/0 conn(0x7f15c8008da0 legacy=0x7f15c8009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:44.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f6d2c700 10 librados: watch_flush enter 2021-02-24T15:16:44.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f6d2c700 10 librados: watch_flush exit 2021-02-24T15:16:44.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f6d2c700 20 client.4400.objecter shutdown clearing up homeless session... 2021-02-24T15:16:44.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f6d2c700 10 client.4400.objecter successfully canceled tick 2021-02-24T15:16:44.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.181:6812/33484 conn(0x7f15d0031700 legacy=0x7f15d0033bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 >> v1:172.21.15.152:6790/0 conn(0x7f15f00613c0 legacy=0x7f15f0124290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f52c9700 1 -- 172.21.15.152:0/3172014723 reap_dead start 2021-02-24T15:16:44.561 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f52c9700 1 -- 172.21.15.152:0/3172014723 reap_dead start 2021-02-24T15:16:44.561 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 shutdown_connections 2021-02-24T15:16:44.561 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.538+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 >> 172.21.15.152:0/3172014723 conn(0x7f15f009a940 msgr2=0x7f15f0127580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:44.561 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.539+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 shutdown_connections 2021-02-24T15:16:44.562 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.539+0000 7f15f6d2c700 1 -- 172.21.15.152:0/3172014723 wait complete. 2021-02-24T15:16:44.562 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.539+0000 7f15f6d2c700 1 librados: shutdown 2021-02-24T15:16:44.562 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:16:44.562 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:16:44.563 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:16:44.563 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:16:44.563 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 10, 2021-02-24T15:16:44.563 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:16:44.563 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:16:44.564 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:16:44.564 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.564 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:16:44.564 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:44.564 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:16:44.565 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:16:44.565 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:44.565 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:44.565 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:44.566 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:44.566 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:44.567 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:44.567 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:44.568 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:44.568 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:44.568 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.568 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:16:44.569 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:16:44.569 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:44.569 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:44.569 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:44.569 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:44.570 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:44.570 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:44.570 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:44.570 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:44.570 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:44.571 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.571 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:16:44.571 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:16:44.572 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:16:44.572 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:16:44.572 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:16:44.572 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:16:44.572 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:44.573 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:44.573 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:16:44.573 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:16:44.573 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:16:44.573 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:16:44.574 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:16:44.574 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:44.574 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:16:44.574 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:44.574 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:44.575 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:44.575 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:44.575 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:44.575 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:44.576 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:44.576 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:44.576 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:44.577 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.577 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:16:44.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.578 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:16:44.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:16:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:16:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:16:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:16:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:16:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:16:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:16:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:16:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:16:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:16:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:16:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:16:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:16:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:16:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:16:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.592 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:16:44.592 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:16:44.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.592 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:44.593 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:44.593 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:44.593 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.593 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.594 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:16:44.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.594 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:44.595 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:44.595 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:44.595 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.595 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.595 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:16:44.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.596 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:44.596 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:44.596 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:16:44.596 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.597 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.597 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:16:44.598 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:16:44.599 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:16:44.717 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.716+0000 7fc11fc37700 1 Processor -- start 2021-02-24T15:16:44.717 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.716+0000 7fc11fc37700 1 -- start start 2021-02-24T15:16:44.718 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.717+0000 7fc11fc37700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc118068930 con 0x7fc118090ba0 2021-02-24T15:16:44.719 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.717+0000 7fc11fc37700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc118068bd0 con 0x7fc118090720 2021-02-24T15:16:44.719 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.717+0000 7fc11fc37700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11808e260 con 0x7fc118097550 2021-02-24T15:16:44.719 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.717+0000 7fc11d9d3700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc118097550 0x7fc118127a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34888/0 (socket says 172.21.15.152:34888) 2021-02-24T15:16:44.719 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.717+0000 7fc11e1d4700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc118090ba0 0x7fc1181334d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46416/0 (socket says 172.21.15.152:46416) 2021-02-24T15:16:44.719 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.717+0000 7fc11d9d3700 1 -- 172.21.15.152:0/94828560 learned_addr learned my addr 172.21.15.152:0/94828560 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:44.720 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.717+0000 7fc11d1d2700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fc118090720 legacy=0x7fc11812fda0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:44.722 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.719+0000 7fc11d9d3700 1 -- 172.21.15.152:0/94828560 >> v1:172.21.15.152:6790/0 conn(0x7fc118097550 legacy=0x7fc118127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.719+0000 7fc11e1d4700 1 -- 172.21.15.152:0/94828560 >> v1:172.21.15.152:6789/0 conn(0x7fc118090ba0 legacy=0x7fc1181334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.719+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027287812 0 0) 0x7fc11808e260 con 0x7fc118097550 2021-02-24T15:16:44.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.719+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc100003230 con 0x7fc118097550 2021-02-24T15:16:44.724 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.719+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832327112 0 0) 0x7fc118068930 con 0x7fc118090ba0 2021-02-24T15:16:44.724 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.719+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc11808e260 con 0x7fc118090ba0 2021-02-24T15:16:44.724 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 754511351 0 0) 0x7fc100003230 con 0x7fc118097550 2021-02-24T15:16:44.724 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 >> v1:172.21.15.181:6789/0 conn(0x7fc118090720 legacy=0x7fc11812fda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:16:44.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 >> v1:172.21.15.152:6789/0 conn(0x7fc118090ba0 legacy=0x7fc1181334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118067fd0 con 0x7fc118097550 2021-02-24T15:16:44.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc114001930 con 0x7fc118097550 2021-02-24T15:16:44.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc114001c40 con 0x7fc118097550 2021-02-24T15:16:44.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11c9d1700 1 -- 172.21.15.152:0/94828560 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc114004750 con 0x7fc118097550 2021-02-24T15:16:44.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11fc37700 1 -- 172.21.15.152:0/94828560 >> v1:172.21.15.152:6790/0 conn(0x7fc118097550 legacy=0x7fc118127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11fc37700 1 -- 172.21.15.152:0/94828560 shutdown_connections 2021-02-24T15:16:44.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11fc37700 1 -- 172.21.15.152:0/94828560 >> 172.21.15.152:0/94828560 conn(0x7fc11809ab10 msgr2=0x7fc118096ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:44.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11fc37700 1 -- 172.21.15.152:0/94828560 shutdown_connections 2021-02-24T15:16:44.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.720+0000 7fc11fc37700 1 -- 172.21.15.152:0/94828560 wait complete. 2021-02-24T15:16:44.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.721+0000 7fc11fc37700 1 librados: starting msgr at 2021-02-24T15:16:44.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.721+0000 7fc11fc37700 1 librados: starting objecter 2021-02-24T15:16:44.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.721+0000 7fc11fc37700 1 Processor -- start 2021-02-24T15:16:44.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.721+0000 7fc11fc37700 1 -- start start 2021-02-24T15:16:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.721+0000 7fc11fc37700 1 librados: setting wanted keys 2021-02-24T15:16:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.721+0000 7fc11fc37700 1 librados: calling monclient init 2021-02-24T15:16:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.722+0000 7fc11fc37700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc118133bf0 con 0x7fc118097550 2021-02-24T15:16:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.722+0000 7fc11fc37700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11808d120 con 0x7fc118090ba0 2021-02-24T15:16:44.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.722+0000 7fc11fc37700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11808afb0 con 0x7fc118090720 2021-02-24T15:16:44.729 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.722+0000 7fc11d9d3700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc118090720 0x7fc11808d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:34894/0 (socket says 172.21.15.152:34894) 2021-02-24T15:16:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.722+0000 7fc11d9d3700 1 -- 172.21.15.152:0/2738337895 learned_addr learned my addr 172.21.15.152:0/2738337895 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:16:44.734 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.722+0000 7fc11d1d2700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.181:6789/0 conn(0x7fc118090ba0 legacy=0x7fc118124440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:16:44.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc11d9d3700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6790/0 conn(0x7fc118090720 legacy=0x7fc11808d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 10 client.?.objecter ms_handle_connect 0x7fc118090720 2021-02-24T15:16:44.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:44.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 10 client.?.objecter ms_handle_connect 0x7fc118097550 2021-02-24T15:16:44.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:16:44.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc11e1d4700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6789/0 conn(0x7fc118097550 legacy=0x7fc118142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004221036 0 0) 0x7fc11808afb0 con 0x7fc118090720 2021-02-24T15:16:44.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f8004bd0 con 0x7fc118090720 2021-02-24T15:16:44.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969626936 0 0) 0x7fc118133bf0 con 0x7fc118097550 2021-02-24T15:16:44.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc11808afb0 con 0x7fc118097550 2021-02-24T15:16:44.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2150350546 0 0) 0x7fc11808afb0 con 0x7fc118097550 2021-02-24T15:16:44.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc118133bf0 con 0x7fc118097550 2021-02-24T15:16:44.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3215956023 0 0) 0x7fc0f8004bd0 con 0x7fc118090720 2021-02-24T15:16:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc11808afb0 con 0x7fc118090720 2021-02-24T15:16:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc110001f60 con 0x7fc118097550 2021-02-24T15:16:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc1140018f0 con 0x7fc118090720 2021-02-24T15:16:44.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1258563016 0 0) 0x7fc118133bf0 con 0x7fc118097550 2021-02-24T15:16:44.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6790/0 conn(0x7fc118090720 legacy=0x7fc11808d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.181:6789/0 conn(0x7fc118090ba0 legacy=0x7fc118124440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:16:44.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11808de90 con 0x7fc118097550 2021-02-24T15:16:44.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.724+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11808bc20 con 0x7fc118097550 2021-02-24T15:16:44.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.725+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc110004c10 con 0x7fc118097550 2021-02-24T15:16:44.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.725+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc110004f20 con 0x7fc118097550 2021-02-24T15:16:44.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.725+0000 7fc11fc37700 10 client.4425.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:16:44.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.725+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc118124d10 con 0x7fc118097550 2021-02-24T15:16:44.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.725+0000 7fc11fc37700 1 librados: init done 2021-02-24T15:16:44.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.725+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fc11000db20 con 0x7fc118097550 2021-02-24T15:16:44.757 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.726+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7fc11003ab90 con 0x7fc118097550 2021-02-24T15:16:44.757 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.726+0000 7fc105ffb700 10 client.4425.objecter ms_dispatch 0x7fc118001510 osd_map(15..15 src has 1..15) v4 2021-02-24T15:16:44.758 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.726+0000 7fc105ffb700 3 client.4425.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:16:44.758 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.726+0000 7fc105ffb700 3 client.4425.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:16:44.758 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.726+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fc118124fc0 con 0x7fc1180914f0 2021-02-24T15:16:44.758 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.726+0000 7fc105ffb700 20 client.4425.objecter dump_active .. 0 homeless 2021-02-24T15:16:44.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.728+0000 7fc105ffb700 10 client.4425.objecter ms_handle_connect 0x7fc1180914f0 2021-02-24T15:16:44.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.728+0000 7fc105ffb700 10 client.4425.objecter resend_mon_ops 2021-02-24T15:16:44.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.728+0000 7fc11d1d2700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6790/0 conn(0x7fc1180914f0 legacy=0x7fc1180918d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.728+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522102604 0 0) 0x7fc118124fc0 con 0x7fc1180914f0 2021-02-24T15:16:44.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.728+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc118133bf0 con 0x7fc1180914f0 2021-02-24T15:16:44.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.728+0000 7fc105ffb700 10 client.4425.objecter ms_handle_connect 0x7fc0f8031460 2021-02-24T15:16:44.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.728+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2872503275 0 0) 0x7fc118133bf0 con 0x7fc1180914f0 2021-02-24T15:16:44.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.728+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc118124fc0 con 0x7fc1180914f0 2021-02-24T15:16:44.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.728+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc1080040e0 con 0x7fc1180914f0 2021-02-24T15:16:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.729+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1762825345 0 0) 0x7fc118124fc0 con 0x7fc1180914f0 2021-02-24T15:16:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.729+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc118058400 con 0x7fc1180914f0 2021-02-24T15:16:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.729+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fc108006400 con 0x7fc1180914f0 2021-02-24T15:16:44.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.729+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6790/0 conn(0x7fc1180914f0 legacy=0x7fc1180918d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.729+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6790/0 conn(0x7fc1180914f0 legacy=0x7fc1180918d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.737+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fc118068620 con 0x7fc118027010 2021-02-24T15:16:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc11d1d2700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6790/0 conn(0x7fc118027010 legacy=0x7fc118147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:16:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc105ffb700 10 client.4425.objecter ms_handle_connect 0x7fc118027010 2021-02-24T15:16:44.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc105ffb700 10 client.4425.objecter resend_mon_ops 2021-02-24T15:16:44.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811398237 0 0) 0x7fc118068620 con 0x7fc118027010 2021-02-24T15:16:44.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc118124fc0 con 0x7fc118027010 2021-02-24T15:16:44.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3252769923 0 0) 0x7fc118124fc0 con 0x7fc118027010 2021-02-24T15:16:44.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc118068620 con 0x7fc118027010 2021-02-24T15:16:44.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc108004900 con 0x7fc118027010 2021-02-24T15:16:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1910219750 0 0) 0x7fc118068620 con 0x7fc118027010 2021-02-24T15:16:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.739+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc118044c90 con 0x7fc118027010 2021-02-24T15:16:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4099 (unknown 0 0 2960863750) 0x7fc108005d90 con 0x7fc118027010 2021-02-24T15:16:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6790/0 conn(0x7fc118027010 legacy=0x7fc118147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc105ffb700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6790/0 conn(0x7fc118027010 legacy=0x7fc118147750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:16:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 10 librados: watch_flush enter 2021-02-24T15:16:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 10 librados: watch_flush exit 2021-02-24T15:16:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 20 client.4425.objecter shutdown clearing up homeless session... 2021-02-24T15:16:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 10 client.4425.objecter successfully canceled tick 2021-02-24T15:16:44.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.181:6812/33484 conn(0x7fc0f8031460 legacy=0x7fc0f8033920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 >> v1:172.21.15.152:6789/0 conn(0x7fc118097550 legacy=0x7fc118142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:16:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11e1d4700 1 -- 172.21.15.152:0/2738337895 reap_dead start 2021-02-24T15:16:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11e1d4700 1 -- 172.21.15.152:0/2738337895 reap_dead start 2021-02-24T15:16:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 shutdown_connections 2021-02-24T15:16:44.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 >> 172.21.15.152:0/2738337895 conn(0x7fc11809ab10 msgr2=0x7fc118126220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:16:44.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 shutdown_connections 2021-02-24T15:16:44.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 1 -- 172.21.15.152:0/2738337895 wait complete. 2021-02-24T15:16:44.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:16:44.740+0000 7fc11fc37700 1 librados: shutdown 2021-02-24T15:16:44.771 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:16:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:16:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:16:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:16:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 10, 2021-02-24T15:16:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:16:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:16:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:16:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:16:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:16:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:16:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:16:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:16:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:16:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:16:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:16:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:16:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:16:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:16:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:16:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:16:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:16:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:16:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:16:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:16:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:16:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:16:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:16:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:16:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:16:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:16:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:16:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:16:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:16:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:16:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:16:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:16:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:16:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:16:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:16:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:16:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:16:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:16:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:16:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:16:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:16:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:16:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:16:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:16:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:16:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:16:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:16:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:16:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:16:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:16:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:16:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:16:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:16:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:16:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:16:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:16:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:16:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:16:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:16:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:16:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:16:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:16:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:16:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:16:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:16:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:16:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:16:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:16:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:16:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:16:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:16:44.815 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:16:44.817 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-02-24T15:17:31.613 INFO:tasks.workunit.client.0.smithi181.stderr:Note: switching to 'c089f21ba7ed78502aadcbf90668ca79817e877e'. 2021-02-24T15:17:31.614 INFO:tasks.workunit.client.0.smithi181.stderr: 2021-02-24T15:17:31.615 INFO:tasks.workunit.client.0.smithi181.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-02-24T15:17:31.615 INFO:tasks.workunit.client.0.smithi181.stderr:changes and commit them, and you can discard any commits you make in this 2021-02-24T15:17:31.616 INFO:tasks.workunit.client.0.smithi181.stderr:state without impacting any branches by switching back to a branch. 2021-02-24T15:17:31.616 INFO:tasks.workunit.client.0.smithi181.stderr: 2021-02-24T15:17:31.616 INFO:tasks.workunit.client.0.smithi181.stderr:If you want to create a new branch to retain commits you create, you may 2021-02-24T15:17:31.617 INFO:tasks.workunit.client.0.smithi181.stderr:do so (now or later) by using -c with the switch command. Example: 2021-02-24T15:17:31.618 INFO:tasks.workunit.client.0.smithi181.stderr: 2021-02-24T15:17:31.618 INFO:tasks.workunit.client.0.smithi181.stderr: git switch -c 2021-02-24T15:17:31.619 INFO:tasks.workunit.client.0.smithi181.stderr: 2021-02-24T15:17:31.619 INFO:tasks.workunit.client.0.smithi181.stderr:Or undo this operation with: 2021-02-24T15:17:31.620 INFO:tasks.workunit.client.0.smithi181.stderr: 2021-02-24T15:17:31.620 INFO:tasks.workunit.client.0.smithi181.stderr: git switch - 2021-02-24T15:17:31.620 INFO:tasks.workunit.client.0.smithi181.stderr: 2021-02-24T15:17:31.621 INFO:tasks.workunit.client.0.smithi181.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-02-24T15:17:31.621 INFO:tasks.workunit.client.0.smithi181.stderr: 2021-02-24T15:17:31.622 INFO:tasks.workunit.client.0.smithi181.stderr:HEAD is now at c089f21ba7 Merge branch 'cephadm-spec-config' of https://github.com/liewegas/ceph into wip-sage-testing-2021-02-23-1850 2021-02-24T15:17:31.624 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-02-24T15:17:31.644 INFO:tasks.workunit.client.0.smithi181.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-02-24T15:17:31.646 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-02-24T15:17:31.646 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-02-24T15:17:31.940 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-02-24T15:17:31.990 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-02-24T15:17:32.027 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-02-24T15:17:32.028 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-02-24T15:17:32.028 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-02-24T15:17:32.065 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-02-24T15:17:32.068 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2021-02-24T15:17:32.068 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-02-24T15:17:32.123 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2021-02-24T15:17:32.124 INFO:tasks.workunit:Running workunit rados/test.sh... 2021-02-24T15:17:32.125 DEBUG:teuthology.orchestra.run.smithi181:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c089f21ba7ed78502aadcbf90668ca79817e877e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2021-02-24T15:17:32.182 INFO:tasks.workunit.client.0.smithi181.stderr:+ parallel=1 2021-02-24T15:17:32.182 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' '' = --serial ']' 2021-02-24T15:17:32.182 INFO:tasks.workunit.client.0.smithi181.stderr:+ color= 2021-02-24T15:17:32.183 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' -t 1 ']' 2021-02-24T15:17:32.183 INFO:tasks.workunit.client.0.smithi181.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2021-02-24T15:17:32.183 INFO:tasks.workunit.client.0.smithi181.stderr:+ declare -A pids 2021-02-24T15:17:32.183 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.184 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.184 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_aio 2021-02-24T15:17:32.184 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_aio' 2021-02-24T15:17:32.184 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_aio 2021-02-24T15:17:32.184 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.190 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_aio 2021-02-24T15:17:32.190 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36709 2021-02-24T15:17:32.190 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_aio on pid 36709' 2021-02-24T15:17:32.191 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36709 2021-02-24T15:17:32.191 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.191 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2021-02-24T15:17:32.191 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.191 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_aio_pp 2021-02-24T15:17:32.192 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_aio_pp' 2021-02-24T15:17:32.192 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_aio_pp 2021-02-24T15:17:32.192 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.192 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_aio 2021-02-24T15:17:32.193 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_aio.log 2021-02-24T15:17:32.193 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_aio: /' 2021-02-24T15:17:32.193 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_aio_pp 2021-02-24T15:17:32.193 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36717 2021-02-24T15:17:32.193 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_aio_pp on pid 36717' 2021-02-24T15:17:32.194 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36717 2021-02-24T15:17:32.194 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.194 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2021-02-24T15:17:32.194 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.200 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_io 2021-02-24T15:17:32.201 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_io' 2021-02-24T15:17:32.201 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_io 2021-02-24T15:17:32.201 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.201 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_aio_pp 2021-02-24T15:17:32.202 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_aio_pp.log 2021-02-24T15:17:32.202 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_aio_pp: /' 2021-02-24T15:17:32.202 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_io 2021-02-24T15:17:32.202 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36725 2021-02-24T15:17:32.203 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_io on pid 36725' 2021-02-24T15:17:32.203 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36725 2021-02-24T15:17:32.203 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.203 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.203 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2021-02-24T15:17:32.204 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_io_pp 2021-02-24T15:17:32.204 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_io_pp' 2021-02-24T15:17:32.204 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_io_pp 2021-02-24T15:17:32.204 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.205 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_io 2021-02-24T15:17:32.205 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_io.log 2021-02-24T15:17:32.205 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_io: /' 2021-02-24T15:17:32.205 INFO:tasks.workunit.client.0.smithi181.stdout:test api_aio on pid 36709 2021-02-24T15:17:32.206 INFO:tasks.workunit.client.0.smithi181.stdout:test api_aio_pp on pid 36717 2021-02-24T15:17:32.206 INFO:tasks.workunit.client.0.smithi181.stdout:test api_io on pid 36725 2021-02-24T15:17:32.229 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_io_pp 2021-02-24T15:17:32.230 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36733 2021-02-24T15:17:32.230 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_io_pp on pid 36733' 2021-02-24T15:17:32.230 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36733 2021-02-24T15:17:32.231 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.244 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2021-02-24T15:17:32.245 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.245 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_asio 2021-02-24T15:17:32.246 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_asio' 2021-02-24T15:17:32.246 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_asio 2021-02-24T15:17:32.247 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.247 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_io_pp 2021-02-24T15:17:32.247 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_io_pp.log 2021-02-24T15:17:32.248 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_io_pp: /' 2021-02-24T15:17:32.248 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_asio 2021-02-24T15:17:32.249 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36741 2021-02-24T15:17:32.249 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_asio on pid 36741' 2021-02-24T15:17:32.250 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36741 2021-02-24T15:17:32.250 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.250 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.251 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2021-02-24T15:17:32.251 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_list 2021-02-24T15:17:32.252 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_list' 2021-02-24T15:17:32.252 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_list 2021-02-24T15:17:32.252 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.253 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_asio 2021-02-24T15:17:32.253 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_asio.log 2021-02-24T15:17:32.254 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_asio: /' 2021-02-24T15:17:32.254 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_list 2021-02-24T15:17:32.279 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36749 2021-02-24T15:17:32.280 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_list on pid 36749' 2021-02-24T15:17:32.280 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36749 2021-02-24T15:17:32.280 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.280 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2021-02-24T15:17:32.281 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.281 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_lock 2021-02-24T15:17:32.281 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_lock' 2021-02-24T15:17:32.281 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_lock 2021-02-24T15:17:32.281 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_list 2021-02-24T15:17:32.282 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_list.log 2021-02-24T15:17:32.282 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.282 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_list: /' 2021-02-24T15:17:32.282 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_lock 2021-02-24T15:17:32.282 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36757 2021-02-24T15:17:32.283 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_lock on pid 36757' 2021-02-24T15:17:32.283 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36757 2021-02-24T15:17:32.283 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.283 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.283 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2021-02-24T15:17:32.284 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_lock_pp 2021-02-24T15:17:32.284 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_lock_pp' 2021-02-24T15:17:32.284 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_lock_pp 2021-02-24T15:17:32.284 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.285 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_lock 2021-02-24T15:17:32.285 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_lock_pp 2021-02-24T15:17:32.285 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36765 2021-02-24T15:17:32.285 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_lock_pp on pid 36765' 2021-02-24T15:17:32.285 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36765 2021-02-24T15:17:32.286 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.286 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.286 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2021-02-24T15:17:32.286 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_lock_pp 2021-02-24T15:17:32.286 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_lock: /' 2021-02-24T15:17:32.287 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_lock.log 2021-02-24T15:17:32.287 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_misc 2021-02-24T15:17:32.287 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_lock_pp.log 2021-02-24T15:17:32.287 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_misc' 2021-02-24T15:17:32.288 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.288 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_misc 2021-02-24T15:17:32.288 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_misc 2021-02-24T15:17:32.288 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36794 2021-02-24T15:17:32.288 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_misc on pid 36794' 2021-02-24T15:17:32.289 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36794 2021-02-24T15:17:32.289 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.289 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.289 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_lock_pp: /' 2021-02-24T15:17:32.289 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2021-02-24T15:17:32.290 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_misc_pp 2021-02-24T15:17:32.290 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_misc_pp' 2021-02-24T15:17:32.310 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_misc 2021-02-24T15:17:32.311 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_misc_pp 2021-02-24T15:17:32.311 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.311 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_misc: /' 2021-02-24T15:17:32.311 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_misc_pp 2021-02-24T15:17:32.311 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36820 2021-02-24T15:17:32.312 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_misc_pp on pid 36820' 2021-02-24T15:17:32.312 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36820 2021-02-24T15:17:32.312 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.312 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.312 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_tier_pp 2021-02-24T15:17:32.313 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2021-02-24T15:17:32.313 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_tier_pp' 2021-02-24T15:17:32.313 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_tier_pp 2021-02-24T15:17:32.313 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_misc_pp.log 2021-02-24T15:17:32.314 INFO:tasks.workunit.client.0.smithi181.stdout:test api_io_pp on pid 36733 2021-02-24T15:17:32.314 INFO:tasks.workunit.client.0.smithi181.stdout:test api_asio on pid 36741 2021-02-24T15:17:32.314 INFO:tasks.workunit.client.0.smithi181.stdout:test api_list on pid 36749 2021-02-24T15:17:32.314 INFO:tasks.workunit.client.0.smithi181.stdout:test api_lock on pid 36757 2021-02-24T15:17:32.315 INFO:tasks.workunit.client.0.smithi181.stdout:test api_lock_pp on pid 36765 2021-02-24T15:17:32.315 INFO:tasks.workunit.client.0.smithi181.stdout:test api_misc on pid 36794 2021-02-24T15:17:32.315 INFO:tasks.workunit.client.0.smithi181.stdout:test api_misc_pp on pid 36820 2021-02-24T15:17:32.353 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.353 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_misc_pp: /' 2021-02-24T15:17:32.354 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_misc_pp 2021-02-24T15:17:32.354 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_tier_pp 2021-02-24T15:17:32.354 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36851 2021-02-24T15:17:32.354 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_tier_pp on pid 36851' 2021-02-24T15:17:32.355 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_misc.log 2021-02-24T15:17:32.355 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36851 2021-02-24T15:17:32.355 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.355 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.355 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_pool 2021-02-24T15:17:32.356 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_pool' 2021-02-24T15:17:32.356 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2021-02-24T15:17:32.356 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.356 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_tier_pp: /' 2021-02-24T15:17:32.356 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_tier_pp.log 2021-02-24T15:17:32.357 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_tier_pp 2021-02-24T15:17:32.357 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_pool 2021-02-24T15:17:32.357 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_pool 2021-02-24T15:17:32.357 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36880 2021-02-24T15:17:32.357 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_pool on pid 36880' 2021-02-24T15:17:32.358 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36880 2021-02-24T15:17:32.358 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.370 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.371 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_snapshots 2021-02-24T15:17:32.371 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2021-02-24T15:17:32.371 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_snapshots' 2021-02-24T15:17:32.371 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_pool 2021-02-24T15:17:32.372 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_pool: /' 2021-02-24T15:17:32.372 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_snapshots 2021-02-24T15:17:32.372 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.372 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_pool.log 2021-02-24T15:17:32.372 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_snapshots 2021-02-24T15:17:32.373 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36897 2021-02-24T15:17:32.373 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_snapshots on pid 36897' 2021-02-24T15:17:32.373 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36897 2021-02-24T15:17:32.373 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.374 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.374 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_snapshots_pp 2021-02-24T15:17:32.375 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_snapshots_pp' 2021-02-24T15:17:32.375 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2021-02-24T15:17:32.375 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.375 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_snapshots: /' 2021-02-24T15:17:32.376 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_snapshots 2021-02-24T15:17:32.376 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_snapshots_pp 2021-02-24T15:17:32.376 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_snapshots_pp 2021-02-24T15:17:32.376 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36920 2021-02-24T15:17:32.376 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_snapshots_pp on pid 36920' 2021-02-24T15:17:32.387 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36920 2021-02-24T15:17:32.387 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.387 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2021-02-24T15:17:32.388 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.388 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_stat 2021-02-24T15:17:32.389 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_stat' 2021-02-24T15:17:32.389 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_stat 2021-02-24T15:17:32.390 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.390 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_snapshots_pp: /' 2021-02-24T15:17:32.390 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_stat 2021-02-24T15:17:32.391 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2021-02-24T15:17:32.391 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36937 2021-02-24T15:17:32.391 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_stat on pid 36937' 2021-02-24T15:17:32.392 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36937 2021-02-24T15:17:32.392 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.392 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_snapshots_pp 2021-02-24T15:17:32.393 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.393 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_stat_pp 2021-02-24T15:17:32.394 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_stat_pp' 2021-02-24T15:17:32.394 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2021-02-24T15:17:32.395 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_stat: /' 2021-02-24T15:17:32.395 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_stat.log 2021-02-24T15:17:32.395 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_snapshots.log 2021-02-24T15:17:32.396 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_stat 2021-02-24T15:17:32.396 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.397 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_stat_pp 2021-02-24T15:17:32.405 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_stat_pp 2021-02-24T15:17:32.406 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36954 2021-02-24T15:17:32.406 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_stat_pp on pid 36954' 2021-02-24T15:17:32.406 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36954 2021-02-24T15:17:32.406 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.407 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.407 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_watch_notify 2021-02-24T15:17:32.407 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_watch_notify' 2021-02-24T15:17:32.407 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2021-02-24T15:17:32.407 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_stat_pp 2021-02-24T15:17:32.408 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_stat_pp: /' 2021-02-24T15:17:32.408 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_stat_pp.log 2021-02-24T15:17:32.408 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_watch_notify 2021-02-24T15:17:32.408 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.408 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_watch_notify 2021-02-24T15:17:32.409 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36991 2021-02-24T15:17:32.409 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_watch_notify on pid 36991' 2021-02-24T15:17:32.409 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=36991 2021-02-24T15:17:32.409 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.410 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.410 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_watch_notify_pp 2021-02-24T15:17:32.410 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_watch_notify_pp' 2021-02-24T15:17:32.410 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.410 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_watch_notify_pp 2021-02-24T15:17:32.411 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_watch_notify_pp 2021-02-24T15:17:32.411 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37009 2021-02-24T15:17:32.411 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_watch_notify_pp on pid 37009' 2021-02-24T15:17:32.411 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37009 2021-02-24T15:17:32.411 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.412 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.412 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_cmd 2021-02-24T15:17:32.412 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_cmd' 2021-02-24T15:17:32.412 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2021-02-24T15:17:32.412 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2021-02-24T15:17:32.413 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_watch_notify 2021-02-24T15:17:32.413 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_watch_notify: /' 2021-02-24T15:17:32.413 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_watch_notify_pp 2021-02-24T15:17:32.413 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_watch_notify.log 2021-02-24T15:17:32.414 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_cmd 2021-02-24T15:17:32.414 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.414 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_cmd 2021-02-24T15:17:32.414 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37056 2021-02-24T15:17:32.414 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_cmd on pid 37056' 2021-02-24T15:17:32.415 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37056 2021-02-24T15:17:32.415 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.415 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.415 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2021-02-24T15:17:32.415 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_cmd_pp 2021-02-24T15:17:32.416 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_cmd_pp' 2021-02-24T15:17:32.416 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_cmd_pp 2021-02-24T15:17:32.416 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.416 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2021-02-24T15:17:32.416 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2021-02-24T15:17:32.417 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_cmd: /' 2021-02-24T15:17:32.417 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_cmd_pp 2021-02-24T15:17:32.417 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_cmd 2021-02-24T15:17:32.417 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37080 2021-02-24T15:17:32.417 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_cmd_pp on pid 37080' 2021-02-24T15:17:32.418 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37080 2021-02-24T15:17:32.418 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.422 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.423 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_service 2021-02-24T15:17:32.423 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_service' 2021-02-24T15:17:32.423 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.424 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_service 2021-02-24T15:17:32.424 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_service 2021-02-24T15:17:32.425 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37095 2021-02-24T15:17:32.425 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_service on pid 37095' 2021-02-24T15:17:32.425 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37095 2021-02-24T15:17:32.426 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.426 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.427 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2021-02-24T15:17:32.427 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_cmd.log 2021-02-24T15:17:32.427 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_service.log 2021-02-24T15:17:32.428 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2021-02-24T15:17:32.428 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_cmd_pp 2021-02-24T15:17:32.429 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_cmd_pp: /' 2021-02-24T15:17:32.429 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_service 2021-02-24T15:17:32.429 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_service_pp 2021-02-24T15:17:32.430 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_service_pp' 2021-02-24T15:17:32.430 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.431 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_service_pp 2021-02-24T15:17:32.431 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2021-02-24T15:17:32.431 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_service: /' 2021-02-24T15:17:32.432 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_service_pp 2021-02-24T15:17:32.432 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37123 2021-02-24T15:17:32.433 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_service_pp on pid 37123' 2021-02-24T15:17:32.433 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37123 2021-02-24T15:17:32.433 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.434 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.434 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2021-02-24T15:17:32.435 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_c_write_operations 2021-02-24T15:17:32.435 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_service_pp 2021-02-24T15:17:32.436 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_c_write_operations' 2021-02-24T15:17:32.436 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_service_pp.log 2021-02-24T15:17:32.437 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_service_pp: /' 2021-02-24T15:17:32.437 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.437 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_c_write_operations 2021-02-24T15:17:32.438 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_c_write_operations 2021-02-24T15:17:32.438 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37152 2021-02-24T15:17:32.439 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_c_write_operations on pid 37152' 2021-02-24T15:17:32.439 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37152 2021-02-24T15:17:32.439 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2021-02-24T15:17:32.440 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.440 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.441 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_c_write_operations 2021-02-24T15:17:32.441 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s api_c_read_operations 2021-02-24T15:17:32.441 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' api_c_read_operations' 2021-02-24T15:17:32.441 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_c_write_operations: /' 2021-02-24T15:17:32.441 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo api_c_read_operations 2021-02-24T15:17:32.442 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.442 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2021-02-24T15:17:32.442 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=api_c_read_operations 2021-02-24T15:17:32.442 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37179 2021-02-24T15:17:32.442 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test api_c_read_operations on pid 37179' 2021-02-24T15:17:32.443 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37179 2021-02-24T15:17:32.443 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.443 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.443 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2021-02-24T15:17:32.444 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s list_parallel 2021-02-24T15:17:32.444 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' list_parallel' 2021-02-24T15:17:32.444 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo list_parallel 2021-02-24T15:17:32.444 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_api_c_read_operations 2021-02-24T15:17:32.444 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2021-02-24T15:17:32.445 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.445 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ api_c_read_operations: /' 2021-02-24T15:17:32.445 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=list_parallel 2021-02-24T15:17:32.445 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37202 2021-02-24T15:17:32.445 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test list_parallel on pid 37202' 2021-02-24T15:17:32.446 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37202 2021-02-24T15:17:32.446 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.446 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.446 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2021-02-24T15:17:32.447 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s open_pools_parallel 2021-02-24T15:17:32.447 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' open_pools_parallel' 2021-02-24T15:17:32.447 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo open_pools_parallel 2021-02-24T15:17:32.447 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.447 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_list_parallel 2021-02-24T15:17:32.448 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ list_parallel: /' 2021-02-24T15:17:32.448 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=open_pools_parallel 2021-02-24T15:17:32.448 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37221 2021-02-24T15:17:32.448 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test open_pools_parallel on pid 37221' 2021-02-24T15:17:32.449 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37221 2021-02-24T15:17:32.449 INFO:tasks.workunit.client.0.smithi181.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-02-24T15:17:32.449 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.449 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_list_parallel.log 2021-02-24T15:17:32.450 INFO:tasks.workunit.client.0.smithi181.stderr:++ printf %25s delete_pools_parallel 2021-02-24T15:17:32.450 INFO:tasks.workunit.client.0.smithi181.stderr:+ r=' delete_pools_parallel' 2021-02-24T15:17:32.450 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2021-02-24T15:17:32.450 INFO:tasks.workunit.client.0.smithi181.stderr:++ awk '{print $1}' 2021-02-24T15:17:32.451 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ open_pools_parallel: /' 2021-02-24T15:17:32.451 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2021-02-24T15:17:32.451 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_open_pools_parallel 2021-02-24T15:17:32.451 INFO:tasks.workunit.client.0.smithi181.stderr:++ echo delete_pools_parallel 2021-02-24T15:17:32.451 INFO:tasks.workunit.client.0.smithi181.stderr:+ ff=delete_pools_parallel 2021-02-24T15:17:32.452 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37250 2021-02-24T15:17:32.452 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'test delete_pools_parallel on pid 37250' 2021-02-24T15:17:32.452 INFO:tasks.workunit.client.0.smithi181.stderr:+ pids[$f]=37250 2021-02-24T15:17:32.452 INFO:tasks.workunit.client.0.smithi181.stderr:+ ret=0 2021-02-24T15:17:32.452 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' 1 -eq 1 ']' 2021-02-24T15:17:32.453 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:17:32.453 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36897 2021-02-24T15:17:32.453 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36897 2021-02-24T15:17:32.453 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2021-02-24T15:17:32.454 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [----------] Global test environment set-up. 2021-02-24T15:17:32.454 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [----------] 12 tests from AsioRados 2021-02-24T15:17:32.454 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.225+0000 7f696bf02540 1 Processor -- start 2021-02-24T15:17:32.454 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.225+0000 7f696bf02540 1 -- start start 2021-02-24T15:17:32.454 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.226+0000 7f696bf02540 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x557ca171a830 con 0x557ca1719650 2021-02-24T15:17:32.455 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.226+0000 7f696bf02540 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x557ca1749d00 con 0x557ca17e27e0 2021-02-24T15:17:32.455 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.226+0000 7f696bf02540 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x557ca1745450 con 0x557ca1719c70 2021-02-24T15:17:32.455 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.226+0000 7f695b9f8700 1 -- >> v1:172.21.15.181:6789/0 conn(0x557ca17e27e0 legacy=0x557ca17f43b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.455 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.226+0000 7f695b1f7700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x557ca1719650 0x557ca17d91a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.181:45734/0 (socket says 172.21.15.181:45734) 2021-02-24T15:17:32.455 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.226+0000 7f695b1f7700 1 -- 172.21.15.181:0/1897261799 learned_addr learned my addr 172.21.15.181:0/1897261799 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:17:32.456 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.229+0000 7f695b1f7700 1 -- 172.21.15.181:0/1897261799 >> v1:172.21.15.152:6789/0 conn(0x557ca1719650 legacy=0x557ca17d91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:17:32.456 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.229+0000 7f695a9f6700 1 -- 172.21.15.181:0/1897261799 >> v1:172.21.15.152:6790/0 conn(0x557ca1719c70 legacy=0x557ca17f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:17:32.456 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.231+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370226714 0 0) 0x557ca171a830 con 0x557ca1719650 2021-02-24T15:17:32.456 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.231+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6948001dd0 con 0x557ca1719650 2021-02-24T15:17:32.457 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.231+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540051694 0 0) 0x557ca1745450 con 0x557ca1719c70 2021-02-24T15:17:32.457 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.231+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x557ca171a830 con 0x557ca1719c70 2021-02-24T15:17:32.457 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.231+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1160577186 0 0) 0x557ca171a830 con 0x557ca1719c70 2021-02-24T15:17:32.457 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.231+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 >> v1:172.21.15.181:6789/0 conn(0x557ca17e27e0 legacy=0x557ca17f43b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.457 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.231+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 >> v1:172.21.15.152:6789/0 conn(0x557ca1719650 legacy=0x557ca17d91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:17:32.458 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.231+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ca1748f40 con 0x557ca1719c70 2021-02-24T15:17:32.458 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.231+0000 7f69599f4700 1 -- 172test api_tier_pp on pid 36851 2021-02-24T15:17:32.458 INFO:tasks.workunit.client.0.smithi181.stdout:test api_pool on pid 36880 2021-02-24T15:17:32.458 INFO:tasks.workunit.client.0.smithi181.stdout:.21.15.181:0/1897261799 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f694c002a70 con 0x557ca1719c70 2021-02-24T15:17:32.459 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.232+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f694c002d80 con 0x557ca1719c70 2021-02-24T15:17:32.459 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.232+0000 7f69599f4700 1 -- 172.21.15.181:0/1897261799 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f694c003090 con 0x557ca1719c70 2021-02-24T15:17:32.459 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.233+0000 7f696bf02540 1 -- 172.21.15.181:0/1897261799 >> v1:172.21.15.152:6790/0 conn(0x557ca1719c70 legacy=0x557ca17f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:17:32.459 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.233+0000 7f696bf02540 1 -- 172.21.15.181:0/1897261799 shutdown_connections 2021-02-24T15:17:32.461 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.233+0000 7f696bf02540 1 -- 172.21.15.181:0/1897261799 >> 172.21.15.181:0/1897261799 conn(0x557ca17160d0 msgr2=0x557ca17493f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:17:32.461 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.233+0000 7f696bf02540 1 -- 172.21.15.181:0/1897261799 shutdown_connections 2021-02-24T15:17:32.461 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.233+0000 7f696bf02540 1 -- 172.21.15.181:0/1897261799 wait complete. 2021-02-24T15:17:32.461 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.233+0000 7f696bf02540 1 librados: starting msgr at 2021-02-24T15:17:32.461 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.233+0000 7f696bf02540 1 librados: starting objecter 2021-02-24T15:17:32.462 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.233+0000 7f696bf02540 1 Processor -- start 2021-02-24T15:17:32.462 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.234+0000 7f696bf02540 1 -- start start 2021-02-24T15:17:32.463 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.234+0000 7f696bf02540 1 librados: setting wanted keys 2021-02-24T15:17:32.463 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.234+0000 7f696bf02540 1 librados: calling monclient init 2021-02-24T15:17:32.463 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.234+0000 7f696bf02540 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x557ca17e19b0 con 0x557ca1719650 2021-02-24T15:17:32.464 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.234+0000 7f696bf02540 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x557ca17e0960 con 0x557ca1719c70 2021-02-24T15:17:32.464 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.234+0000 7f696bf02540 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x557ca174a900 con 0x557ca17e27e0 2021-02-24T15:17:32.465 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.234+0000 7f695a9f6700 1 -- >> v1:172.21.15.181:6789/0 conn(0x557ca1719c70 legacy=0x557ca17f8600 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.465 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.234+0000 7f695b1f7700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x557ca1719650 0x557ca17d91a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.181:45768/0 (socket says 172.21.15.181:45768) 2021-02-24T15:17:32.465 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.235+0000 7f695b1f7700 1 -- 172.21.15.181:0/1227290393 learned_addr learned my addr 172.21.15.181:0/1227290393 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:17:32.466 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.237+0000 7f695b1f7700 1 -- 172.21.15.181:0/1227290393 >> v1:172.21.15.152:6789/0 conn(0x557ca1719650 legacy=0x557ca17d91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:17:32.466 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.237+0000 7f695b9f8700 1 -- 172.21.15.181:0/1227290393 >> v1:172.21.15.152:6790/0 conn(0x557ca17e27e0 legacy=0x557ca17fbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:17:32.466 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.239+0000 7f6943fff700 10 client.?.objecter ms_handle_connect 0x557ca1719650 2021-02-24T15:17:32.467 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.240+0000 7f6943fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:17:32.467 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.240+000test api_snapshots on pid 36897 2021-02-24T15:17:32.467 INFO:tasks.workunit.client.0.smithi181.stdout:0 7f6943fff700 10 client.?.objecter ms_handle_connect 0x557ca17e27e0 2021-02-24T15:17:32.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.240+0000 7f6943fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:17:32.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.240+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527831347 0 0) 0x557ca174a900 con 0x557ca17e27e0 2021-02-24T15:17:32.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.240+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69480021a0 con 0x557ca17e27e0 2021-02-24T15:17:32.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.240+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2045145692 0 0) 0x7f69480021a0 con 0x557ca17e27e0 2021-02-24T15:17:32.469 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.240+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x557ca174a900 con 0x557ca17e27e0 2021-02-24T15:17:32.469 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.240+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6950001930 con 0x557ca17e27e0 2021-02-24T15:17:32.469 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 170110524 0 0) 0x557ca174a900 con 0x557ca17e27e0 2021-02-24T15:17:32.469 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 >> v1:172.21.15.181:6789/0 conn(0x557ca1719c70 legacy=0x557ca17f8600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:17:32.469 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 >> v1:172.21.15.152:6789/0 conn(0x557ca1719650 legacy=0x557ca17d91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:17:32.470 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ca17dc430 con 0x557ca17e27e0 2021-02-24T15:17:32.470 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ca17e04b0 con 0x557ca17e27e0 2021-02-24T15:17:32.470 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f696bf02540 10 client.4436.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:17:32.470 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x557ca17f06e0 con 0x557ca17e27e0 2021-02-24T15:17:32.470 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f696bf02540 1 librados: init done 2021-02-24T15:17:32.471 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f696bf02540 10 librados: wait_for_osdmap waiting 2021-02-24T15:17:32.471 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f69500038e0 con 0x557ca17e27e0 2021-02-24T15:17:32.471 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.244+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6950003bf0 con 0x557ca17e27e0 2021-02-24T15:17:32.471 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f695000c6f0 con 0x557ca17e27e0 2021-02-24T15:17:32.472 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3549+0+0 (unknown 3730994235 0 0) 0x7f6950039570 con 0x557ca17e27e0 2021-02-24T15:17:32.472 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f6943fff700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_map(15..15 src has 1..15) v4 2021-02-24T15:17:32.472 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-0test api_snapshots_pp on pid 36920 2021-02-24T15:17:32.472 INFO:tasks.workunit.client.0.smithi181.stdout:test api_stat on pid 36937 2021-02-24T15:17:32.472 INFO:tasks.workunit.client.0.smithi181.stdout:test api_stat_pp on pid 36954 2021-02-24T15:17:32.473 INFO:tasks.workunit.client.0.smithi181.stdout:test api_watch_notify on pid 36991 2021-02-24T15:17:32.473 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [==========] Running 11 tests from 4 test suites. 2021-02-24T15:17:32.473 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] Global test environment set-up. 2021-02-24T15:17:32.475 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2021-02-24T15:17:32.475 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2021-02-24T15:17:32.476 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2021-02-24T15:17:32.476 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-02-24T15:17:32.476 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.476 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure 2021-02-24T15:17:32.477 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2021-02-24T15:17:32.477 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 0 2021-02-24T15:17:32.477 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.278+0000 7fb5acdfe540 10 monclient: get_monmap_and_config 2021-02-24T15:17:32.477 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.278+0000 7fb5acdfe540 10 monclient: build_initial_monmap 2021-02-24T15:17:32.478 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.278+0000 7fb5acdfe540 10 monclient: monmap: 2021-02-24T15:17:32.478 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: epoch 0 2021-02-24T15:17:32.479 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: fsid d54e238b-89a2-4d0f-9dd4-1a64625c33b0 2021-02-24T15:17:32.485 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: last_changed 2021-02-24T15:17:32.278937+0000 2021-02-24T15:17:32.485 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: created 2021-02-24T15:17:32.278937+0000 2021-02-24T15:17:32.485 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: min_mon_release 0 (unknown) 2021-02-24T15:17:32.486 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: election_strategy: 1 2021-02-24T15:17:32.486 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 0: v1:172.21.15.152:6789/0 mon.noname-a 2021-02-24T15:17:32.486 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 1: v1:172.21.15.181:6789/0 mon.noname-c 2021-02-24T15:17:32.486 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2: v1:172.21.15.152:6790/0 mon.noname-b 2021-02-24T15:17:32.487 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.487 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 1 Processor -- start 2021-02-24T15:17:32.487 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 1 -- start start 2021-02-24T15:17:32.487 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.487 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.488 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[0,2,1] 2021-02-24T15:17:32.488 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-a con 0x55fdfab51830 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:32.488 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:32.488 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab24100 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.488 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfab51830 2021-02-24T15:17:32.489 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab24100 2021-02-24T15:17:32.489 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:32.489 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:32.489 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.710839s 2021-02-24T15:17:32.489 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:32.490 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:32.490 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:32.490 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 1 -- >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfabfdc90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-24T15:17:32.490 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb5acdfe540 1 -- >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac013c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-24T15:17:32.491 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.283+0000 7fb596d9d700 test api_watch_notify_pp on pid 37009 2021-02-24T15:17:32.491 INFO:tasks.workunit.client.0.smithi181.stdout:1 -- >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac013c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.491 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.284+0000 7fb59659c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x55fdfab51830 0x55fdfab51c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.181:45832/0 (socket says 172.21.15.181:45832) 2021-02-24T15:17:32.491 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.284+0000 7fb59659c700 1 -- 172.21.15.181:0/1052788466 learned_addr learned my addr 172.21.15.181:0/1052788466 (peer_addr_for_me v1:172.21.15.181:0/0) 2021-02-24T15:17:32.491 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.284+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfab51830 legacy=0x55fdfab51c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.492 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.284+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.492 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.492 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[2,1,0] 2021-02-24T15:17:32.492 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:32.493 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab24100 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.493 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-a con 0x55fdfab51830 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:32.493 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfab51830 2021-02-24T15:17:32.493 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab24100 2021-02-24T15:17:32.493 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:32.494 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:32.494 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.713641s 2021-02-24T15:17:32.494 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb595d9b700 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac29910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.494 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:32.495 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:32.495 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:32.495 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfac29200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.495 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac29910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.495 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfab51830 legacy=0x55fdfab51c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.496 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.286+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.496 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.496 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[2,0,1] 2021-02-24T15:17:32.496 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:32.496 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-a con 0x55fdfab51830 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:32.497 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab24100 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.497 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfab51830 2021-02-24T15:17:32.497 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab24100 2021-02-24T15:17:32.497 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:32.498 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:32.498 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.714647s 2021-02-24T15:17:32.498 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb596d9d700 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac01d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.498 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:32.498 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:32.499 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:32.499 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfac03880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.499 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac01d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.500 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.287+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfab51830 legacy=0x55fdfab51c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.500 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.500 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.500 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[0,1,2] 2021-02-24T15:17:32.500 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-a con 0x55fdfab51830 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:32.501 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab24100 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.501 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:32.501 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfab51830 2021-02-24T15:17:32.501 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab24100 2021-02-24T15:17:32.501 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:32.502 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:32.502 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.288+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.715710s 2021-02-24T15:17:32.502 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.289+0000 7fb595d9b700 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac01d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.502 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.289+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:32.503 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.289+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:32.503 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.289+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:32.503 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.289+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfac03880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.503 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.289+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac01d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.503 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.289+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfab51830 legacy=0x55fdfab51c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.504 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.291+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.504 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.504 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[2,1,0] 2021-02-24T15:17:32.504 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:32.504 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab24100 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.505 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-a con 0x55fdfab51830 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:32.505 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfab51830 2021-02-24T15:17:32.505 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab24100 2021-02-24T15:17:32.505 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:32.506 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:32.506 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.719583s 2021-02-24T15:17:32.506 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:32.506 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:32.506 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:32.507 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfac03880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-24T15:17:32.507 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac01d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.507 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb595d9b700 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac01d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.507 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfab51830 legacy=0x55fdfab51c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.507 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.292+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.508 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.508 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[2,0,1] 2021-02-24T15:17:32.508 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:32.508 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-a con 0x55fdfab51830 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:32.508 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab24100 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.509 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfab51830 2021-02-24T15:17:32.509 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab24100 2021-02-24T15:17:32.509 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:32.509 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:32.509 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.720164s 2021-02-24T15:17:32.510 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb596d9d700 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac01d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.510 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:32.510 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:32.510 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:32.511 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfac298a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-24T15:17:32.511 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab24100 legacy=0x55fdfac01d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.511 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfab51830 legacy=0x55fdfab51c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.511 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.511 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.512 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[2,1,0] 2021-02-24T15:17:32.512 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:32.512 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab55810 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.512 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-a con 0x55fdfab51830 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:32.512 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:test api_cmd on pid 37056 2021-02-24T15:17:32.513 INFO:tasks.workunit.client.0.smithi181.stdout:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfab51830 2021-02-24T15:17:32.513 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab55810 2021-02-24T15:17:32.513 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:32.513 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:32.514 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.720818s 2021-02-24T15:17:32.514 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb595d9b700 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab55810 legacy=0x55fdfac04d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.542 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:32.543 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:32.543 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:32.544 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfac298a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-24T15:17:32.544 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab55810 legacy=0x55fdfac04d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.544 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.293+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfab51830 legacy=0x55fdfab51c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.545 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.545 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.546 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[0,1,2] 2021-02-24T15:17:32.546 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-a con 0x55fdfab51830 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:32.547 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab55810 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.547 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:32.547 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfab51830 2021-02-24T15:17:32.548 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab55810 2021-02-24T15:17:32.548 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:32.548 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:32.549 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.721678s 2021-02-24T15:17:32.549 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:32.549 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:32.549 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:32.550 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfac298a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.550 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab55810 legacy=0x55fdfab29810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.550 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb595d9b700 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab55810 legacy=0x55fdfab29810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:32.550 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfab51830 legacy=0x55fdfab51c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:32.550 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.294+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.551 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.551 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[1,2,0] 2021-02-24T15:17:32.551 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab55810 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.551 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:32.551 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-a con 0x55fdfac05c00 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:32.552 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfac05c00 2021-02-24T15:17:32.552 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab55810 2021-02-24T15:17:32.552 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:32.552 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:32.553 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.722287s 2021-02-24T15:17:32.553 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:32.553 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:32.553 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:32.553 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfac04890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-24T15:17:32.554 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab55810 legacy=0x55fdfac01380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.554 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfac05c00 legacy=0x55fdfab29810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:32.554 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient: init 2021-02-24T15:17:32.554 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.295+0000 7fb5acdfe540 10 monclient: _reopen_session rank -1 2021-02-24T15:17:32.555 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 10 monclient: _add_conns ranks=[1,0,2] 2021-02-24T15:17:32.555 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-c con 0x55fdfab55810 addr v1:172.21.15.181:6789/0 2021-02-24T15:17:32.555 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdftest api_cmd_pp on pid 37080 2021-02-24T15:17:32.555 INFO:tasks.workunit.client.0.smithi181.stdout:test api_service on pid 37095 2021-02-24T15:17:32.555 INFO:tasks.workunit.client.0.smithi181.stdout:test api_service_pp on pid 37123 2021-02-24T15:17:32.556 INFO:tasks.workunit.client.0.smithi181.stdout:test api_c_write_operations on pid 37152 2021-02-24T15:17:32.556 INFO:tasks.workunit.client.0.smithi181.stdout:test api_c_read_operations on pid 37179 2021-02-24T15:17:32.556 INFO:tasks.workunit.client.0.smithi181.stdout:test list_parallel on pid 37202 2021-02-24T15:17:32.556 INFO:tasks.workunit.client.0.smithi181.stdout:test open_pools_parallel on pid 37221 2021-02-24T15:17:32.556 INFO:tasks.workunit.client.0.smithi181.stdout:test delete_pools_parallel on pid 37250 2021-02-24T15:17:32.557 INFO:tasks.workunit.client.0.smithi181.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2021-02-24T15:17:32.558 INFO:tasks.workunit.client.0.smithi181.stderr:+ sed 's/^/ delete_pools_parallel: /' 2021-02-24T15:17:32.558 INFO:tasks.workunit.client.0.smithi181.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2021-02-24T15:17:32.559 INFO:tasks.workunit.client.0.smithi181.stderr:+ ceph_test_rados_delete_pools_parallel 2021-02-24T15:17:33.084 INFO:tasks.workunit.client.0.smithi181.stdout:2-24T15:17:32.245+0000 7f6943fff700 3 client.4436.objecter handle_osd_map got epochs [15,15] > 0 2021-02-24T15:17:33.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f6943fff700 3 client.4436.objecter handle_osd_map decoding full epoch 15 2021-02-24T15:17:33.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f6943fff700 20 client.4436.objecter dump_active .. 0 homeless 2021-02-24T15:17:33.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f696bf02540 10 librados: wait_for_osdmap done waiting 2021-02-24T15:17:33.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6950001c40 con 0x557ca17e27e0 2021-02-24T15:17:33.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f6950011410 con 0x557ca17e27e0 2021-02-24T15:17:33.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f69591f3700 10 client.4436.objecter _get_latest_version latest 15, have it 2021-02-24T15:17:33.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f696bf02540 10 client.4436.objecter create_pool name=ceph_test_rados_api_asio 2021-02-24T15:17:33.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f696bf02540 10 client.4436.objecter pool_op_submit 1 2021-02-24T15:17:33.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.245+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6790/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x557ca16b13a0 con 0x557ca17e27e0 2021-02-24T15:17:33.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:32.247+0000 7f6943fff700 10 client.4436.objecter ms_handle_connect 0x7f694802fc20 2021-02-24T15:17:33.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.076+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 10 ==== pool_op_reply(tid 1 (0) Success v16) v1 ==== 43+0+0 (unknown 478828390 0 0) 0x7f69500111e0 con 0x557ca17e27e0 2021-02-24T15:17:33.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.076+0000 7f6943fff700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 pool_op_reply(tid 1 (0) Success v16) v1 2021-02-24T15:17:33.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.076+0000 7f6943fff700 10 client.4436.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v16) v1 2021-02-24T15:17:33.088 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.076+0000 7f6943fff700 10 client.4436.objecter have request 1 at 0x557ca17e06a0 Op: create 2021-02-24T15:17:33.088 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.076+0000 7f6943fff700 20 client.4436.objecter waiting for client to reach epoch 16 before calling back 2021-02-24T15:17:33.088 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.076+0000 7f6943fff700 10 client.4436.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:17:33.088 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.076+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=16}) v3 -- 0x557ca174a900 con 0x557ca17e27e0 2021-02-24T15:17:33.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.076+0000 7f6943fff700 10 client.4436.objecter done 2021-02-24T15:17:33.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.081+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== mon.2 v1:172.21.15.152:6790/0 11 ==== osd_map(16..16 src has 1..16) v4 ==== 8744+0+0 (unknown 2200158153 0 0) 0x7f6950011640 con 0x557ca17e27e0 2021-02-24T15:17:33.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f6943fff700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_map(16..16 src has 1..16) v4 2021-02-24T15:17:33.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f6943fff700 3 client.4436.objecter handle_osd_map got epochs [16,16] > 15 2021-02-24T15:17:33.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f6943fff700 3 client.4436.objecter handle_osd_map decoding incremental epoch 16 2021-02-24T15:17:33.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f6943fff700 20 client.4436.objecter dump_active .. 0 homeless 2021-02-24T15:17:33.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 10 librados: set snap read head -> 1 2021-02-24T15:17:33.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 10 librados: writefull oid=exist nspace= 2021-02-24T15:17:34.345 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17dedf0 2021-02-24T15:17:34.345 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 16 base exist @5 precalc_pgid 0 pgid 0.0 is_write 2021-02-24T15:17:34.345 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.346 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.346 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.346 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [writefull 0~5 in=5b] tid 2 osd.1 2021-02-24T15:17:34.346 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.346 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 2 2021-02-24T15:17:34.347 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 15 client.4436.objecter _send_op 2 to 5.1 on osd.1 2021-02-24T15:17:34.347 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:2 5.1 5:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected e16) v8 -- 0x557ca17c88f0 con 0x557ca17c4de0 2021-02-24T15:17:34.347 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.347 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.082+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.348 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:33.090+0000 7f6943fff700 10 client.4436.objecter ms_handle_connect 0x557ca17c4de0 2021-02-24T15:17:34.348 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.290+0000 7f6943fff700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 1 ==== osd_map(17..17 src has 1..17) v4 ==== 8543+0+0 (unknown 714338334 0 0) 0x7f694c002ef0 con 0x557ca17c4de0 2021-02-24T15:17:34.348 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.290+0000 7f6943fff700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_map(17..17 src has 1..17) v4 2021-02-24T15:17:34.348 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.290+0000 7f6943fff700 3 client.4436.objecter handle_osd_map got epochs [17,17] > 16 2021-02-24T15:17:34.348 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.290+0000 7f6943fff700 3 client.4436.objecter handle_osd_map decoding incremental epoch 17 2021-02-24T15:17:34.349 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.290+0000 7f6943fff700 10 client.4436.objecter checking op 2 2021-02-24T15:17:34.349 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.290+0000 7f6943fff700 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_write 2021-02-24T15:17:34.349 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.290+0000 7f6943fff700 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.349 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.290+0000 7f6943fff700 20 client.4436.objecter dump_active .. 0 homeless 2021-02-24T15:17:34.349 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.290+0000 7f6943fff700 20 client.4436.objecter 2 5.d3a59201 osd.1 exist [writefull 0~5 in=5b] 2021-02-24T15:17:34.350 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 2 ==== osd_op_reply(2 exist [writefull 0~5] v17'1 uv1 ondisk = 0) v8 ==== 149+0+0 (unknown 2489814116 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.350 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(2 exist [writefull 0~5] v17'1 uv1 ondisk = 0) v8 2021-02-24T15:17:34.351 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.351 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2021-02-24T15:17:34.352 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 2 ondisk uv 1 in 5.1 attempt 0 2021-02-24T15:17:34.352 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.352 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 2 2021-02-24T15:17:34.352 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 15 client.4436.objecter _finish_op 2 2021-02-24T15:17:34.352 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.353 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 2 2021-02-24T15:17:34.353 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.353 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 10 librados: Objecter returned from writefull r=0 2021-02-24T15:17:34.353 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17dedf0 2021-02-24T15:17:34.353 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.354 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.354 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.354 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.354 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [read 0~256] tid 3 osd.1 2021-02-24T15:17:34.355 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.355 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 3 2021-02-24T15:17:34.355 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 15 client.4436.objecter _send_op 3 to 5.1 on osd.1 2021-02-24T15:17:34.355 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:3 5.1 5:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17c38c0 con 0x557ca17c4de0 2021-02-24T15:17:34.355 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.356 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.356 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17c3cb0 2021-02-24T15:17:34.356 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base noexist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.356 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter _calc_target target noexist @5 -> pgid 5.a7bbaa1 2021-02-24T15:17:34.356 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.a7bbaa1 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.357 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.357 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 10 client.4436.objecter _op_submit oid noexist '@5' '@5' [read 0~256] tid 4 osd.1 2021-02-24T15:17:34.357 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.357 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 4 2021-02-24T15:17:34.358 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 15 client.4436.objecter _send_op 4 to 5.1 on osd.1 2021-02-24T15:17:34.358 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:4 5.1 5:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17c41a0 con 0x557ca17c4de0 2021-02-24T15:17:34.367 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.380 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.343+0000 7f696bf02540 5 client.4436.objecter 2 in flight 2021-02-24T15:17:34.381 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (unknown 620176411 0 3741568377) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.381 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2021-02-24T15:17:34.381 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.382 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 3 ondisk uv 1 in 5.1 attempt 0 2021-02-24T15:17:34.392 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 5 2021-02-24T15:17:34.393 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 3 2021-02-24T15:17:34.394 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 15 client.4436.objecter _finish_op 3 2021-02-24T15:17:34.394 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.394 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 3 2021-02-24T15:17:34.395 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.395 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 4 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (unknown 3006058690 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.410 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2021-02-24T15:17:34.411 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.411 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 4 ondisk uv 0 in 5.1 attempt 0 2021-02-24T15:17:34.411 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 10 client.4436.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2021-02-24T15:17:34.412 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.412 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 4 2021-02-24T15:17:34.412 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 15 client.4436.objecter _finish_op 4 2021-02-24T15:17:34.413 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.414 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 4 2021-02-24T15:17:34.414 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.415 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (2 ms) 2021-02-24T15:17:34.416 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2021-02-24T15:17:34.416 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17c3cb0 2021-02-24T15:17:34.416 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.417 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.418 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.418 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.419 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [read 0~256] tid 5 osd.1 2021-02-24T15:17:34.419 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.420 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 5 2021-02-24T15:17:34.421 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 15 client.4436.objecter _send_op 5 to 5.1 on osd.1 2021-02-24T15:17:34.421 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:5 5.1 5:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17dedf0 con 0x557ca17c4de0 2021-02-24T15:17:34.422 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.422 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.422 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17c8ca0 2021-02-24T15:17:34.423 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base noexist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.424 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter _calc_target target noexist @5 -> pgid 5.a7bbaa1 2021-02-24T15:17:34.425 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.a7bbaa1 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.426 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.426 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 10 client.4436.objecter _op_submit oid noexist '@5' '@5' [read 0~256] tid 6 osd.1 2021-02-24T15:17:34.428 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.431 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 6 2021-02-24T15:17:34.432 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 15 client.4436.objecter _send_op 6 to 5.1 on osd.1 2021-02-24T15:17:34.432 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:6 5.1 5:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17c9190 con 0x557ca17c4de0 2021-02-24T15:17:34.432 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.433 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.345+0000 7f696bf02540 5 client.4436.objecter 2 in flight 2021-02-24T15:17:34.433 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (unknown 620176411 0 3741568377) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.433 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2021-02-24T15:17:34.434 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2021-02-24T15:17:34.445 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.446 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2021-02-24T15:17:34.446 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 5 ondisk uv 1 in 5.1 attempt 0 2021-02-24T15:17:34.448 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 5 2021-02-24T15:17:34.448 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 5 2021-02-24T15:17:34.448 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 15 client.4436.objecter _finish_op 5 2021-02-24T15:17:34.449 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.450 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 5 2021-02-24T15:17:34.450 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.450 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 6 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (unknown 3006058690 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.451 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2021-02-24T15:17:34.451 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 6 ondisk uv 0 in 5.1 attempt 0 2021-02-24T15:17:34.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 10 client.4436.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2021-02-24T15:17:34.469 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.469 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 6 2021-02-24T15:17:34.469 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 15 client.4436.objecter _finish_op 6 2021-02-24T15:17:34.470 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.470 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 6 2021-02-24T15:17:34.470 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.471 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17c8ca0 2021-02-24T15:17:34.471 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.471 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.472 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.472 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.472 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [read 0~256] tid 7 osd.1 2021-02-24T15:17:34.472 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.473 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 7 2021-02-24T15:17:34.473 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 15 client.4436.objecter _send_op 7 to 5.1 on osd.1 2021-02-24T15:17:34.473 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:7 5.1 5:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17c3cb0 con 0x557ca17c4de0 2021-02-24T15:17:34.474 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.474 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.474 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17c9c20 2021-02-24T15:17:34.475 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base noexist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.475 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter _calc_target target noexist @5 -> pgid 5.a7bbaa1 2021-02-24T15:17:34.489 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.a7bbaa1 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.490 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.490 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 10 client.4436.objecter _op_submit oid noexist '@5' '@5' [read 0~256] tid 8 osd.1 2021-02-24T15:17:34.490 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.491 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 8 2021-02-24T15:17:34.491 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 15 client.4436.objecter _send_op 8 to 5.1 on osd.1 2021-02-24T15:17:34.491 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:8 5.1 5:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17ca150 con 0x557ca17c4de0 2021-02-24T15:17:34.491 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.492 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.346+0000 7f696bf02540 5 client.4436.objecter 2 in flight 2021-02-24T15:17:34.492 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (unknown 620176411 0 3741568377) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.492 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2021-02-24T15:17:34.493 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.493 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 7 ondisk uv 1 in 5.1 attempt 0 2021-02-24T15:17:34.493 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 5 2021-02-24T15:17:34.494 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 7 2021-02-24T15:17:34.494 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 15 client.4436.objecter _finish_op 7 2021-02-24T15:17:34.494 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.495 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 7 2021-02-24T15:17:34.495 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.495 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 8 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (unknown 3006058690 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.496 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2021-02-24T15:17:34.496 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.496 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 8 ondisk uv 0 in 5.1 attempt 0 2021-02-24T15:17:34.496 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 10 client.4436.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2021-02-24T15:17:34.497 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.497 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 8 2021-02-24T15:17:34.506 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield2021-02-24T15:17:34.347+0000 7f695a9f6700 15 client.4436.objecter _finish_op 8 (2 ms) 2021-02-24T15:17:34.507 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2021-02-24T15:17:34.507 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.507 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.508 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 8 2021-02-24T15:17:34.508 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.509 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2021-02-24T15:17:34.509 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 20 librados: queue_aio_write 0x557ca16be090 completion 0x557ca17c8ca0 write_seq 1 2021-02-24T15:17:34.509 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17c95b0 2021-02-24T15:17:34.511 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_write 2021-02-24T15:17:34.511 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.511 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.512 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.512 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [write 0~5 in=5b] tid 9 osd.1 2021-02-24T15:17:34.512 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.513 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 9 2021-02-24T15:17:34.513 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 15 client.4436.objecter _send_op 9 to 5.1 on osd.1 2021-02-24T15:17:34.513 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:9 5.1 5:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected e17) v8 -- 0x557ca17c8db0 con 0x557ca17c4de0 2021-02-24T15:17:34.514 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.514 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.514 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.347+0000 7f696bf02540 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2021-02-24T15:17:34.515 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 9 ==== osd_op_reply(9 exist [write 0~5] v17'2 uv2 ondisk = 0) v8 ==== 149+0+0 (unknown 2496788108 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.515 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(9 exist [write 0~5] v17'2 uv2 ondisk = 0) v8 2021-02-24T15:17:34.515 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.516 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 9 ondisk uv 2 in 5.1 attempt 0 2021-02-24T15:17:34.516 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.516 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 9 2021-02-24T15:17:34.516 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 15 client.4436.objecter _finish_op 9 2021-02-24T15:17:34.517 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.517 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 9 2021-02-24T15:17:34.517 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.518 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f695a9f6700 20 librados: complete_aio_write 0x557ca17c8ca0 2021-02-24T15:17:34.518 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (4 ms) 2021-02-24T15:17:34.518 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2021-02-24T15:17:34.519 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2021-02-24T15:17:34.519 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 20 librados: queue_aio_write 0x557ca16be090 completion 0x557ca17c9aa0 write_seq 2 2021-02-24T15:17:34.519 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17c95b0 2021-02-24T15:17:34.520 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_write 2021-02-24T15:17:34.520 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.520 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.536 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.537 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [write 0~5 in=5b] tid 10 osd.1 2021-02-24T15:17:34.537 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.537 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 10 2021-02-24T15:17:34.538 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 15 client.4436.objecter _send_op 10 to 5.1 on osd.1 2021-02-24T15:17:34.538 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:10 5.1 5:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected e17) v8 -- 0x557ca17c8db0 con 0x557ca17c4de0 2021-02-24T15:17:34.538 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.539 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.539 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.351+0000 7f696bf02540 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2021-02-24T15:17:34.539 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 10 ==== osd_op_reply(10 exist [write 0~5] v17'3 uv3 ondisk = 0) v8 ==== 149+0+0 (unknown 3763424600 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.540 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(10 exist [write 0~5] v17'3 uv3 ondisk = 0) v8 2021-02-24T15:17:34.540 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.540 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 10 ondisk uv 3 in 5.1 attempt 0 2021-02-24T15:17:34.541 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.541 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 10 2021-02-24T15:17:34.541 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 15 client.4436.objecter _finish_op 10[ OK ] AsioRados.AsyncWriteFuture 2021-02-24T15:17:34.542 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: (1 ms) 2021-02-24T15:17:34.543 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2021-02-24T15:17:34.543 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.543 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 10 2021-02-24T15:17:34.544 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.544 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f695a9f6700 20 librados: complete_aio_write 0x557ca17c9aa0 2021-02-24T15:17:34.544 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f696bf02540 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2021-02-24T15:17:34.545 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f696bf02540 20 librados: queue_aio_write 0x557ca16be090 completion 0x557ca17c9bb0 write_seq 3 2021-02-24T15:17:34.545 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17c95b0 2021-02-24T15:17:34.545 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_write 2021-02-24T15:17:34.545 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.352+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.546 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.553 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.554 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [write 0~5 in=5b] tid 11 osd.1 2021-02-24T15:17:34.554 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.554 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 11 2021-02-24T15:17:34.555 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 15 client.4436.objecter _send_op 11 to 5.1 on osd.1 2021-02-24T15:17:34.555 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:11 5.1 5:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected e17) v8 -- 0x557ca180ebb0 con 0x557ca17c4de0 2021-02-24T15:17:34.555 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.556 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.556 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.353+0000 7f696bf02540 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2021-02-24T15:17:34.556 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 11 ==== osd_op_reply(11 exist [write 0~5] v17'4 uv4 ondisk = 0) v8 ==== 149+0+0 (unknown 2856196229 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.564 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(11 exist [write 0~5] v17'4 uv4 ondisk = 0) v8 2021-02-24T15:17:34.564 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.565 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 11 ondisk uv 4 in 5.1 attempt 0 2021-02-24T15:17:34.565 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.565 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 11 2021-02-24T15:17:34.566 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 15 client.4436.objecter _finish_op 11 2021-02-24T15:17:34.566 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.566 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 11 2021-02-24T15:17:34.567 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.567 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.355+0000 7f695a9f6700 20 librados: complete_aio_write 0x557ca17c9bb0 2021-02-24T15:17:34.567 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (3 ms) 2021-02-24T15:17:34.568 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2021-02-24T15:17:34.575 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17ca500 2021-02-24T15:17:34.575 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.575 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.576 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.576 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.577 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [read 0~0] tid 12 osd.1 2021-02-24T15:17:34.577 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.581 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 12 2021-02-24T15:17:34.582 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 15 client.4436.objecter _send_op 12 to 5.1 on osd.1 2021-02-24T15:17:34.582 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:12 5.1 5:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17ca9f0 con 0x557ca17c4de0 2021-02-24T15:17:34.582 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.583 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.584 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17caeb0 2021-02-24T15:17:34.584 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base noexist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.585 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _calc_target target noexist @5 -> pgid 5.a7bbaa1 2021-02-24T15:17:34.585 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.a7bbaa1 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.586 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.586 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _op_submit oid noexist '@5' '@5' [read 0~0] tid 13 osd.1 2021-02-24T15:17:34.586 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.587 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 13 2021-02-24T15:17:34.587 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 15 client.4436.objecter _send_op 13 to 5.1 on osd.1 2021-02-24T15:17:34.587 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:13 5.1 5:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17fe530 con 0x557ca17c4de0 2021-02-24T15:17:34.597 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.598 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 5 client.4436.objecter 2 in flight 2021-02-24T15:17:34.598 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (unknown 1453704938 0 3741568377) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.599 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2021-02-24T15:17:34.599 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.600 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 12 ondisk uv 4 in 5.1 attempt 0 2021-02-24T15:17:34.600 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 5 2021-02-24T15:17:34.601 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 12 2021-02-24T15:17:34.601 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 15 client.4436.objecter _finish_op 12 2021-02-24T15:17:34.601 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.602 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 12 2021-02-24T15:17:34.603 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.603 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 13 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (unknown 3735351034 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.603 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2021-02-24T15:17:34.604 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.604 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 13 ondisk uv 0 in 5.1 attempt 0 2021-02-24T15:17:34.604 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 10 client.4436.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0[ OK ] 2021-02-24T15:17:34.605 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: AsioRados.AsyncReadOperationCallback2021-02-24T15:17:34.356+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.605 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 13 2021-02-24T15:17:34.605 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: (1 ms) 2021-02-24T15:17:34.606 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2021-02-24T15:17:34.606 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 15 client.4436.objecter _finish_op 13 2021-02-24T15:17:34.606 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.607 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 13 2021-02-24T15:17:34.607 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.608 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17ca500 2021-02-24T15:17:34.609 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.609 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.609 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.610 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.610 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [read 0~0] tid 14 osd.1 2021-02-24T15:17:34.610 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.611 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 14 2021-02-24T15:17:34.611 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 15 client.4436.objecter _send_op 14 to 5.1 on osd.1 2021-02-24T15:17:34.611 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:14 5.1 5:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17ca9f0 con 0x557ca17c4de0 2021-02-24T15:17:34.612 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.612 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.613 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17caf70 2021-02-24T15:17:34.613 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base noexist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.614 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _calc_target target noexist @5 -> pgid 5.a7bbaa1 2021-02-24T15:17:34.614 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.a7bbaa1 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.615 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.615 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 10 client.4436.objecter _op_submit oid noexist '@5' '@5' [read 0~0] tid 15 osd.1 2021-02-24T15:17:34.615 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.616 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 15 2021-02-24T15:17:34.616 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 15 client.4436.objecter _send_op 15 to 5.1 on osd.1 2021-02-24T15:17:34.616 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:15 5.1 5:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17fe530 con 0x557ca17c4de0 2021-02-24T15:17:34.616 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.617 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.356+0000 7f696bf02540 5 client.4436.objecter 2 in flight 2021-02-24T15:17:34.617 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (unknown 1453704938 0 3741568377) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.617 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2021-02-24T15:17:34.618 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.619 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 14 ondisk uv 4 in 5.1 attempt 0 2021-02-24T15:17:34.619 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 5 2021-02-24T15:17:34.619 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 14 2021-02-24T15:17:34.620 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter _finish_op 14 2021-02-24T15:17:34.620 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.620 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 14 2021-02-24T15:17:34.621 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.621 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 15 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (unknown 3735351034 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.621 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2021-02-24T15:17:34.621 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.622 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 15 ondisk uv 0 in 5.1 attempt 0 2021-02-24T15:17:34.622 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2021-02-24T15:17:34.623 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.624 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 15 2021-02-24T15:17:34.624 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter _finish_op 15 2021-02-24T15:17:34.625 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.625 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 15 2021-02-24T15:17:34.625 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture2021-02-24T15:17:34.357+0000 7f695a9f6700 5 client.4436.objecter 0 in flight (1 ms) 2021-02-24T15:17:34.626 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.626 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2021-02-24T15:17:34.626 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17ca500 2021-02-24T15:17:34.627 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.627 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.627 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.627 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.628 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [read 0~0] tid 16 osd.1 2021-02-24T15:17:34.628 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.628 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 16 2021-02-24T15:17:34.629 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 15 client.4436.objecter _send_op 16 to 5.1 on osd.1 2021-02-24T15:17:34.629 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:16 5.1 5:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca17ca9f0 con 0x557ca17c4de0 2021-02-24T15:17:34.630 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.630 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.630 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca181f080 2021-02-24T15:17:34.630 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base noexist @5 precalc_pgid 0 pgid 0.0 is_read 2021-02-24T15:17:34.631 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter _calc_target target noexist @5 -> pgid 5.a7bbaa1 2021-02-24T15:17:34.631 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.a7bbaa1 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.631 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.631 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 10 client.4436.objecter _op_submit oid noexist '@5' '@5' [read 0~0] tid 17 osd.1 2021-02-24T15:17:34.632 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.632 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 17 2021-02-24T15:17:34.632 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 15 client.4436.objecter _send_op 17 to 5.1 on osd.1 2021-02-24T15:17:34.632 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:17 5.1 5:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected e17) v8 -- 0x557ca181eba0 con 0x557ca17c4de0 2021-02-24T15:17:34.633 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.633 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 5 client.4436.objecter 2 in flight 2021-02-24T15:17:34.633 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (unknown 1453704938 0 3741568377) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.634 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2021-02-24T15:17:34.634 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.635 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 16 ondisk uv 4 in 5.1 attempt 0 2021-02-24T15:17:34.635 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 5 2021-02-24T15:17:34.635 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 16 2021-02-24T15:17:34.636 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter _finish_op 16 2021-02-24T15:17:34.636 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 5 2021-02-24T15:17:34.636 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 16 2021-02-24T15:17:34.636 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.637 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 17 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (unknown 3735351034 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.637 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2021-02-24T15:17:34.637 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.638 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 17 ondisk uv 0 in 5.1 attempt 0[ OK ] AsioRados.AsyncReadOperationYield 2021-02-24T15:17:34.638 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: (0 ms) 2021-02-24T15:17:34.638 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2021-02-24T15:17:34.639 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2021-02-24T15:17:34.639 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.640 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 17 2021-02-24T15:17:34.640 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter _finish_op 17 2021-02-24T15:17:34.640 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.641 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 17 2021-02-24T15:17:34.641 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.641 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 librados: queue_aio_write 0x557ca16be090 completion 0x557ca17fe530 write_seq 4 2021-02-24T15:17:34.642 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17ca500 2021-02-24T15:17:34.642 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_write 2021-02-24T15:17:34.642 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.643 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.643 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.643 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [writefull 0~5 in=5b] tid 18 osd.1 2021-02-24T15:17:34.644 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.644 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 18 2021-02-24T15:17:34.645 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 15 client.4436.objecter _send_op 18 to 5.1 on osd.1 2021-02-24T15:17:34.645 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:18 5.1 5:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected e17) v8 -- 0x557ca181eb60 con 0x557ca17c4de0 2021-02-24T15:17:34.646 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.646 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.357+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.646 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 18 ==== osd_op_reply(18 exist [writefull 0~5] v17'5 uv5 ondisk = 0) v8 ==== 149+0+0 (unknown 1133057477 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.647 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(18 exist [writefull 0~5] v17'5 uv5 ondisk = 0) v8 2021-02-24T15:17:34.647 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.647 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 18 ondisk uv 5 in 5.1 attempt 0 2021-02-24T15:17:34.648 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.648 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 18 2021-02-24T15:17:34.648 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 15 client.4436.objecter _finish_op 18 2021-02-24T15:17:34.649 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.649 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 18 2021-02-24T15:17:34.649 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.650 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f695a9f6700 20 librados: complete_aio_write 0x557ca17fe530 2021-02-24T15:17:34.651 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (3 ms) 2021-02-24T15:17:34.651 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2021-02-24T15:17:34.651 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 20 librados: queue_aio_write 0x557ca16be090 completion 0x557ca181e9d0 write_seq 5 2021-02-24T15:17:34.652 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17ca500 2021-02-24T15:17:34.652 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_write 2021-02-24T15:17:34.652 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.653 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.653 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.653 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [writefull 0~5 in=5b] tid 19 osd.1 2021-02-24T15:17:34.654 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.654 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 19 2021-02-24T15:17:34.654 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 15 client.4436.objecter _send_op 19 to 5.1 on osd.1 2021-02-24T15:17:34.655 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:19 5.1 5:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected e17) v8 -- 0x557ca181eb40 con 0x557ca17c4de0 2021-02-24T15:17:34.656 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.656 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.360+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.656 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 19 ==== osd_op_reply(19 exist [writefull 0~5] v17'6 uv6 ondisk = 0) v8 ==== 149+0+0 (unknown 3725121977 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.657 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(19 exist [writefull 0~5] v17'6 uv6 ondisk = 0) v8 2021-02-24T15:17:34.657 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.658 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 19 ondisk uv 6 in 5.1 attempt 0 2021-02-24T15:17:34.658 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0 2021-02-24T15:17:34.658 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 19 2021-02-24T15:17:34.659 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 15 client.4436.objecter _finish_op 19 2021-02-24T15:17:34.659 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.659 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 19 2021-02-24T15:17:34.660 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.660 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f695a9f6700 20 librados: complete_aio_write 0x557ca181e9d0 2021-02-24T15:17:34.661 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (9 ms) 2021-02-24T15:17:34.661 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2021-02-24T15:17:34.662 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 20 librados: queue_aio_write 0x557ca16be090 completion 0x557ca17fe530 write_seq 6 2021-02-24T15:17:34.662 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 10 client.4436.objecter _op_submit op 0x557ca17ca500 2021-02-24T15:17:34.663 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 20 client.4436.objecter _calc_target epoch 17 base exist @5 precalc_pgid 0 pgid 0.0 is_write 2021-02-24T15:17:34.663 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 20 client.4436.objecter _calc_target target exist @5 -> pgid 5.d3a59201 2021-02-24T15:17:34.663 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 10 client.4436.objecter _calc_target raw pgid 5.d3a59201 -> actual 5.1 acting [1,4] primary 1 2021-02-24T15:17:34.664 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 20 client.4436.objecter _get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.664 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 10 client.4436.objecter _op_submit oid exist '@5' '@5' [writefull 0~5 in=5b] tid 20 osd.1 2021-02-24T15:17:34.664 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 20 client.4436.objecter get_session s=0x557ca1686840 osd=1 3 2021-02-24T15:17:34.665 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 15 client.4436.objecter _session_op_assign 1 20 2021-02-24T15:17:34.665 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 15 client.4436.objecter _send_op 20 to 5.1 on osd.1 2021-02-24T15:17:34.665 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 --> v1:172.21.15.152:6800/33736 -- osd_op(unknown.0.0:20 5.1 5:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected e17) v8 -- 0x557ca17caa30 con 0x557ca17c4de0 2021-02-24T15:17:34.666 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.667 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.369+0000 7f696bf02540 5 client.4436.objecter 1 in flight 2021-02-24T15:17:34.667 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 1 -- 172.21.15.181:0/1227290393 <== osd.1 v1:172.21.15.152:6800/33736 20 ==== osd_op_reply(20 exist [writefull 0~5] v17'7 uv7 ondisk = 0) v8 ==== 149+0+0 (unknown 2861064813 0 0) 0x7f694c0042c0 con 0x557ca17c4de0 2021-02-24T15:17:34.667 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 10 client.4436.objecter ms_dispatch 0x557ca16a7840 osd_op_reply(20 exist [writefull 0~5] v17'7 uv7 ondisk = 0) v8 2021-02-24T15:17:34.668 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 10 client.4436.objecter in handle_osd_op_reply 2021-02-24T15:17:34.668 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 7 client.4436.objecter handle_osd_op_reply 20 ondisk uv 7 in 5.1 attempt 0 2021-02-24T15:17:34.669 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 10 client.4436.objecter op 0 rval 0 len 0[ OK ] 2021-02-24T15:17:34.669 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: AsioRados.AsyncWriteOperationYield (9 ms) 2021-02-24T15:17:34.669 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 15 client.4436.objecter handle_osd_op_reply completed tid 20 2021-02-24T15:17:34.670 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 15 client.4436.objecter _finish_op 20 2021-02-24T15:17:34.670 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 4 2021-02-24T15:17:34.670 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 15 client.4436.objecter _session_op_remove 1 20 2021-02-24T15:17:34.671 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 5 client.4436.objecter 0 in flight 2021-02-24T15:17:34.671 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695a9f6700 20 librados: complete_aio_write 0x557ca17fe530 2021-02-24T15:17:34.673 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 10 librados: watch_flush enter 2021-02-24T15:17:34.673 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 10 librados: watch_flush exit 2021-02-24T15:17:34.673 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 10 client.4436.objecter close_session for osd.1 2021-02-24T15:17:34.674 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 >> v1:172.21.15.152:6800/33736 conn(0x557ca17c4de0 legacy=0x557ca17c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:17:34.675 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 20 client.4436.objecter put_session s=0x557ca1686840 osd=1 1 2021-02-24T15:17:34.675 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 20 client.4436.objecter shutdown clearing up homeless session... 2021-02-24T15:17:34.676 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 10 client.4436.objecter successfully canceled tick 2021-02-24T15:17:34.676 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 >> v1:172.21.15.181:6812/33484 conn(0x7f694802fc20 legacy=0x7f69480320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:17:34.676 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 >> v1:172.21.15.152:6790/0 conn(0x557ca17e27e0 legacy=0x557ca17fbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:17:34.677 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f695b9f8700 1 -- 172.21.15.181:0/1227290393 reap_dead start 2021-02-24T15:17:34.678 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 shutdown_connections 2021-02-24T15:17:34.678 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 >> 172.21.15.181:0/1227290393 conn(0x557ca17160d0 msgr2=0x557ca17478b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:17:34.679 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 shutdown_connections 2021-02-24T15:17:34.679 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 1 -- 172.21.15.181:0/1227290393 wait complete. 2021-02-24T15:17:34.680 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.378+0000 7f696bf02540 1 librados: shutdown 2021-02-24T15:17:34.680 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [----------] 12 tests from AsioRados (35 ms total) 2021-02-24T15:17:34.680 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: 2021-02-24T15:17:34.681 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [----------] Global test environment tear-down 2021-02-24T15:17:34.681 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (2153 ms total) 2021-02-24T15:17:34.681 INFO:tasks.workunit.client.0.smithi181.stdout: api_asio: [ PASSED ] 12 tests. 2021-02-24T15:17:34.903 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [==========] Running 10 tests from 3 test suites. 2021-02-24T15:17:34.903 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [----------] Global test environment set-up. 2021-02-24T15:17:34.904 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [----------] 6 tests from LibRadosList 2021-02-24T15:17:34.904 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2021-02-24T15:17:34.904 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosList.ListObjects (311 ms) 2021-02-24T15:17:34.904 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2021-02-24T15:17:34.904 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: myset foo1,foo2,foo3 2021-02-24T15:17:34.905 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo1 2021-02-24T15:17:34.905 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo2 2021-02-24T15:17:34.905 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo3 2021-02-24T15:17:34.905 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: myset foo1,foo4,foo5 2021-02-24T15:17:34.906 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo4 2021-02-24T15:17:34.906 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo5 2021-02-24T15:17:34.906 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo1 2021-02-24T15:17:34.906 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: myset foo6,foo7 2021-02-24T15:17:34.906 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo7 2021-02-24T15:17:34.907 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo6 2021-02-24T15:17:34.907 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-02-24T15:17:34.907 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns1:foo4 2021-02-24T15:17:34.907 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns1:foo5 2021-02-24T15:17:34.908 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns2:foo7 2021-02-24T15:17:34.908 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns2:foo6 2021-02-24T15:17:34.908 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns1:foo1 2021-02-24T15:17:34.908 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: :foo1 2021-02-24T15:17:34.908 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: :foo2 2021-02-24T15:17:34.909 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: :foo3 2021-02-24T15:17:34.909 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (170 ms) 2021-02-24T15:17:34.909 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2021-02-24T15:17:34.909 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 1 0 2021-02-24T15:17:34.909 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 10 0 2021-02-24T15:17:34.910 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 13 0 2021-02-24T15:17:34.910 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 7 0 2021-02-24T15:17:34.910 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 14 0 2021-02-24T15:17:34.910 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 0 0 2021-02-24T15:17:34.911 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 15 0 2021-02-24T15:17:34.911 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 11 0 2021-02-24T15:17:34.911 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 5 0 2021-02-24T15:17:34.911 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 8 0 2021-02-24T15:17:34.912 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 6 0 2021-02-24T15:17:34.912 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 3 0 2021-02-24T15:17:34.913 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 4 0 2021-02-24T15:17:34.913 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 12 0 2021-02-24T15:17:34.913 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 9 0 2021-02-24T15:17:34.914 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 2 0 2021-02-24T15:17:34.914 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-02-24T15:17:34.914 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (148 ms) 2021-02-24T15:17:34.914 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2021-02-24T15:17:34.915 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: x cursor=MIN 2021-02-24T15:17:34.915 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=1 cursor=8:02547ec2:::1:head 2021-02-24T15:17:34.915 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=10 cursor=8:52ea6a34:::10:head 2021-02-24T15:17:34.915 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=13 cursor=8:566253c9:::13:head 2021-02-24T15:17:34.916 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=7 cursor=8:5c6b0b28:::7:head 2021-02-24T15:17:34.916 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=14 cursor=8:62a1935d:::14:head 2021-02-24T15:17:34.916 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=0 cursor=8:6cac518f:::0:head 2021-02-24T15:17:34.916 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=15 cursor=8:863748b0:::15:head 2021-02-24T15:17:34.916 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=11 cursor=8:89d3ae78:::11:head 2021-02-24T15:17:34.917 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=5 cursor=8:b29083e3:::5:head 2021-02-24T15:17:34.917 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=8 cursor=8:bd63b0f1:::8:head 2021-02-24T15:17:34.917 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=6 cursor=8:c4fdafeb:::6:head 2021-02-24T15:17:34.917 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=3 cursor=8:cfc208b3:::3:head 2021-02-24T15:17:34.918 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=4 cursor=8:d83876eb:::4:head 2021-02-24T15:17:34.918 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=12 cursor=8:de5d7c5f:::12:head 2021-02-24T15:17:34.918 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=9 cursor=8:e960b815:::9:head 2021-02-24T15:17:34.918 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > oid=2 cursor=8:f905c69b:::2:head 2021-02-24T15:17:34.918 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: FIRST> seek to MIN oid=1 2021-02-24T15:17:34.919 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=1 cursor=8:02547ec2:::1:head 2021-02-24T15:17:34.919 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:02547ec2:::1:head 2021-02-24T15:17:34.919 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:02547ec2:::1:head -> 1 2021-02-24T15:17:34.919 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=10 cursor=8:52ea6a34:::10:head 2021-02-24T15:17:34.919 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:52ea6a34:::10:head 2021-02-24T15:17:34.920 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2021-02-24T15:17:34.920 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=13 cursor=8:566253c9:::13:head 2021-02-24T15:17:34.920 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:566253c9:::13:head 2021-02-24T15:17:34.920 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:566253c9:::13:head -> 13 2021-02-24T15:17:34.921 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=7 cursor=8:5c6b0b28:::7:head 2021-02-24T15:17:34.921 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:5c6b0b28:::7:head 2021-02-24T15:17:34.921 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:5c6b0b28:::7:head -> 7 2021-02-24T15:17:34.921 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=14 cursor=8:62a1935d:::14:head 2021-02-24T15:17:34.921 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:62a1935d:::14:head 2021-02-24T15:17:34.922 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:62a1935d:::14:head -> 14 2021-02-24T15:17:35.003 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=0 cursor=8:6cac518f:::0:head 2021-02-24T15:17:35.004 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:6cac518f:::0:head 2021-02-24T15:17:35.004 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:6cac518f:::0:head -> 0 2021-02-24T15:17:35.004 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=15 cursor=8:863748b0:::15:head 2021-02-24T15:17:35.004 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:863748b0:::15:head 2021-02-24T15:17:35.004 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:863748b0:::15:head -> 15 2021-02-24T15:17:35.005 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=11 cursor=8:89d3ae78:::11:head 2021-02-24T15:17:35.005 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:89d3ae78:::11:head 2021-02-24T15:17:35.005 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2021-02-24T15:17:35.005 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=5 cursor=8:b29083e3:::5:head 2021-02-24T15:17:35.006 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:b29083e3:::5:head 2021-02-24T15:17:35.006 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:b29083e3:::5:head -> 5 2021-02-24T15:17:35.006 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=8 cursor=8:bd63b0f1:::8:head 2021-02-24T15:17:35.006 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:bd63b0f1:::8:head 2021-02-24T15:17:35.006 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:bd63b0f1:::8:head -> 8 2021-02-24T15:17:35.007 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=6 cursor=8:c4fdafeb:::6:head 2021-02-24T15:17:35.007 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:c4fdafeb:::6:head 2021-02-24T15:17:35.007 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:c4fdafeb:::6:head -> 6 2021-02-24T15:17:35.007 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=3 cursor=8:cfc208b3:::3:head 2021-02-24T15:17:35.008 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:cfc208b3:::3:head 2021-02-24T15:17:35.008 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:cfc208b3:::3:head -> 3 2021-02-24T15:17:35.008 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=4 cursor=8:d83876eb:::4:head 2021-02-24T15:17:35.008 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:d83876eb:::4:head 2021-02-24T15:17:35.009 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:d83876eb:::4:head -> 4 2021-02-24T15:17:35.009 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=12 cursor=8:de5d7c5f:::12:head 2021-02-24T15:17:35.009 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:de5d7c5f:::12:head 2021-02-24T15:17:35.010 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:de5d7c5f:::12:head -> 12 2021-02-24T15:17:35.010 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=9 cursor=8:e960b815:::9:head 2021-02-24T15:17:35.010 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:e960b815:::9:head 2021-02-24T15:17:35.010 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:e960b815:::9:head -> 9 2021-02-24T15:17:35.011 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : oid=2 cursor=8:f905c69b:::2:head 2021-02-24T15:17:35.011 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:f905c69b:::2:head 2021-02-24T15:17:35.011 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:f905c69b:::2:head -> 2 2021-02-24T15:17:35.011 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:b29083e3:::5:head 2021-02-24T15:17:35.011 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:b29083e3:::5:head expected=8:b29083e3:::5:head 2021-02-24T15:17:35.012 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:b29083e3:::5:head -> 5 2021-02-24T15:17:35.012 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=5 expected=5 2021-02-24T15:17:35.012 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:89d3ae78:::11:head 2021-02-24T15:17:35.012 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:89d3ae78:::11:head expected=8:89d3ae78:::11:head 2021-02-24T15:17:35.013 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2021-02-24T15:17:35.013 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=11 expected=11 2021-02-24T15:17:35.013 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:863748b0:::15:head 2021-02-24T15:17:35.013 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:863748b0:::15:head expected=8:863748b0:::15:head 2021-02-24T15:17:35.014 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:863748b0:::15:head -> 15 2021-02-24T15:17:35.014 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=15 expected=15 2021-02-24T15:17:35.014 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:6cac518f:::0:head 2021-02-24T15:17:35.015 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:6cac518f:::0:head expected=8:6cac518f:::0:head 2021-02-24T15:17:35.015 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:6cac518f:::0:head -> 0 2021-02-24T15:17:35.015 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=0 expected=0 2021-02-24T15:17:35.015 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:62a1935d:::14:head 2021-02-24T15:17:35.015 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:62a1935d:::14:head expected=8:62a1935d:::14:head 2021-02-24T15:17:35.016 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:62a1935d:::14:head -> 14 2021-02-24T15:17:35.016 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=14 expected=14 2021-02-24T15:17:35.016 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:52ea6a34:::10:head 2021-02-24T15:17:35.016 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:52ea6a34:::10:head expected=8:52ea6a34:::10:head 2021-02-24T15:17:35.017 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2021-02-24T15:17:35.017 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=10 expected=10 2021-02-24T15:17:35.017 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:f905c69b:::2:head 2021-02-24T15:17:35.017 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:f905c69b:::2:head expected=8:f905c69b:::2:head 2021-02-24T15:17:35.018 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:f905c69b:::2:head -> 2 2021-02-24T15:17:35.018 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=2 expected=2 2021-02-24T15:17:35.018 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:e960b815:::9:head 2021-02-24T15:17:35.018 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:e960b815:::9:head expected=8:e960b815:::9:head 2021-02-24T15:17:35.019 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:e960b815:::9:head -> 9 2021-02-24T15:17:35.019 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=9 expected=9 2021-02-24T15:17:35.019 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:de5d7c5f:::12:head 2021-02-24T15:17:35.020 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:de5d7c5f:::12:head expected=8:de5d7c5f:::12:head 2021-02-24T15:17:35.020 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:de5d7c5f:::12:head -> 12 2021-02-24T15:17:35.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_lis api_cmd_pp: Running main() from gmock_main.cc 2021-02-24T15:17:35.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2021-02-24T15:17:35.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [----------] Global test environment set-up. 2021-02-24T15:17:35.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2021-02-24T15:17:35.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2021-02-24T15:17:35.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (42 ms) 2021-02-24T15:17:35.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2021-02-24T15:17:35.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (59 ms) 2021-02-24T15:17:35.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2021-02-24T15:17:35.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (2675 ms) 2021-02-24T15:17:35.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (2776 ms total) 2021-02-24T15:17:35.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: 2021-02-24T15:17:35.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [----------] Global test environment tear-down 2021-02-24T15:17:35.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (2776 ms total) 2021-02-24T15:17:35.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2021-02-24T15:17:35.218 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: Running main() from gmock_main.cc 2021-02-24T15:17:35.218 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2021-02-24T15:17:35.218 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [----------] Global test environment set-up. 2021-02-24T15:17:35.219 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2021-02-24T15:17:35.219 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2021-02-24T15:17:35.219 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (52 ms) 2021-02-24T15:17:35.219 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2021-02-24T15:17:35.220 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (59 ms) 2021-02-24T15:17:35.220 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2021-02-24T15:17:35.220 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (2673 ms) 2021-02-24T15:17:35.220 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2021-02-24T15:17:35.221 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.078743+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1913644645' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36714-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.221 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.085615+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/2572747953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36730-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:35.221 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.102277+0000 mon.a [INF] from='client.4481 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36839-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.222 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.102468+0000 mon.a [INF] from='client.4502 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36966-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.222 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.102583+0000 mon.a [INF] from='client.4454 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36760-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.222 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.102678+0000 mon.a [INF] from='client.4466 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36886-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.223 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.102771+0000 mon.a [INF] from='client.4421 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36722-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.223 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.102836+0000 mon.a [INF] from='client.4439 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36738-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.224 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.102880+0000 mon.a [INF] from='client.4526 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37028-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.224 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.102921+0000 mon.a [INF] from='client.4487 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36860-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.102974+0000 mon.a [INF] from='client.4499 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36940-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:35.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.103068+0000 mon.a [INF] from='client.4538 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37154-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.103124+0000 mon.a [INF] from='client.4577 ' entity='client.admin' cmd='[{"prefix": "osd pool api_c_read_operations: Running main() from gmock_main.cc 2021-02-24T15:17:36.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [==========] Running 16 tests from 1 test suite. 2021-02-24T15:17:36.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [----------] Global test environment set-up. 2021-02-24T15:17:36.093 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest 2021-02-24T15:17:36.093 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2021-02-24T15:17:36.093 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2021-02-24T15:17:36.093 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2021-02-24T15:17:36.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (239 ms) 2021-02-24T15:17:36.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2021-02-24T15:17:36.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (7 ms) 2021-02-24T15:17:36.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2021-02-24T15:17:36.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (33 ms) 2021-02-24T15:17:36.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2021-02-24T15:17:36.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (46 ms) 2021-02-24T15:17:36.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2021-02-24T15:17:36.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (13 ms) 2021-02-24T15:17:36.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2021-02-24T15:17:36.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (15 ms) 2021-02-24T15:17:36.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2021-02-24T15:17:36.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (16 ms) 2021-02-24T15:17:36.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2021-02-24T15:17:36.097 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (14 ms) 2021-02-24T15:17:36.097 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2021-02-24T15:17:36.097 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (15 ms) 2021-02-24T15:17:36.098 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2021-02-24T15:17:36.098 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (9 ms) 2021-02-24T15:17:36.098 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2021-02-24T15:17:36.098 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (11 ms) 2021-02-24T15:17:36.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2021-02-24T15:17:36.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (24 ms) 2021-02-24T15:17:36.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2021-02-24T15:17:36.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (30 ms) 2021-02-24T15:17:36.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2021-02-24T15:17:36.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (30 ms) 2021-02-24T15:17:36.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2021-02-24T15:17:36.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (9 ms) 2021-02-24T15:17:36.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest (512 ms total) 2021-02-24T15:17:36.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: 2021-02-24T15:17:36.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [----------] Global test environment tear-down 2021-02-24T15:17:36.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [==========] 16 tests from 1 test suite ran. (3731 ms total) 2021-02-24T15:17:36.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_read_operations: [ PASSED ] 16 tests. 2021-02-24T15:17:36.132 INFO:tasks.workunit.client.0.smithi181.stdout:e540 10 monclient(hunting): picked mon.noname-a con 0x55fdfac05c00 addr v1:172.21.15.152:6789/0 2021-02-24T15:17:36.133 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 10 monclient(hunting): picked mon.noname-b con 0x55fdfab52320 addr v1:172.21.15.152:6790/0 2021-02-24T15:17:36.133 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa69fc0 con 0x55fdfac05c00 2021-02-24T15:17:36.133 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa656f0 con 0x55fdfab55810 2021-02-24T15:17:36.134 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55fdfaa42ae0 con 0x55fdfab52320 2021-02-24T15:17:36.134 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 10 monclient(hunting): _renew_subs 2021-02-24T15:17:36.134 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 10 monclient(hunting): authenticate will time out at 593.723062s 2021-02-24T15:17:36.134 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb59659c700 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab55810 legacy=0x55fdfab413d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:17:36.135 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 0 monclient(hunting): authenticate timed out after 1e-09 2021-02-24T15:17:36.135 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 10 monclient(hunting): shutdown 2021-02-24T15:17:36.135 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-02-24T15:17:36.135 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6790/0 conn(0x55fdfab52320 legacy=0x55fdfac04890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:36.136 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.181:6789/0 conn(0x55fdfab55810 legacy=0x55fdfab413d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:17:36.136 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> v1:172.21.15.152:6789/0 conn(0x55fdfac05c00 legacy=0x55fdfab29810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:17:36.136 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 10 monclient: shutdown 2021-02-24T15:17:36.136 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 20 monclient: shutdown discarding 0 pending message(s) 2021-02-24T15:17:36.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 shutdown_connections 2021-02-24T15:17:36.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 >> 172.21.15.181:0/1052788466 conn(0x55fdfab59580 msgr2=0x55fdfab59960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:17:36.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 shutdown_connections 2021-02-24T15:17:36.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 -- 172.21.15.181:0/1052788466 wait complete. 2021-02-24T15:17:36.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 10 monclient: shutdown 2021-02-24T15:17:36.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 20 monclient: shutdown discarding 0 pending message(s) 2021-02-24T15:17:36.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:32.296+0000 7fb5acdfe540 1 librados: shutdown 2021-02-24T15:17:36.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (32 ms) 2021-02-24T15:17:36.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure (32 ms total) 2021-02-24T15:17:36.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:17:36.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2021-02-24T15:17:36.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2021-02-24T15:17:36.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: started 0x55fdfab09410 2021-02-24T15:17:36.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: started 0x55fdfaa58170 2021-02-24T15:17:36.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: started 2 aios 2021-02-24T15:17:36.141 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: waiting 0x55fdfab09410 2021-02-24T15:17:36.141 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: waiting 0x55fdfaa58170 2021-02-24T15:17:36.142 INFO:tasks.workunit.client.0.smithi181.stdout: application enable","pool": "test-rados-api-smithi181-36767-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.142 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.103171+0000 mon.a [INF] from='client.4622 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37101-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.103230+0000 mon.a [INF] from='client.4457 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36754-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.103292+0000 mon.a [INF] from='client.4478 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36914-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.103345+0000 mon.a [INF] from='client.4484 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36934-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.103398+0000 mon.a [INF] from='client.4553 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37193-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.103514+0000 mon.a [INF] from='client.4619 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37064-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:34.108072+0000 mon.a [INF] from='client.4442 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36730-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:36.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.082264+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-37034-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-37034-1"}]': finished 2021-02-24T15:17:36.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.082343+0000 mon.a [INF] from='client.4442 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36730-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.083612+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2154119673' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36860-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:36.145 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.171507+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/4000859417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36940-6"}]: dispatch 2021-02-24T15:17:36.145 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.171599+0000 client.admin [INF] onexx 2021-02-24T15:17:36.145 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.183311+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/2106069313' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36738-22"}]: dispatch 2021-02-24T15:17:36.145 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.194689+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/3126824983' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36966-7"}]: dispatch 2021-02-24T15:17:36.145 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.215829+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/4000859417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-36940-6"}]: dispatch 2021-02-24T15:17:36.146 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.216668+0000 mon.a [INF] from='client.4676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36738-22"}]: dispatch 2021-02-24T15:17:36.146 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.216952+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1469989892' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-02-24T15:17:36.146 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.217166+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/4000859417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36940-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-02-24T15:17:36.146 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.219129+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/2106069313' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-36738-22"}]: dispatch 2021-02-24T15:17:36.147 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.220257+0000 mon.a [INF] from='client.4691 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36966-7"}]: dispatch 2021-02-24T15:17:36.147 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.249353+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/3126824983' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-36966-7"}]: dispatch 2021-02-24T15:17:36.147 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.332679+0000 mon.a [INF] from='client.4676 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-36738-22"}]: dispatch 2021-02-24T15:17:36.147 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.333289+0000 mon.a [INF] from='client.4691 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-36966-7"}]: dispatch 2021-02-24T15:17:36.147 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.341547+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/2106069313' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36738-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-02-24T15:17:36.148 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.341796+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/3126824983' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36966-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-02-24T15:17:36.148 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.341955+0000 mon.a [INF] from='client.4676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36738-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-02-24T15:17:36.148 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:35.342276+0000 mon.a [INF] from='client.4691 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36966-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-02-24T15:17:36.148 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.084096+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2154119673' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36860-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:36.149 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.084419+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/4000859417' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36940-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-02-24T15:17:36.149 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.084608+0000 mon.a [INF] from='client.4676 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36738-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-02-24T15:17:36.149 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.084673+0000 mon.a [INF] from='client.4691 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36966-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-02-24T15:17:36.149 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.085830+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/4000859417' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36940-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36940-6"}]: dispatch 2021-02-24T15:17:36.149 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.086634+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2745362425' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36886-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:36.150 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.086676+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/2106069313' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36738-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36738-22"}]: dispatch 2021-02-24T15:17:36.150 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.086922+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/4092789103' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37154-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:36.151 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.087179+0000 mon.a [INF] from='client.4676 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36738-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36738-22"}]: dispatch 2021-02-24T15:17:36.151 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.091396+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/697671702' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36714-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:36.151 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.091778+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/3126824983' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36966-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36966-7"}]: dispatch 2021-02-24T15:17:36.151 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.092277+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/4224323969' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36722-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:36.152 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.125298+0000 mon.a [INF] from='client.4697 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37154-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:36.152 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.125604+0000 mon.a [INF] from='client.4700 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36714-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:36.152 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.125815+0000 mon.a [INF] from='client.4691 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36966-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36966-7"}]: dispatch 2021-02-24T15:17:36.152 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.126230+0000 mon.a [INF] from='client.4685 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36722-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:36.152 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.135152+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/2672962342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36730-15"}]: dispatch 2021-02-24T15:17:36.430 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:36.135980+0000 mon.a [INF] from='client.4733 ' entity='client.admin' cmd=[{"prefix": "osd eras list_parallel: process_1_[37254]: starting. 2021-02-24T15:17:36.431 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_1_[37254]: creating pool ceph_test_rados_list_parallel.smithi181-37211 2021-02-24T15:17:36.431 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_1_[37254]: created object 0... 2021-02-24T15:17:36.431 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_1_[37254]: created object 25... 2021-02-24T15:17:36.431 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_1_[37254]: created object 49... 2021-02-24T15:17:36.432 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_1_[37254]: finishing. 2021-02-24T15:17:36.432 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_1_[37254]: shutting down. 2021-02-24T15:17:36.432 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_2_[37256]: starting. 2021-02-24T15:17:36.432 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_2_[37256]: listing objects. 2021-02-24T15:17:36.432 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_2_[37256]: listed object 0... 2021-02-24T15:17:36.433 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_2_[37256]: listed object 25... 2021-02-24T15:17:36.433 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_2_[37256]: saw 50 objects 2021-02-24T15:17:36.433 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_2_[37256]: shutting down. 2021-02-24T15:17:36.433 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.433 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_3_[37550]: starting. 2021-02-24T15:17:36.434 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_3_[37550]: creating pool ceph_test_rados_list_parallel.smithi181-37211 2021-02-24T15:17:36.434 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_3_[37550]: created object 0... 2021-02-24T15:17:36.434 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_3_[37550]: created object 25... 2021-02-24T15:17:36.435 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_3_[37550]: created object 49... 2021-02-24T15:17:36.435 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_3_[37550]: finishing. 2021-02-24T15:17:36.435 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_3_[37550]: shutting down. 2021-02-24T15:17:36.436 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.436 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_4_[37551]: starting. 2021-02-24T15:17:36.436 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_4_[37551]: listing objects. 2021-02-24T15:17:36.436 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_4_[37551]: listed object 0... 2021-02-24T15:17:36.436 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_4_[37551]: listed object 25... 2021-02-24T15:17:36.437 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_4_[37551]: saw 44 objects 2021-02-24T15:17:36.437 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_4_[37551]: shutting down. 2021-02-24T15:17:36.437 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.437 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_5_[37552]: starting. 2021-02-24T15:17:36.437 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_5_[37552]: removed 25 objects... 2021-02-24T15:17:36.438 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_5_[37552]: removed half of the objects 2021-02-24T15:17:36.438 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_5_[37552]: removed 50 objects... 2021-02-24T15:17:36.438 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_5_[37552]: removed 50 objects 2021-02-24T15:17:36.438 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_5_[37552]: shutting down. 2021-02-24T15:17:36.439 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.439 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.439 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_6_[37796]: starting. 2021-02-24T15:17:36.439 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_6_[37796]: creating pool ceph_test_rados_list_parallel.smithi181-37211 2021-02-24T15:17:36.439 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_6_[37796]: created object 0... 2021-02-24T15:17:36.440 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_6_[37796]: created object 25... 2021-02-24T15:17:36.440 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_6_[37796]: created object 49... 2021-02-24T15:17:36.440 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_6_[37796]: finishing. 2021-02-24T15:17:36.440 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_6_[37796]: shutting down. 2021-02-24T15:17:36.440 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.441 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.441 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_7_[37797]: starting. 2021-02-24T15:17:36.441 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_7_[37797]: listing objects. 2021-02-24T15:17:36.441 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_7_[37797]: listed object 0... 2021-02-24T15:17:36.441 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_7_[37797]: listed object 25... 2021-02-24T15:17:36.442 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_7_[37797]: listed object 50... 2021-02-24T15:17:36.442 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_7_[37797]: saw 57 objects 2021-02-24T15:17:36.442 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_7_[37797]: shutting down. 2021-02-24T15:17:36.442 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.443 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.443 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_8_[37798]: starting. 2021-02-24T15:17:36.443 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_8_[37798]: added 25 objects... 2021-02-24T15:17:36.443 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_8_[37798]: added half of the objects 2021-02-24T15:17:36.443 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_8_[37798]: added 50 objects... 2021-02-24T15:17:36.444 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_8_[37798]: added 50 objects 2021-02-24T15:17:36.444 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_8_[37798]: shutting down. 2021-02-24T15:17:36.444 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.444 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.922 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.922 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_9_[37897]: starting. 2021-02-24T15:17:36.922 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_9_[37897]: creating pool ceph_test_rados_list_parallel.smithi181-37211 2021-02-24T15:17:36.922 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_9_[37897]: created object 0... 2021-02-24T15:17:36.923 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_9_[37897]: created object 25... 2021-02-24T15:17:36.923 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_9_[37897]: created object 49... 2021-02-24T15:17:36.923 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_9_[37897]: finishing. 2021-02-24T15:17:36.923 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_9_[37897]: shutting down. 2021-02-24T15:17:36.924 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.924 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.924 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.924 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_10_[37898]: starting. 2021-02-24T15:17:36.924 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_10_[37898]: listing objects. 2021-02-24T15:17:36.925 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_10_[37898]: listed object 0... 2021-02-24T15:17:36.925 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_10_[37898]: listed object 25... 2021-02-24T15:17:36.925 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_10_[37898]: listed object 50... 2021-02-24T15:17:36.925 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_10_[37898]: listed object 75... 2021-02-24T15:17:36.925 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_10_[37898]: saw 98 objects 2021-02-24T15:17:36.926 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_10_[37898]: shutting down. 2021-02-24T15:17:36.926 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.926 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.926 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.926 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_13_[37901]: starting. 2021-02-24T15:17:36.927 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_13_[37901]: removed 25 objects... 2021-02-24T15:17:36.927 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_13_[37901]: removed half of the objects 2021-02-24T15:17:36.927 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_13_[37901]: removed 50 objects... 2021-02-24T15:17:36.927 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_13_[37901]: removed 50 objects 2021-02-24T15:17:36.927 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_13_[37901]: shutting down. 2021-02-24T15:17:36.928 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.928 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.928 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.928 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_11_[37899]: starting. 2021-02-24T15:17:36.929 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_11_[37899]: added 25 objects... 2021-02-24T15:17:36.929 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_11_[37899]: added half of the objects 2021-02-24T15:17:36.929 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_11_[37899]: added 50 objects... 2021-02-24T15:17:36.929 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_11_[37899]: added 50 objects 2021-02-24T15:17:36.929 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_11_[37899]: shutting down. 2021-02-24T15:17:36.930 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.930 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.930 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.931 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_12_[37900]: starting. 2021-02-24T15:17:36.931 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_12_[37900]: added 25 objects... 2021-02-24T15:17:36.931 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_12_[37900]: added half of the objects 2021-02-24T15:17:36.931 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_12_[37900]: added 50 objects... 2021-02-24T15:17:36.932 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_12_[37900]: added 50 objects 2021-02-24T15:17:36.932 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_12_[37900]: shutting down. 2021-02-24T15:17:36.932 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.932 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.932 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.933 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.933 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_14_[37983]: starting. 2021-02-24T15:17:36.933 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_14_[37983]: creating pool ceph_test_rados_list_parallel.smithi181-37211 2021-02-24T15:17:36.933 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_14_[37983]: created object 0... 2021-02-24T15:17:36.934 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_14_[37983]: created object 25... 2021-02-24T15:17:36.934 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_14_[37983]: created object 49... 2021-02-24T15:17:36.934 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_14_[37983]: finishing. 2021-02-24T15:17:36.934 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_14_[37983]: shutting down. 2021-02-24T15:17:36.934 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.935 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.935 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.935 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:36.935 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: starting. 2021-02-24T15:17:36.935 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: listing objects. 2021-02-24T15:17:36.936 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: listed object 0... 2021-02-24T15:17:37.178 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: listed object 25... 2021-02-24T15:17:37.178 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: listed object 50... 2021-02-24T15:17:37.179 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: listed object 75... 2021-02-24T15:17:37.179 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: listed object 100... 2021-02-24T15:17:37.179 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: listed object 125... 2021-02-24T15:17:37.179 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: saw 150 objects 2021-02-24T15:17:37.180 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_15_[37984]: shutting down. 2021-02-24T15:17:37.180 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:37.180 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:37.180 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:37.181 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:37.181 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_16_[37985]: starting. 2021-02-24T15:17:37.181 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_16_[37985]: added 25 objects... 2021-02-24T15:17:37.181 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_16_[37985]: added half of the objects 2021-02-24T15:17:37.182 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_16_[37985]: added 50 objects... 2021-02-24T15:17:37.182 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_16_[37985]: added 50 objects 2021-02-24T15:17:37.182 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: process_16_[37985]: shutting down. 2021-02-24T15:17:37.182 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:37.182 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:37.183 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:37.183 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:37.183 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******************************* 2021-02-24T15:17:37.183 INFO:tasks.workunit.client.0.smithi181.stdout: list_parallel: ******* SUCCESS ********** 2021-02-24T15:17:38.123 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_1_[37304]: starting. 2021-02-24T15:17:38.123 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_1_[37304]: creating pool ceph_test_rados_delete_pools_parallel.smithi181-37268 2021-02-24T15:17:38.124 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_1_[37304]: created object 0... 2021-02-24T15:17:38.124 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_1_[37304]: created object 25... 2021-02-24T15:17:38.124 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_1_[37304]: created object 49... 2021-02-24T15:17:38.124 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_1_[37304]: finishing. 2021-02-24T15:17:38.124 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_1_[37304]: shutting down. 2021-02-24T15:17:38.125 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_2_[37305]: starting. 2021-02-24T15:17:38.125 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_2_[37305]: deleting pool ceph_test_rados_delete_pools_parallel.smithi181-37268 2021-02-24T15:17:38.125 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_2_[37305]: shutting down. 2021-02-24T15:17:38.125 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: ******************************* 2021-02-24T15:17:38.126 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_3_[37602]: starting. 2021-02-24T15:17:38.126 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_3_[37602]: creating pool ceph_test_rados_delete_pools_parallel.smithi181-37268 2021-02-24T15:17:38.126 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_3_[37602]: created object 0... 2021-02-24T15:17:38.126 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_3_[37602]: created object 25... 2021-02-24T15:17:38.126 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_3_[37602]: created object 49... 2021-02-24T15:17:38.127 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_3_[37602]: finishing. 2021-02-24T15:17:38.127 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_3_[37602]: shutting down. 2021-02-24T15:17:38.127 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: ******************************* 2021-02-24T15:17:38.127 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_5_[37604]: starting. 2021-02-24T15:17:38.128 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_5_[37604]: listing objects. 2021-02-24T15:17:38.128 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_5_[37604]: listed object 0... 2021-02-24T15:17:38.129 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_5_[37604]: listed object 25... 2021-02-24T15:17:38.129 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_5_[37604]: saw 50 objects 2021-02-24T15:17:38.129 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_5_[37604]: shutting down. 2021-02-24T15:17:38.129 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: ******************************* 2021-02-24T15:17:38.130 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_4_[37603]: starting. 2021-02-24T15:17:38.131 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_4_[37603]: deleting pool ceph_test_rados_delete_pools_parallel.smithi181-37268 2021-02-24T15:17:38.131 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: process_4_[37603]: shutting down. 2021-02-24T15:17:38.132 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: ******************************* 2021-02-24T15:17:38.132 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: ******************************* 2021-02-24T15:17:38.133 INFO:tasks.workunit.client.0.smithi181.stdout: delete_pools_parallel: ******* SUCCESS ********** 2021-02-24T15:17:39.157 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_1_[37265]: starting. 2021-02-24T15:17:39.157 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_1_[37265]: creating pool ceph_test_rados_open_pools_parallel.smithi181-37241 2021-02-24T15:17:39.158 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_1_[37265]: created object 0... 2021-02-24T15:17:39.158 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_1_[37265]: created object 25... 2021-02-24T15:17:39.158 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_1_[37265]: created object 49... 2021-02-24T15:17:39.158 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_1_[37265]: finishing. 2021-02-24T15:17:39.159 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_1_[37265]: shutting down. 2021-02-24T15:17:39.159 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_2_[37266]: starting. 2021-02-24T15:17:39.159 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_2_[37266]: rados_pool_create. 2021-02-24T15:17:39.159 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_2_[37266]: rados_ioctx_create. 2021-02-24T15:17:39.159 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_2_[37266]: shutting down. 2021-02-24T15:17:39.160 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: ******************************* 2021-02-24T15:17:39.160 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_3_[37847]: starting. 2021-02-24T15:17:39.160 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_3_[37847]: creating pool ceph_test_rados_open_pools_parallel.smithi181-37241 2021-02-24T15:17:39.160 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_3_[37847]: created object 0... 2021-02-24T15:17:39.161 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_3_[37847]: created object 25... 2021-02-24T15:17:39.161 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_3_[37847]: created object 49... 2021-02-24T15:17:39.161 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_3_[37847]: finishing. 2021-02-24T15:17:39.161 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_3_[37847]: shutting down. 2021-02-24T15:17:39.161 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: ******************************* 2021-02-24T15:17:39.162 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_4_[37848]: starting. 2021-02-24T15:17:39.162 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_4_[37848]: rados_pool_create. 2021-02-24T15:17:39.162 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_4_[37848]: rados_ioctx_create. 2021-02-24T15:17:39.162 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: process_4_[37848]: shutting down. 2021-02-24T15:17:39.162 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: ******************************* 2021-02-24T15:17:39.163 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: ******************************* 2021-02-24T15:17:39.163 INFO:tasks.workunit.client.0.smithi181.stdout: open_pools_parallel: ******* SUCCESS ********** 2021-02-24T15:17:39.250 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: Running main() from gmock_main.cc 2021-02-24T15:17:39.250 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2021-02-24T15:17:39.250 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [----------] Global test environment set-up. 2021-02-24T15:17:39.251 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2021-02-24T15:17:39.251 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: seed 36738 2021-02-24T15:17:39.251 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2021-02-24T15:17:39.251 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2021-02-24T15:17:39.252 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2021-02-24T15:17:39.252 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (267 ms) 2021-02-24T15:17:39.252 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2021-02-24T15:17:39.252 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (18 ms) 2021-02-24T15:17:39.252 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2021-02-24T15:17:39.253 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (11 ms) 2021-02-24T15:17:39.253 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2021-02-24T15:17:39.253 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (7 ms) 2021-02-24T15:17:39.253 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2021-02-24T15:17:39.253 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (6 ms) 2021-02-24T15:17:39.254 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2021-02-24T15:17:39.254 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (8 ms) 2021-02-24T15:17:39.254 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2021-02-24T15:17:39.254 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (8 ms) 2021-02-24T15:17:39.255 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2021-02-24T15:17:39.255 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (3 ms) 2021-02-24T15:17:39.255 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2021-02-24T15:17:39.255 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (13 ms) 2021-02-24T15:17:39.256 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2021-02-24T15:17:39.256 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (3 ms) 2021-02-24T15:17:39.256 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2021-02-24T15:17:39.256 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (9 ms) 2021-02-24T15:17:39.256 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2021-02-24T15:17:39.257 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (7 ms) 2021-02-24T15:17:39.257 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2021-02-24T15:17:39.257 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (5 ms) 2021-02-24T15:17:39.257 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2021-02-24T15:17:39.257 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (14 ms) 2021-02-24T15:17:39.258 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2021-02-24T15:17:39.258 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (30 ms) 2021-02-24T15:17:39.258 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2021-02-24T15:17:39.258 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (16 ms) 2021-02-24T15:17:39.259 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2021-02-24T15:17:39.259 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (8 ms) 2021-02-24T15:17:39.259 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2021-02-24T15:17:39.259 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (6 ms) 2021-02-24T15:17:39.259 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2021-02-24T15:17:39.260 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (12 ms) 2021-02-24T15:17:39.260 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (451 ms total) 2021-02-24T15:17:39.261 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: 2021-02-24T15:17:39.261 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2021-02-24T15:17:39.261 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2021-02-24T15:17:39.261 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1076 ms) 2021-02-24T15:17:39.262 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2021-02-24T15:17:39.262 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (18 ms) 2021-02-24T15:17:39.262 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2021-02-24T15:17:39.262 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (42 ms) 2021-02-24T15:17:39.262 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2021-02-24T15:17:39.263 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (6 ms) 2021-02-24T15:17:39.263 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2021-02-24T15:17:39.263 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (10 ms) 2021-02-24T15:17:39.645 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUNure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36730-15"}]: dispatch 2021-02-24T15:17:39.646 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.108595+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2745362425' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36886-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:39.646 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.132186+0000 mon.a [INF] from='client.4697 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37154-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:39.646 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.132350+0000 mon.a [INF] from='client.4700 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36714-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:39.647 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.161433+0000 mon.a [INF] from='client.4685 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36722-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:39.647 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.161631+0000 mon.a [INF] from='client.4733 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36730-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-02-24T15:17:39.647 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.170117+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2154119673' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36860-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:39.647 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.179038+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/3475470191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-37034-1"}]: dispatch 2021-02-24T15:17:39.647 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.187229+0000 mon.a [INF] from='client.4733 v1:172.21.15.181:0/2672962342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36730-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-02-24T15:17:39.648 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.188100+0000 mon.a [INF] from='client.4733 v1:172.21.15.181:0/2672962342' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36730-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36730-15"}]: dispatch 2021-02-24T15:17:39.648 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.195754+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-37034-1"}]: dispatch 2021-02-24T15:17:39.648 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.210450+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1681686336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36767-10"}]: dispatch 2021-02-24T15:17:39.648 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.212505+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1681686336' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-36767-10"}]: dispatch 2021-02-24T15:17:39.649 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.213962+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1681686336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36767-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-02-24T15:17:39.649 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.221407+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/942974293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36760-10"}]: dispatch 2021-02-24T15:17:39.649 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.222563+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/942974293' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-36760-10"}]: dispatch 2021-02-24T15:17:39.649 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.222824+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/942974293' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36760-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-02-24T15:17:39.649 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:37.644616+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1469989892' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-02-24T15:17:39.650 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.086515+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/4000859417' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36940-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36940-6"}]': finished 2021-02-24T15:17:39.650 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.086593+0000 mon.a [INF] from='client.4676 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36738-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36738-22"}]': finished 2021-02-24T15:17:39.650 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.086667+0000 mon.a [INF] from='client.4691 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36966-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36966-7"}]': finished 2021-02-24T15:17:39.650 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.086804+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2154119673' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36860-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:39.651 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.111651+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-37034-1"}]': finished 2021-02-24T15:17:39.651 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.111812+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1681686336' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36767-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-02-24T15:17:39.651 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.111893+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/942974293' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi181-36760-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-02-24T15:17:39.651 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.112270+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/3475470191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-37034-1"}]: dispatch 2021-02-24T15:17:39.651 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.117386+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/4224323969' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36722-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:39.652 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.117801+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1681686336' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36767-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36767-10"}]: dispatch 2021-02-24T15:17:39.652 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.118442+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/942974293' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36760-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36760-10"}]: dispatch 2021-02-24T15:17:40.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.120749+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-37034-1"}]: dispatch 2021-02-24T15:17:40.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.121404+0000 mon.a [INF] from='client.4685 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36722-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:40.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:38.124442+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2154119673' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi181-36860-4", "tierpool": "test-rados-api-smithi181-36860-4-cache"}]: dispatch 2021-02-24T15:17:40.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.084680+0000 mon.a [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-02-24T15:17:40.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.095094+0000 mon.a [INF] from='client.4733 v1:172.21.15.181:0/2672962342' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36730-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36730-15"}]': finished 2021-02-24T15:17:40.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.145908+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi181-37034-1"}]': finished 2021-02-24T15:17:40.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.146032+0000 mon.a [INF] from='client.4685 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36722-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:40.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.146135+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2154119673' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi181-36860-4", "tierpool": "test-rados-api-smithi181-36860-4-cache"}]': finished 2021-02-24T15:17:40.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.148383+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2154119673' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi181-36860-4", "overlaypool": "test-rados-api-smithi181-36860-4-cache"}]: dispatch 2021-02-24T15:17:40.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.150395+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1882291698' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37154-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:40.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.150698+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/355571256' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36886-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:40.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.151589+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/4224323969' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi181-36722-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-02-24T15:17:40.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.151891+0000 mon.a [INF] from='client.4811 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37154-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:40.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.153807+0000 mon.c [INF] from='client.4808 v1:172.21.15.181:0/1420216028' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36714-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:40.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.153946+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1136570481' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36802-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:41.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.205471+0000 mon.a [INF] from='client.4685 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi181-36722-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-02-24T15:17:41.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.205964+0000 mon.a [INF] from='client.4808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36714-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:41.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.206200+0000 mon.a [INF] from='client.4820 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36802-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:41.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.645029+0000 client.admin [INF] threexx 2021-02-24T15:17:41.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:39.645381+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1469989892' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-02-24T15:17:41.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.146256+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/1681686336' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36767-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36767-10"}]': finished 2021-02-24T15:17:41.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.146322+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/942974293' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi181-36760-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi181-36760-10"}]': finished 2021-02-24T15:17:41.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.146394+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2154119673' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi181-36860-4", "overlaypool": "test-rados-api-smithi181-36860-4-cache"}]': finished 2021-02-24T15:17:41.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.146490+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/355571256' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36886-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:41.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.146556+0000 mon.a [INF] from='client.4811 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37154-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:41.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.146656+0000 mon.a [INF] from='client.4685 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi181-36722-3", "field": "max_bytes", "val": "4096"}]': finished 2021-02-24T15:17:41.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.146728+0000 mon.a [INF] from='client.4808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36714-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:41.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.146802+0000 mon.a [INF] from='client.4820 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36802-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-02-24T15:17:41.141 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.147562+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/2154119673' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi181-36860-4-cache", "mode": "writeback"}]: dispatch 2021-02-24T15:17:41.141 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.148479+0000 mon.a [INF] from='client.? v1:172.21.15.181:0/4000859417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36940-6"}]: dispatch 2021-02-24T15:17:42.019 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.151046+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/3126824983' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36966-7"}]: di api_stat: Running main() from gmock_main.cc 2021-02-24T15:17:42.019 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [==========] Running 8 tests from 2 test suites. 2021-02-24T15:17:42.020 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [----------] Global test environment set-up. 2021-02-24T15:17:42.020 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [----------] 4 tests from LibRadosStat 2021-02-24T15:17:42.020 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2021-02-24T15:17:42.020 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ OK ] LibRadosStat.Stat (233 ms) 2021-02-24T15:17:42.020 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2021-02-24T15:17:42.021 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ OK ] LibRadosStat.StatNS (52 ms) 2021-02-24T15:17:42.021 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2021-02-24T15:17:42.021 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2021-02-24T15:17:42.021 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2021-02-24T15:17:42.022 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (7 ms) 2021-02-24T15:17:42.022 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [----------] 4 tests from LibRadosStat (292 ms total) 2021-02-24T15:17:42.022 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: 2021-02-24T15:17:42.022 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2021-02-24T15:17:42.022 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2021-02-24T15:17:42.023 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1076 ms) 2021-02-24T15:17:42.023 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2021-02-24T15:17:42.023 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (20 ms) 2021-02-24T15:17:42.023 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2021-02-24T15:17:42.024 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2021-02-24T15:17:42.024 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2021-02-24T15:17:42.024 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (7 ms) 2021-02-24T15:17:42.024 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1103 ms total) 2021-02-24T15:17:42.025 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: 2021-02-24T15:17:42.025 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [----------] Global test environment tear-down 2021-02-24T15:17:42.025 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [==========] 8 tests from 2 test suites ran. (9745 ms total) 2021-02-24T15:17:42.026 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat: [ PASSED ] 8 tests. 2021-02-24T15:17:42.026 INFO:tasks.workunit.client.0.smithi181.stdout: ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2021-02-24T15:17:42.026 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (8 ms) 2021-02-24T15:17:42.027 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2021-02-24T15:17:42.027 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (16 ms) 2021-02-24T15:17:42.027 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2021-02-24T15:17:42.027 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (4 ms) 2021-02-24T15:17:42.028 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2021-02-24T15:17:42.028 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (11 ms) 2021-02-24T15:17:42.028 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2021-02-24T15:17:42.028 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (10 ms) 2021-02-24T15:17:42.028 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2021-02-24T15:17:42.029 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (8 ms) 2021-02-24T15:17:42.029 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2021-02-24T15:17:42.029 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (7 ms) 2021-02-24T15:17:42.029 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2021-02-24T15:17:42.030 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (26 ms) 2021-02-24T15:17:42.030 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2021-02-24T15:17:42.030 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (17 ms) 2021-02-24T15:17:42.030 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2021-02-24T15:17:42.031 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (11 ms) 2021-02-24T15:17:42.031 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2021-02-24T15:17:42.031 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (3 ms) 2021-02-24T15:17:42.033 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2021-02-24T15:17:42.033 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (16 ms) 2021-02-24T15:17:42.033 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1290 ms total) 2021-02-24T15:17:42.033 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: 2021-02-24T15:17:42.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [----------] Global test environment tear-down 2021-02-24T15:17:42.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (9815 ms total) 2021-02-24T15:17:42.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_io_pp: [ PASSED ] 37 tests. 2021-02-24T15:17:42.035 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: Running main() from gmock_main.cc 2021-02-24T15:17:42.035 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2021-02-24T15:17:42.035 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [----------] Global test environment set-up. 2021-02-24T15:17:42.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2021-02-24T15:17:42.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: seed 36966 2021-02-24T15:17:42.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2021-02-24T15:17:42.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (227 ms) 2021-02-24T15:17:42.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2021-02-24T15:17:42.037 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (51 ms) 2021-02-24T15:17:42.037 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2021-02-24T15:17:42.037 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2021-02-24T15:17:42.038 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2021-02-24T15:17:42.038 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (5 ms) 2021-02-24T15:17:42.038 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2021-02-24T15:17:42.038 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (27 ms) 2021-02-24T15:17:42.039 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (310 ms total) 2021-02-24T15:17:42.039 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: 2021-02-24T15:17:42.039 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2021-02-24T15:17:42.039 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2021-02-24T15:17:42.039 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1091 ms) 2021-02-24T15:17:42.040 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2021-02-24T15:17:42.040 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (17 ms) 2021-02-24T15:17:42.040 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2021-02-24T15:17:42.040 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (4 ms) 2021-02-24T15:17:42.040 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2021-02-24T15:17:42.041 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (13 ms) 2021-02-24T15:17:42.041 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1125 ms total) 2021-02-24T15:17:42.041 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: 2021-02-24T15:17:42.041 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [----------] Global test environment tear-down 2021-02-24T15:17:42.041 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (9736 ms total) 2021-02-24T15:17:42.042 INFO:tasks.workunit.client.0.smithi181.stdout: api_stat_pp: [ PASSED ] 9 tests. 2021-02-24T15:17:43.023 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: Running main() from gmock_main.cc 2021-02-24T15:17:43.023 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [==========] Running 23 tests from 2 test suites. 2021-02-24T15:17:43.023 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [----------] Global test environment set-up. 2021-02-24T15:17:43.023 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [----------] 13 tests from LibRadosIo 2021-02-24T15:17:43.024 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2021-02-24T15:17:43.024 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (183 ms) 2021-02-24T15:17:43.024 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2021-02-24T15:17:43.024 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2021-02-24T15:17:43.025 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2021-02-24T15:17:43.025 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: no timeout :/ 2021-02-24T15:17:43.025 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: no timeout :/ 2021-02-24T15:17:43.025 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: no timeout :/ 2021-02-24T15:17:43.025 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: no timeout :/ 2021-02-24T15:17:43.026 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: no timeout :/ 2021-02-24T15:17:43.026 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (35 ms) 2021-02-24T15:17:43.026 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2021-02-24T15:17:43.026 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (20 ms) 2021-02-24T15:17:43.026 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2021-02-24T15:17:43.027 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.Checksum (9 ms) 2021-02-24T15:17:43.027 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2021-02-24T15:17:43.027 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (18 ms) 2021-02-24T15:17:43.027 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2021-02-24T15:17:43.027 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (6 ms) 2021-02-24T15:17:43.028 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2021-02-24T15:17:43.028 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (8 ms) 2021-02-24T15:17:43.028 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2021-02-24T15:17:43.028 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.TruncTest (4 ms) 2021-02-24T15:17:43.029 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2021-02-24T15:17:43.029 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (3 ms) 2021-02-24T15:17:43.029 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2021-02-24T15:17:43.030 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (11 ms) 2021-02-24T15:17:43.030 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2021-02-24T15:17:43.031 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.RmXattr (20 ms) 2021-02-24T15:17:43.031 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2021-02-24T15:17:43.031 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIo.XattrIter (8 ms) 2021-02-24T15:17:43.031 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [----------] 13 tests from LibRadosIo (325 ms total) 2021-02-24T15:17:43.032 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: 2021-02-24T15:17:43.033 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2021-02-24T15:17:43.033 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2021-02-24T15:17:43.033 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1102 ms) 2021-02-24T15:17:43.033 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2021-02-24T15:17:43.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (10 ms) 2021-02-24T15:17:43.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2021-02-24T15:17:43.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (7 ms) 2021-02-24T15:17:43.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2021-02-24T15:17:43.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (15 ms) 2021-02-24T15:17:43.035 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2021-02-24T15:17:43.035 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (13 ms) 2021-02-24T15:17:43.044 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2021-02-24T15:17:43.044 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (6 ms) 2021-02-24T15:17:43.044 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2021-02-24T15:17:43.044 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (8 ms) 2021-02-24T15:17:43.044 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2021-02-24T15:17:43.045 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (9 ms) 2021-02-24T15:17:43.045 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2021-02-24T15:17:43.045 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (27 ms) 2021-02-24T15:17:43.045 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2021-02-24T15:17:43.045 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (12 ms) 2021-02-24T15:17:43.046 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1209 ms total) 2021-02-24T15:17:43.046 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: 2021-02-24T15:17:43.046 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [----------] Global test environment tear-down 2021-02-24T15:17:43.047 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [==========] 23 tests from 2 test suites ran. (10819 ms total) 2021-02-24T15:17:43.047 INFO:tasks.workunit.client.0.smithi181.stdout: api_io: [ PASSED ] 23 tests. 2021-02-24T15:17:44.213 INFO:tasks.workunit.client.0.smithi181.stdout:spatch 2021-02-24T15:17:44.213 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.151230+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/2106069313' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36738-22"}]: dispatch 2021-02-24T15:17:44.214 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.151459+0000 mon.a [INF] from='client.4691 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36966-7"}]: dispatch 2021-02-24T15:17:44.214 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.151760+0000 mon.a [INF] from='client.4676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi181-36738-22"}]: dispatch 2021-02-24T15:17:44.214 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.156743+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1813560600' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37034-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:44.214 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.157329+0000 mon.a [INF] from='client.4826 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-37034-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:44.214 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.250029+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1136570481' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36802-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:44.215 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.250361+0000 mon.a [INF] from='client.4820 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi181-36802-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-02-24T15:17:44.215 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.325086+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.0"}]: dispatch 2021-02-24T15:17:44.215 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.325730+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.1"}]: dispatch 2021-02-24T15:17:44.215 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.326218+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.2"}]: dispatch 2021-02-24T15:17:44.216 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.326740+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.3"}]: dispatch 2021-02-24T15:17:44.216 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.327244+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.4"}]: dispatch 2021-02-24T15:17:44.216 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.327714+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.5"}]: dispatch 2021-02-24T15:17:44.216 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.328150+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.6"}]: dispatch 2021-02-24T15:17:44.217 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.328547+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.7"}]: dispatch 2021-02-24T15:17:44.217 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.328938+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.8"}]: dispatch 2021-02-24T15:17:44.218 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: got: 2021-02-24T15:17:40.329313+0000 mon.c [INF] from='client.? v1:172.21.15.181:0/1907633142' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "12.9"}]: dispatch 2021-02-24T15:17:44.218 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (9114 ms) 2021-02-24T15:17:44.218 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (11898 ms total) 2021-02-24T15:17:44.219 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: 2021-02-24T15:17:44.219 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [----------] Global test environment tear-down 2021-02-24T15:17:44.219 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (11898 ms total) 2021-02-24T15:17:44.220 INFO:tasks.workunit.client.0.smithi181.stdout: api_cmd: [ PASSED ] 4 tests. 2021-02-24T15:17:45.248 INFO:tasks.ceph.osd.0.smithi152.stderr:2021-02-24T15:17:45.243+0000 7f7bd8fb0700 -1 osd.0 pg_epoch: 28 pg[11.4( v 27'4 (0'0,27'4] local-lis/les=16/17 n=2 ec=16/16 lis/c=16/16 les/c/f=17/17/0 sis=16) [0,2] r=0 lpr=16 crt=27'4 lcod 26'3 mlcod 26'3 active+clean+snaptrim trimq=[9~1] ps=[3~1,5~1,7~1]] removing snap head 2021-02-24T15:17:45.626 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2021-02-24T15:17:45.627 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2021-02-24T15:17:45.627 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2021-02-24T15:17:45.627 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2021-02-24T15:17:45.628 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2021-02-24T15:17:45.628 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: notify 2021-02-24T15:17:45.628 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1092 ms) 2021-02-24T15:17:45.628 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2021-02-24T15:17:45.629 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (19 ms) 2021-02-24T15:17:45.629 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1111 ms total) 2021-02-24T15:17:45.629 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: 2021-02-24T15:17:45.629 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2021-02-24T15:17:45.629 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2021-02-24T15:17:45.630 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: notify 2021-02-24T15:17:45.630 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (77 ms) 2021-02-24T15:17:45.630 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2021-02-24T15:17:45.630 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: notify 2021-02-24T15:17:45.631 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4025 ms) 2021-02-24T15:17:45.631 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2021-02-24T15:17:45.631 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (101 ms) 2021-02-24T15:17:45.631 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2021-02-24T15:17:45.631 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (33 ms) 2021-02-24T15:17:45.632 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2021-02-24T15:17:45.632 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573945666224 notify_id 120259084291 notifier_gid 4826 2021-02-24T15:17:45.632 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (16 ms) 2021-02-24T15:17:45.632 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2021-02-24T15:17:45.633 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573945666144 notify_id 120259084290 notifier_gid 4826 2021-02-24T15:17:45.634 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (28 ms) 2021-02-24T15:17:45.634 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2021-02-24T15:17:45.635 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573945666144 notify_id 120259084292 notifier_gid 4826 2021-02-24T15:17:45.635 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573945666144 notify_id 120259084293 notifier_gid 4826 2021-02-24T15:17:45.635 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (37 ms) 2021-02-24T15:17:45.635 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2021-02-24T15:17:45.636 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573934492128 notify_id 120259084294 notifier_gid 4826 2021-02-24T15:17:45.636 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (44 ms) 2021-02-24T15:17:45.636 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2021-02-24T15:17:45.636 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573934492128 notify_id 120259084295 notifier_gid 4826 2021-02-24T15:17:45.636 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (22 ms) 2021-02-24T15:17:45.637 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2021-02-24T15:17:45.637 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573934492128 notify_id 120259084296 notifier_gid 4826 2021-02-24T15:17:45.637 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (17 ms) 2021-02-24T15:17:45.639 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2021-02-24T15:17:45.639 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: trying... 2021-02-24T15:17:46.221 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573934492128 notify_id 120259084297 n api_lock: Running main() from gmock_main.cc 2021-02-24T15:17:46.221 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2021-02-24T15:17:46.221 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [----------] Global test environment set-up. 2021-02-24T15:17:46.222 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [----------] 8 tests from LibRadosLock 2021-02-24T15:17:46.222 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2021-02-24T15:17:46.222 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (203 ms) 2021-02-24T15:17:46.222 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2021-02-24T15:17:46.222 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLock.LockShared (11 ms) 2021-02-24T15:17:46.223 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2021-02-24T15:17:46.223 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1054 ms) 2021-02-24T15:17:46.223 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2021-02-24T15:17:46.223 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1012 ms) 2021-02-24T15:17:46.223 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2021-02-24T15:17:46.224 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (18 ms) 2021-02-24T15:17:46.224 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2021-02-24T15:17:46.224 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLock.Unlock (10 ms) 2021-02-24T15:17:46.225 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2021-02-24T15:17:46.225 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (8 ms) 2021-02-24T15:17:46.226 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2021-02-24T15:17:46.226 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (9 ms) 2021-02-24T15:17:46.226 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [----------] 8 tests from LibRadosLock (2325 ms total) 2021-02-24T15:17:46.226 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: 2021-02-24T15:17:46.227 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2021-02-24T15:17:46.227 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2021-02-24T15:17:46.227 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1139 ms) 2021-02-24T15:17:46.227 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2021-02-24T15:17:46.227 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (9 ms) 2021-02-24T15:17:46.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2021-02-24T15:17:46.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1015 ms) 2021-02-24T15:17:46.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2021-02-24T15:17:46.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1005 ms) 2021-02-24T15:17:46.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2021-02-24T15:17:46.230 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (12 ms) 2021-02-24T15:17:46.230 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2021-02-24T15:17:46.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (21 ms) 2021-02-24T15:17:46.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2021-02-24T15:17:46.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (9 ms) 2021-02-24T15:17:46.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2021-02-24T15:17:46.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (17 ms) 2021-02-24T15:17:46.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3227 ms total) 2021-02-24T15:17:46.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: 2021-02-24T15:17:46.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [----------] Global test environment tear-down 2021-02-24T15:17:46.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (13999 ms total) 2021-02-24T15:17:46.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock: [ PASSED ] 16 tests. 2021-02-24T15:17:46.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: Running main() from gmock_main.cc 2021-02-24T15:17:46.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2021-02-24T15:17:46.234 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [----------] Global test environment set-up. 2021-02-24T15:17:46.234 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2021-02-24T15:17:46.234 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: seed 36767 2021-02-24T15:17:46.234 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2021-02-24T15:17:46.234 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (228 ms) 2021-02-24T15:17:46.235 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2021-02-24T15:17:46.236 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (48 ms) 2021-02-24T15:17:46.236 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2021-02-24T15:17:46.236 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1014 ms) 2021-02-24T15:17:46.237 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2021-02-24T15:17:46.237 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1021 ms) 2021-02-24T15:17:46.237 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2021-02-24T15:17:46.237 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (10 ms) 2021-02-24T15:17:46.238 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2021-02-24T15:17:46.238 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (11 ms) 2021-02-24T15:17:46.238 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2021-02-24T15:17:46.238 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (11 ms) 2021-02-24T15:17:46.239 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2021-02-24T15:17:46.239 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (4 ms) 2021-02-24T15:17:46.239 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2347 ms total) 2021-02-24T15:17:46.240 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: 2021-02-24T15:17:46.240 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2021-02-24T15:17:46.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2021-02-24T15:17:46.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1135 ms) 2021-02-24T15:17:46.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2021-02-24T15:17:46.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (11 ms) 2021-02-24T15:17:46.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2021-02-24T15:17:46.242 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1011 ms) 2021-02-24T15:17:46.242 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2021-02-24T15:17:46.242 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1006 ms) 2021-02-24T15:17:46.242 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2021-02-24T15:17:46.243 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (37 ms) 2021-02-24T15:17:46.243 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2021-02-24T15:17:46.243 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (17 ms) 2021-02-24T15:17:46.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2021-02-24T15:17:46.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (16 ms) 2021-02-24T15:17:46.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2021-02-24T15:17:46.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (10 ms) 2021-02-24T15:17:46.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3243 ms total) 2021-02-24T15:17:46.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: 2021-02-24T15:17:46.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [----------] Global test environment tear-down 2021-02-24T15:17:46.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (14002 ms total) 2021-02-24T15:17:46.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_lock_pp: [ PASSED ] 16 tests. 2021-02-24T15:17:53.178 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: Running main() from gmock_main.cc 2021-02-24T15:17:53.179 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2021-02-24T15:17:53.179 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [----------] Global test environment set-up. 2021-02-24T15:17:53.179 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2021-02-24T15:17:53.179 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2021-02-24T15:17:53.180 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2021-02-24T15:17:53.180 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2021-02-24T15:17:53.180 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: 2021-02-24T15:17:53.180 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2021-02-24T15:17:53.181 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2021-02-24T15:17:53.181 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (2751 ms) 2021-02-24T15:17:53.181 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2021-02-24T15:17:53.181 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3021 ms) 2021-02-24T15:17:53.181 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2021-02-24T15:17:53.182 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3098 ms) 2021-02-24T15:17:53.182 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2021-02-24T15:17:53.182 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3180 ms) 2021-02-24T15:17:53.182 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2021-02-24T15:17:53.183 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (2633 ms) 2021-02-24T15:17:53.183 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2021-02-24T15:17:53.183 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3121 ms) 2021-02-24T15:17:53.183 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2021-02-24T15:17:53.183 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (3025 ms) 2021-02-24T15:17:53.184 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (20829 ms total) 2021-02-24T15:17:53.184 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: 2021-02-24T15:17:53.184 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [----------] Global test environment tear-down 2021-02-24T15:17:53.184 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (20829 ms total) 2021-02-24T15:17:53.184 INFO:tasks.workunit.client.0.smithi181.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2021-02-24T15:17:54.189 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: Running main() from gmock_main.cc 2021-02-24T15:17:54.189 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2021-02-24T15:17:54.189 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [----------] Global test environment set-up. 2021-02-24T15:17:54.190 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2021-02-24T15:17:54.190 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2021-02-24T15:17:54.190 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify_test_cb 2021-02-24T15:17:54.190 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (274 ms) 2021-02-24T15:17:54.191 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2021-02-24T15:17:54.191 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-02-24T15:17:54.191 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94319990834464 err -107 2021-02-24T15:17:54.191 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1022 ms) 2021-02-24T15:17:54.192 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2021-02-24T15:17:54.192 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-02-24T15:17:54.192 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94319990850368 err -107 2021-02-24T15:17:54.192 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1014 ms) 2021-02-24T15:17:54.193 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2021-02-24T15:17:54.193 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_cb from 4526 notify_id 81604378624 cookie 94319990855424 2021-02-24T15:17:54.193 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (21 ms) 2021-02-24T15:17:54.193 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2021-02-24T15:17:54.193 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_cb from 4526 notify_id 81604378625 cookie 94319990875904 2021-02-24T15:17:54.194 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (26 ms) 2021-02-24T15:17:54.195 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2021-02-24T15:17:54.195 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_cb from 4526 notify_id 81604378625 cookie 94319990875904 2021-02-24T15:17:54.195 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (12 ms) 2021-02-24T15:17:54.195 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2021-02-24T15:17:54.195 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_cb from 4526 notify_id 81604378624 cookie 94319990875904 2021-02-24T15:17:54.196 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_cb from 4526 notify_id 81604378624 cookie 94319990939360 2021-02-24T15:17:54.196 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (15 ms) 2021-02-24T15:17:54.196 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2021-02-24T15:17:54.196 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_cb from 4526 notify_id 81604378624 cookie 94319990939360 2021-02-24T15:17:54.196 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_cb from 4526 notify_id 85899345921 cookie 94319990939360 2021-02-24T15:17:54.197 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3008 ms) 2021-02-24T15:17:54.197 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2021-02-24T15:17:54.197 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: waiting up to 64 for osd to time us out ... 2021-02-24T15:17:54.197 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94319990939360 err -107 2021-02-24T15:17:54.198 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_cb from 4526 notify_id 115964116994 cookie 94319990939360 2021-02-24T15:17:54.198 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5012 ms) 2021-02-24T15:17:54.198 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2021-02-24T15:17:54.198 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2021-02-24T15:17:54.198 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94319990939360 err -107 2021-02-24T15:17:54.199 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1010 ms) 2021-02-24T15:17:54.199 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11414 ms total) 2021-02-24T15:17:54.199 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: 2021-02-24T15:17:54.199 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2021-02-24T15:17:54.199 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2021-02-24T15:17:54.200 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: watch_notify_test_cb 2021-02-24T15:17:54.200 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1780 ms) 2021-02-24T15:17:54.200 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1780 ms total) 2021-02-24T15:17:54.200 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: 2021-02-24T15:17:54.201 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [----------] Global test environment tear-down 2021-02-24T15:17:54.201 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (21876 ms total) 2021-02-24T15:17:54.201 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify: [ PASSED ] 11 tests. 2021-02-24T15:17:57.465 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [==========] Running 3 tests from 1 test suite. 2021-02-24T15:17:57.466 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [----------] Global test environment set-up. 2021-02-24T15:17:57.466 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [----------] 3 tests from LibRadosService 2021-02-24T15:17:57.466 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2021-02-24T15:17:57.466 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5076 ms) 2021-02-24T15:17:57.466 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2021-02-24T15:17:57.467 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [ OK ] LibRadosService.RegisterLate (24 ms) 2021-02-24T15:17:57.467 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [ RUN ] LibRadosService.Status 2021-02-24T15:17:57.467 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [ OK ] LibRadosService.Status (20025 ms) 2021-02-24T15:17:57.467 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [----------] 3 tests from LibRadosService (25125 ms total) 2021-02-24T15:17:57.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: 2021-02-24T15:17:57.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [----------] Global test environment tear-down 2021-02-24T15:17:57.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [==========] 3 tests from 1 test suite ran. (25125 ms total) 2021-02-24T15:17:57.468 INFO:tasks.workunit.client.0.smithi181.stdout: api_service: [ PASSED ] 3 tests. 2021-02-24T15:18:01.228 INFO:tasks.workunit.client.0.smithi181.stdout:otifier_gid 4826 2021-02-24T15:18:01.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: timed out 2021-02-24T15:18:01.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: flushing 2021-02-24T15:18:01.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: flushed 2021-02-24T15:18:01.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3015 ms) 2021-02-24T15:18:01.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2021-02-24T15:18:01.230 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: trying... 2021-02-24T15:18:01.230 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573934492128 notify_id 133143986186 notifier_gid 4826 2021-02-24T15:18:01.230 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: timed out 2021-02-24T15:18:01.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: flushing 2021-02-24T15:18:01.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: flushed 2021-02-24T15:18:01.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3032 ms) 2021-02-24T15:18:01.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2021-02-24T15:18:01.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: List watches 2021-02-24T15:18:01.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: notify2 2021-02-24T15:18:01.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573934492128 notify_id 146028888067 notifier_gid 4826 2021-02-24T15:18:01.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: notify2 done 2021-02-24T15:18:01.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: watch_check 2021-02-24T15:18:01.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: unwatch2 2021-02-24T15:18:01.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: flushing 2021-02-24T15:18:01.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: done 2021-02-24T15:18:01.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3025 ms) 2021-02-24T15:18:01.234 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2021-02-24T15:18:01.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: List watches 2021-02-24T15:18:01.246 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: notify2 2021-02-24T15:18:01.246 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: handle_notify cookie 94573934492128 notify_id 158913789956 notifier_gid 4826 2021-02-24T15:18:01.246 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: notify2 done 2021-02-24T15:18:01.246 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: watch_check 2021-02-24T15:18:01.247 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: unwatch2 2021-02-24T15:18:01.247 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: flushing 2021-02-24T15:18:01.247 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: done 2021-02-24T15:18:01.247 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3082 ms) 2021-02-24T15:18:01.248 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16554 ms total) 2021-02-24T15:18:01.248 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: 2021-02-24T15:18:01.249 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2021-02-24T15:18:01.250 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (28914 ms total) 2021-02-24T15:18:01.250 INFO:tasks.workunit.client.0.smithi181.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2021-02-24T15:18:05.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: Running main() from gmock_main.cc 2021-02-24T15:18:05.034 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [==========] Running 7 tests from 1 test suite. 2021-02-24T15:18:05.035 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [----------] Global test environment set-up. 2021-02-24T15:18:05.035 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [----------] 7 tests from LibRadosPools 2021-02-24T15:18:05.035 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2021-02-24T15:18:05.035 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2851 ms) 2021-02-24T15:18:05.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2021-02-24T15:18:05.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3019 ms) 2021-02-24T15:18:05.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2021-02-24T15:18:05.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3091 ms) 2021-02-24T15:18:05.036 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2021-02-24T15:18:05.037 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5829 ms) 2021-02-24T15:18:05.037 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2021-02-24T15:18:05.037 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5120 ms) 2021-02-24T15:18:05.037 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2021-02-24T15:18:05.037 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5035 ms) 2021-02-24T15:18:05.038 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2021-02-24T15:18:05.038 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (7831 ms) 2021-02-24T15:18:05.038 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [----------] 7 tests from LibRadosPools (32776 ms total) 2021-02-24T15:18:05.038 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: 2021-02-24T15:18:05.039 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [----------] Global test environment tear-down 2021-02-24T15:18:05.039 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [==========] 7 tests from 1 test suite ran. (32776 ms total) 2021-02-24T15:18:05.039 INFO:tasks.workunit.client.0.smithi181.stdout: api_pool: [ PASSED ] 7 tests. 2021-02-24T15:18:07.028 INFO:tasks.ceph.osd.2.smithi152.stderr:2021-02-24T15:18:07.024+0000 7fe1d6422700 -1 osd.2 pg_epoch: 50 pg[58.11( v 49'3 (0'0,49'3] local-lis/les=31/32 n=2 ec=31/31 lis/c=31/31 les/c/f=32/32/0 sis=31) [2,5] r=0 lpr=31 crt=49'3 lcod 48'1 mlcod 48'1 active+clean+snaptrim trimq=[11~1] ps=[a~2]] removing snap head 2021-02-24T15:18:08.530 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2021-02-24T15:18:08.530 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [----------] Global test environment set-up. 2021-02-24T15:18:08.531 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2021-02-24T15:18:08.531 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2021-02-24T15:18:08.531 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5054 ms) 2021-02-24T15:18:08.531 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2021-02-24T15:18:08.531 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (35 ms) 2021-02-24T15:18:08.532 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2021-02-24T15:18:08.532 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20037 ms) 2021-02-24T15:18:08.532 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2021-02-24T15:18:08.532 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: attempt 0 of 20 2021-02-24T15:18:08.532 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: failed to deregister: 2021-02-24T15:18:08.533 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: { 2021-02-24T15:18:08.533 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "epoch": 6, 2021-02-24T15:18:08.533 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "modified": "2021-02-24T15:17:58.635238+0000", 2021-02-24T15:18:08.533 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "services": { 2021-02-24T15:18:08.533 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "laundry": { 2021-02-24T15:18:08.534 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "daemons": { 2021-02-24T15:18:08.535 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "summary": "", 2021-02-24T15:18:08.535 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "close-test-pid37128": { 2021-02-24T15:18:08.535 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "start_epoch": 6, 2021-02-24T15:18:08.536 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "start_stamp": "2021-02-24T15:17:57.677952+0000", 2021-02-24T15:18:08.536 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "gid": 16511, 2021-02-24T15:18:08.536 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "addr": "172.21.15.181:0/4138815514", 2021-02-24T15:18:08.536 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "metadata": { 2021-02-24T15:18:08.536 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "arch": "x86_64", 2021-02-24T15:18:08.537 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "ceph_release": "quincy", 2021-02-24T15:18:08.537 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "ceph_version": "ceph version 17.0.0-1076-gc089f21b (c089f21ba7ed78502aadcbf90668ca79817e877e) quincy (dev)", 2021-02-24T15:18:08.537 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "ceph_version_short": "17.0.0-1076-gc089f21b", 2021-02-24T15:18:08.537 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2021-02-24T15:18:08.538 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "distro": "centos", 2021-02-24T15:18:08.538 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "distro_description": "CentOS Linux 8 (Core)", 2021-02-24T15:18:08.538 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "distro_version": "8", 2021-02-24T15:18:08.538 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "foo": "bar", 2021-02-24T15:18:08.538 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "hostname": "smithi181", 2021-02-24T15:18:08.539 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "kernel_description": "#1 SMP Mon Jan 18 17:05:51 UTC 2021", 2021-02-24T15:18:08.539 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "kernel_version": "4.18.0-240.10.1.el8_3.x86_64", 2021-02-24T15:18:08.539 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "mem_swap_kb": "0", 2021-02-24T15:18:08.539 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "mem_total_kb": "32610048", 2021-02-24T15:18:08.539 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "os": "Linux", 2021-02-24T15:18:08.540 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "this": "that" 2021-02-24T15:18:08.540 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: }, 2021-02-24T15:18:08.540 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: "task_status": {} 2021-02-24T15:18:08.540 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: } 2021-02-24T15:18:08.540 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: } 2021-02-24T15:18:08.541 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: } 2021-02-24T15:18:08.541 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: } 2021-02-24T15:18:08.541 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: } 2021-02-24T15:18:08.541 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: 2021-02-24T15:18:08.542 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: attempt 1 of 20 2021-02-24T15:18:08.542 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (11052 ms) 2021-02-24T15:18:08.542 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (36178 ms total) 2021-02-24T15:18:08.542 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: 2021-02-24T15:18:08.542 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [----------] Global test environment tear-down 2021-02-24T15:18:08.543 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (36178 ms total) 2021-02-24T15:18:08.543 INFO:tasks.workunit.client.0.smithi181.stdout: api_service_pp: [ PASSED ] 4 tests. 2021-02-24T15:18:11.163 INFO:tasks.ceph.osd.1.smithi152.stderr:2021-02-24T15:18:11.160+0000 7fbbaa115700 -1 osd.1 pg_epoch: 54 pg[57.5( v 50'3 (0'0,50'3] local-lis/les=30/31 n=2 ec=30/30 lis/c=30/30 les/c/f=31/31/0 sis=30) [1,3] r=0 lpr=30 crt=50'3 lcod 49'1 mlcod 49'1 active+clean+snaptrim trimq=[2~1]] removing snap head 2021-02-24T15:18:11.420 INFO:tasks.ceph.osd.5.smithi181.stderr:2021-02-24T15:18:11.198+0000 7f194ffb0700 -1 osd.5 pg_epoch: 54 pg[81.5( v 53'2 (0'0,53'2] local-lis/les=48/49 n=2 ec=48/48 lis/c=48/48 les/c/f=49/49/0 sis=48) [5,0] r=0 lpr=48 crt=53'2 lcod 53'1 mlcod 53'1 active+clean+snaptrim trimq=[2~1]] removing snap head 2021-02-24T15:18:14.818 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2021-02-24T15:18:14.818 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2021-02-24T15:18:14.818 INFO:tasks.ceph.mon.b:Restarting daemon 2021-02-24T15:18:14.819 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-02-24T15:18:14.845 INFO:tasks.ceph.mon.b:Started 2021-02-24T15:18:14.846 INFO:tasks.mon_thrash:Sending STOP to mon c 2021-02-24T15:18:14.846 INFO:tasks.ceph.mon.c:Sent signal 19 2021-02-24T15:18:14.847 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2021-02-24T15:18:29.848 INFO:tasks.mon_thrash:Sending CONT to mon c 2021-02-24T15:18:29.849 INFO:tasks.ceph.mon.c:Sent signal 18 2021-02-24T15:18:29.850 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:18:29.850 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:18:29.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.984+0000 7f3a88f69700 1 Processor -- start 2021-02-24T15:18:29.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.984+0000 7f3a88f69700 1 -- start start 2021-02-24T15:18:29.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.984+0000 7f3a88f69700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84066dd0 con 0x7f3a8412d2c0 2021-02-24T15:18:29.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.984+0000 7f3a88f69700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84064370 con 0x7f3a84067430 2021-02-24T15:18:29.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.984+0000 7f3a88f69700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a840665f0 con 0x7f3a84067810 2021-02-24T15:18:29.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.984+0000 7f3a83fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3a8412d2c0 0x7f3a8412f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46794/0 (socket says 172.21.15.152:46794) 2021-02-24T15:18:29.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.984+0000 7f3a83fff700 1 -- 172.21.15.152:0/2971965761 learned_addr learned my addr 172.21.15.152:0/2971965761 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:29.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.984+0000 7f3a82ffd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f3a84067810 0x7f3a84063c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35268/0 (socket says 172.21.15.152:35268) 2021-02-24T15:18:29.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a83fff700 1 -- 172.21.15.152:0/2971965761 >> v1:172.21.15.152:6789/0 conn(0x7f3a8412d2c0 legacy=0x7f3a8412f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:29.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a82ffd700 1 -- 172.21.15.152:0/2971965761 >> v1:172.21.15.152:6790/0 conn(0x7f3a84067810 legacy=0x7f3a84063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:29.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a837fe700 1 -- 172.21.15.152:0/2971965761 >> v1:172.21.15.181:6789/0 conn(0x7f3a84067430 legacy=0x7f3a84063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:29.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a827fc700 1 -- 172.21.15.152:0/2971965761 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407567230 0 0) 0x7f3a84066dd0 con 0x7f3a8412d2c0 2021-02-24T15:18:29.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a827fc700 1 -- 172.21.15.152:0/2971965761 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a70003230 con 0x7f3a8412d2c0 2021-02-24T15:18:29.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a827fc700 1 -- 172.21.15.152:0/2971965761 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3230236646 0 0) 0x7f3a70003230 con 0x7f3a8412d2c0 2021-02-24T15:18:29.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a827fc700 1 -- 172.21.15.152:0/2971965761 >> v1:172.21.15.152:6790/0 conn(0x7f3a84067810 legacy=0x7f3a84063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:29.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a827fc700 1 -- 172.21.15.152:0/2971965761 >> v1:172.21.15.181:6789/0 conn(0x7f3a84067430 legacy=0x7f3a84063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:29.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a827fc700 1 -- 172.21.15.152:0/2971965761 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84066890 con 0x7f3a8412d2c0 2021-02-24T15:18:29.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a827fc700 1 -- 172.21.15.152:0/2971965761 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3a7c001d70 con 0x7f3a8412d2c0 2021-02-24T15:18:29.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a827fc700 1 -- 172.21.15.152:0/2971965761 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3a7c002060 con 0x7f3a8412d2c0 2021-02-24T15:18:29.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.987+0000 7f3a827fc700 1 -- 172.21.15.152:0/2971965761 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3a7c004ad0 con 0x7f3a8412d2c0 2021-02-24T15:18:29.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.988+0000 7f3a88f69700 1 -- 172.21.15.152:0/2971965761 >> v1:172.21.15.152:6789/0 conn(0x7f3a8412d2c0 legacy=0x7f3a8412f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:29.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.988+0000 7f3a88f69700 1 -- 172.21.15.152:0/2971965761 shutdown_connections 2021-02-24T15:18:29.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.988+0000 7f3a88f69700 1 -- 172.21.15.152:0/2971965761 >> 172.21.15.152:0/2971965761 conn(0x7f3a84099650 msgr2=0x7f3a84099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:29.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.988+0000 7f3a88f69700 1 -- 172.21.15.152:0/2971965761 shutdown_connections 2021-02-24T15:18:29.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.988+0000 7f3a88f69700 1 -- 172.21.15.152:0/2971965761 wait complete. 2021-02-24T15:18:29.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.988+0000 7f3a88f69700 1 librados: starting msgr at 2021-02-24T15:18:29.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.988+0000 7f3a88f69700 1 librados: starting objecter 2021-02-24T15:18:29.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.989+0000 7f3a88f69700 1 Processor -- start 2021-02-24T15:18:29.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.989+0000 7f3a88f69700 1 -- start start 2021-02-24T15:18:29.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.989+0000 7f3a88f69700 1 librados: setting wanted keys 2021-02-24T15:18:29.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.989+0000 7f3a88f69700 1 librados: calling monclient init 2021-02-24T15:18:29.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.989+0000 7f3a88f69700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84067f60 con 0x7f3a84067810 2021-02-24T15:18:29.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.989+0000 7f3a88f69700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84132e60 con 0x7f3a84067430 2021-02-24T15:18:30.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.989+0000 7f3a88f69700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84133100 con 0x7f3a8412d2c0 2021-02-24T15:18:30.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.989+0000 7f3a83fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f3a8412d2c0 0x7f3a841402b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35276/0 (socket says 172.21.15.152:35276) 2021-02-24T15:18:30.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.990+0000 7f3a83fff700 1 -- 172.21.15.152:0/2847022687 learned_addr learned my addr 172.21.15.152:0/2847022687 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:30.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a83fff700 1 -- 172.21.15.152:0/2847022687 >> v1:172.21.15.152:6790/0 conn(0x7f3a8412d2c0 legacy=0x7f3a841402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a82ffd700 1 -- 172.21.15.152:0/2847022687 >> v1:172.21.15.152:6789/0 conn(0x7f3a84067810 legacy=0x7f3a8412c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 10 client.?.objecter ms_handle_connect 0x7f3a8412d2c0 2021-02-24T15:18:30.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:30.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 10 client.?.objecter ms_handle_connect 0x7f3a84067810 2021-02-24T15:18:30.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:30.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a837fe700 1 -- 172.21.15.152:0/2847022687 >> v1:172.21.15.181:6789/0 conn(0x7f3a84067430 legacy=0x7f3a84137f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 10 client.?.objecter ms_handle_connect 0x7f3a84067430 2021-02-24T15:18:30.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:30.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160806686 0 0) 0x7f3a84067f60 con 0x7f3a84067810 2021-02-24T15:18:30.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a64004bd0 con 0x7f3a84067810 2021-02-24T15:18:30.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a82ffd700 1 --1- 172.21.15.152:0/2847022687 >> v1:172.21.15.152:6789/0 conn(0x7f3a84067810 0x7f3a8412c610 :-1 s=OPENED pgs=8540 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f3a78001b10 mon_map magic: 0 v1 2021-02-24T15:18:30.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2542514891 0 0) 0x7f3a64004bd0 con 0x7f3a84067810 2021-02-24T15:18:30.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a84067f60 con 0x7f3a84067810 2021-02-24T15:18:30.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:29.992+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3a78001b10 con 0x7f3a84067810 2021-02-24T15:18:30.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479846773 0 0) 0x7f3a84132e60 con 0x7f3a84067430 2021-02-24T15:18:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a64004bd0 con 0x7f3a84067430 2021-02-24T15:18:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522822585 0 0) 0x7f3a84133100 con 0x7f3a8412d2c0 2021-02-24T15:18:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a84132e60 con 0x7f3a8412d2c0 2021-02-24T15:18:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2641931570 0 0) 0x7f3a64004bd0 con 0x7f3a84067430 2021-02-24T15:18:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a84133100 con 0x7f3a84067430 2021-02-24T15:18:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3a74001ab0 con 0x7f3a84067430 2021-02-24T15:18:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1208795547 0 0) 0x7f3a84132e60 con 0x7f3a8412d2c0 2021-02-24T15:18:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a64004bd0 con 0x7f3a8412d2c0 2021-02-24T15:18:30.113 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3a7c001d30 con 0x7f3a8412d2c0 2021-02-24T15:18:30.113 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 794385560 0 0) 0x7f3a84133100 con 0x7f3a84067430 2021-02-24T15:18:30.113 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 >> v1:172.21.15.152:6790/0 conn(0x7f3a8412d2c0 legacy=0x7f3a841402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.113 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 >> v1:172.21.15.152:6789/0 conn(0x7f3a84067810 legacy=0x7f3a8412c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.116 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84138650 con 0x7f3a84067430 2021-02-24T15:18:30.116 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 243831616 0 0) 0x7f3a84067f60 con 0x7f3a84067810 2021-02-24T15:18:30.116 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.107+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8412cd20 con 0x7f3a84067430 2021-02-24T15:18:30.116 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3a74002170 con 0x7f3a84067430 2021-02-24T15:18:30.117 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a88f69700 10 client.54859.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:30.117 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3a74002500 con 0x7f3a84067430 2021-02-24T15:18:30.117 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a84131a70 con 0x7f3a84067430 2021-02-24T15:18:30.118 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a88f69700 1 librados: init done 2021-02-24T15:18:30.118 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f3a740026e0 con 0x7f3a84067430 2021-02-24T15:18:30.118 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(65..65 src has 1..65) v4 ==== 6672+0+0 (unknown 3503280325 0 0) 0x7f3a7403b430 con 0x7f3a84067430 2021-02-24T15:18:30.118 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a6b7fe700 10 client.54859.objecter ms_dispatch 0x7f3a84001510 osd_map(65..65 src has 1..65) v4 2021-02-24T15:18:30.118 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a6b7fe700 3 client.54859.objecter handle_osd_map got epochs [65,65] > 0 2021-02-24T15:18:30.119 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a6b7fe700 3 client.54859.objecter handle_osd_map decoding full epoch 65 2021-02-24T15:18:30.119 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.108+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a84096e50 con 0x7f3a84067430 2021-02-24T15:18:30.119 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.109+0000 7f3a6b7fe700 20 client.54859.objecter dump_active .. 0 homeless 2021-02-24T15:18:30.120 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.111+0000 7f3a6b7fe700 10 client.54859.objecter ms_handle_connect 0x7f3a640316e0 2021-02-24T15:18:30.120 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.113+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f3a74012640 con 0x7f3a84067430 2021-02-24T15:18:30.281 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: Running main() from gmock_main.cc 2021-02-24T15:18:30.282 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [==========] Running 12 tests from 4 test suites. 2021-02-24T15:18:30.282 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] Global test environment set-up. 2021-02-24T15:18:30.282 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2021-02-24T15:18:30.282 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2021-02-24T15:18:30.283 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (1968 ms) 2021-02-24T15:18:30.283 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2021-02-24T15:18:30.283 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2027 ms) 2021-02-24T15:18:30.283 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2021-02-24T15:18:30.284 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2037 ms) 2021-02-24T15:18:30.284 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2021-02-24T15:18:30.284 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (1861 ms) 2021-02-24T15:18:30.284 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (7893 ms total) 2021-02-24T15:18:30.284 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: 2021-02-24T15:18:30.285 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged 2021-02-24T15:18:30.285 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2021-02-24T15:18:30.285 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4539 ms) 2021-02-24T15:18:30.285 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2021-02-24T15:18:30.288 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (3607 ms) 2021-02-24T15:18:30.289 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged (8146 ms total) 2021-02-24T15:18:30.289 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: 2021-02-24T15:18:30.290 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2021-02-24T15:18:30.290 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2021-02-24T15:18:30.290 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2992 ms) 2021-02-24T15:18:30.290 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2021-02-24T15:18:30.291 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (1816 ms) 2021-02-24T15:18:30.291 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2021-02-24T15:18:30.291 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2000 ms) 2021-02-24T15:18:30.291 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2021-02-24T15:18:30.292 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2015 ms) 2021-02-24T15:18:30.292 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8823 ms total) 2021-02-24T15:18:30.292 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: 2021-02-24T15:18:30.292 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2021-02-24T15:18:30.292 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2021-02-24T15:18:30.293 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (9037 ms) 2021-02-24T15:18:30.293 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2021-02-24T15:18:30.293 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (6213 ms) 2021-02-24T15:18:30.293 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (15250 ms total) 2021-02-24T15:18:30.293 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: 2021-02-24T15:18:30.294 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [----------] Global test environment tear-down 2021-02-24T15:18:30.294 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [==========] 12 tests from 4 test suites ran. (58015 ms total) 2021-02-24T15:18:30.294 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots: [ PASSED ] 12 tests. 2021-02-24T15:18:30.296 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:18:30.297 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37152 2021-02-24T15:18:30.297 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37152 2021-02-24T15:18:30.297 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:18:30.298 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36741 2021-02-24T15:18:30.298 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36741 2021-02-24T15:18:30.298 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:18:30.298 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37009 2021-02-24T15:18:30.299 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37009 2021-02-24T15:18:30.299 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:18:30.299 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36920 2021-02-24T15:18:30.299 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36920 2021-02-24T15:18:30.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.385+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3a84058400 con 0x7f3a84067430 2021-02-24T15:18:30.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.386+0000 7f3a6b7fe700 1 -- 172.21.15.152:0/2847022687 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 2647449255) 0x7f3a74012230 con 0x7f3a84067430 2021-02-24T15:18:30.388 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:18:30.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.388+0000 7f3a88f69700 10 librados: watch_flush enter 2021-02-24T15:18:30.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.388+0000 7f3a88f69700 10 librados: watch_flush exit 2021-02-24T15:18:30.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.388+0000 7f3a88f69700 20 client.54859.objecter shutdown clearing up homeless session... 2021-02-24T15:18:30.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.388+0000 7f3a88f69700 10 client.54859.objecter successfully canceled tick 2021-02-24T15:18:30.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.389+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 >> v1:172.21.15.181:6812/33484 conn(0x7f3a640316e0 legacy=0x7f3a64033ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.389+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 >> v1:172.21.15.181:6789/0 conn(0x7f3a84067430 legacy=0x7f3a84137f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.389+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 shutdown_connections 2021-02-24T15:18:30.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.389+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 >> 172.21.15.152:0/2847022687 conn(0x7f3a84099650 msgr2=0x7f3a84125260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:30.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.389+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 shutdown_connections 2021-02-24T15:18:30.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.389+0000 7f3a88f69700 1 -- 172.21.15.152:0/2847022687 wait complete. 2021-02-24T15:18:30.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.389+0000 7f3a88f69700 1 librados: shutdown 2021-02-24T15:18:30.411 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:18:30.412 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:18:30.532 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.529+0000 7f2a825a9700 1 Processor -- start 2021-02-24T15:18:30.532 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.530+0000 7f2a825a9700 1 -- start start 2021-02-24T15:18:30.532 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.530+0000 7f2a825a9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c096270 con 0x7f2a7c094540 2021-02-24T15:18:30.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.530+0000 7f2a825a9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c096510 con 0x7f2a7c0949d0 2021-02-24T15:18:30.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.530+0000 7f2a825a9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c0967b0 con 0x7f2a7c0613c0 2021-02-24T15:18:30.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.530+0000 7f2a815a7700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2a7c0613c0 0x7f2a7c093e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35290/0 (socket says 172.21.15.152:35290) 2021-02-24T15:18:30.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.530+0000 7f2a80da6700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2a7c094540 0x7f2a7c12fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46814/0 (socket says 172.21.15.152:46814) 2021-02-24T15:18:30.534 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.530+0000 7f2a815a7700 1 -- 172.21.15.152:0/3498502838 learned_addr learned my addr 172.21.15.152:0/3498502838 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:30.538 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a815a7700 1 -- 172.21.15.152:0/3498502838 >> v1:172.21.15.152:6790/0 conn(0x7f2a7c0613c0 legacy=0x7f2a7c093e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.538 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a80da6700 1 -- 172.21.15.152:0/3498502838 >> v1:172.21.15.152:6789/0 conn(0x7f2a7c094540 legacy=0x7f2a7c12fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.539 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a81da8700 1 -- 172.21.15.152:0/3498502838 >> v1:172.21.15.181:6789/0 conn(0x7f2a7c0949d0 legacy=0x7f2a7c133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.539 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803631887 0 0) 0x7f2a7c0967b0 con 0x7f2a7c0613c0 2021-02-24T15:18:30.542 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a64003230 con 0x7f2a7c0613c0 2021-02-24T15:18:30.542 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113584462 0 0) 0x7f2a7c096270 con 0x7f2a7c094540 2021-02-24T15:18:30.542 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a7c0967b0 con 0x7f2a7c094540 2021-02-24T15:18:30.542 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10159451 0 0) 0x7f2a7c096510 con 0x7f2a7c0949d0 2021-02-24T15:18:30.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a7c096270 con 0x7f2a7c0949d0 2021-02-24T15:18:30.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3213659853 0 0) 0x7f2a64003230 con 0x7f2a7c0613c0 2021-02-24T15:18:30.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 >> v1:172.21.15.181:6789/0 conn(0x7f2a7c0949d0 legacy=0x7f2a7c133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 >> v1:172.21.15.152:6789/0 conn(0x7f2a7c094540 legacy=0x7f2a7c12fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c096a50 con 0x7f2a7c0613c0 2021-02-24T15:18:30.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2a78001a30 con 0x7f2a7c0613c0 2021-02-24T15:18:30.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2a6c001930 con 0x7f2a7c094540 2021-02-24T15:18:30.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2a78001c50 con 0x7f2a7c0613c0 2021-02-24T15:18:30.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.533+0000 7f2a6bfff700 1 -- 172.21.15.152:0/3498502838 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2a78004750 con 0x7f2a7c0613c0 2021-02-24T15:18:30.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 -- 172.21.15.152:0/3498502838 >> v1:172.21.15.152:6790/0 conn(0x7f2a7c0613c0 legacy=0x7f2a7c093e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 -- 172.21.15.152:0/3498502838 shutdown_connections 2021-02-24T15:18:30.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 -- 172.21.15.152:0/3498502838 >> 172.21.15.152:0/3498502838 conn(0x7f2a7c09a7a0 msgr2=0x7f2a7c09ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:30.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 -- 172.21.15.152:0/3498502838 shutdown_connections 2021-02-24T15:18:30.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 -- 172.21.15.152:0/3498502838 wait complete. 2021-02-24T15:18:30.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 librados: starting msgr at 2021-02-24T15:18:30.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 librados: starting objecter 2021-02-24T15:18:30.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 Processor -- start 2021-02-24T15:18:30.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 -- start start 2021-02-24T15:18:30.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 librados: setting wanted keys 2021-02-24T15:18:30.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.534+0000 7f2a825a9700 1 librados: calling monclient init 2021-02-24T15:18:30.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.535+0000 7f2a825a9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c095a70 con 0x7f2a7c094540 2021-02-24T15:18:30.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.535+0000 7f2a825a9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c067710 con 0x7f2a7c0613c0 2021-02-24T15:18:30.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.535+0000 7f2a825a9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c127300 con 0x7f2a7c0949d0 2021-02-24T15:18:30.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.535+0000 7f2a80da6700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2a7c094540 0x7f2a7c124270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46822/0 (socket says 172.21.15.152:46822) 2021-02-24T15:18:30.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.535+0000 7f2a81da8700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2a7c0949d0 0x7f2a7c141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35300/0 (socket says 172.21.15.152:35300) 2021-02-24T15:18:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.535+0000 7f2a80da6700 1 -- 172.21.15.152:0/2185156916 learned_addr learned my addr 172.21.15.152:0/2185156916 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:30.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a81da8700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6790/0 conn(0x7f2a7c0949d0 legacy=0x7f2a7c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a80da6700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6789/0 conn(0x7f2a7c094540 legacy=0x7f2a7c124270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a697fa700 10 client.?.objecter ms_handle_connect 0x7f2a7c0949d0 2021-02-24T15:18:30.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a697fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:30.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a697fa700 10 client.?.objecter ms_handle_connect 0x7f2a7c094540 2021-02-24T15:18:30.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a697fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:30.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534376089 0 0) 0x7f2a7c095a70 con 0x7f2a7c094540 2021-02-24T15:18:30.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a5c004bd0 con 0x7f2a7c094540 2021-02-24T15:18:30.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a697fa700 10 client.?.objecter ms_handle_connect 0x7f2a7c0613c0 2021-02-24T15:18:30.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a697fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:30.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a815a7700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.181:6789/0 conn(0x7f2a7c0613c0 legacy=0x7f2a7c139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.537+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219953711 0 0) 0x7f2a7c127300 con 0x7f2a7c0949d0 2021-02-24T15:18:30.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a7c095a70 con 0x7f2a7c0949d0 2021-02-24T15:18:30.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1509960883 0 0) 0x7f2a5c004bd0 con 0x7f2a7c094540 2021-02-24T15:18:30.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2a7c127300 con 0x7f2a7c094540 2021-02-24T15:18:30.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2a6c001950 con 0x7f2a7c094540 2021-02-24T15:18:30.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2909231473 0 0) 0x7f2a7c095a70 con 0x7f2a7c0949d0 2021-02-24T15:18:30.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2a5c004bd0 con 0x7f2a7c0949d0 2021-02-24T15:18:30.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2a74001f60 con 0x7f2a7c0949d0 2021-02-24T15:18:30.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205487738 0 0) 0x7f2a7c067710 con 0x7f2a7c0613c0 2021-02-24T15:18:30.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a7c095a70 con 0x7f2a7c0613c0 2021-02-24T15:18:30.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1854288883 0 0) 0x7f2a7c127300 con 0x7f2a7c094540 2021-02-24T15:18:30.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6790/0 conn(0x7f2a7c0949d0 legacy=0x7f2a7c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.181:6789/0 conn(0x7f2a7c0613c0 legacy=0x7f2a7c139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c124980 con 0x7f2a7c094540 2021-02-24T15:18:30.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c111cb0 con 0x7f2a7c094540 2021-02-24T15:18:30.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a825a9700 10 client.27255.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:30.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c0671e0 con 0x7f2a7c094540 2021-02-24T15:18:30.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a825a9700 1 librados: init done 2021-02-24T15:18:30.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2a6c0049a0 con 0x7f2a7c094540 2021-02-24T15:18:30.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.538+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2a6c004cb0 con 0x7f2a7c094540 2021-02-24T15:18:30.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.539+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2a54006550 con 0x7f2a540027f0 2021-02-24T15:18:30.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.539+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f2a6c004e10 con 0x7f2a7c094540 2021-02-24T15:18:30.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.539+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(66..66 src has 1..66) v4 ==== 6551+0+0 (unknown 1392395739 0 0) 0x7f2a6c03b5b0 con 0x7f2a7c094540 2021-02-24T15:18:30.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.539+0000 7f2a697fa700 10 client.27255.objecter ms_dispatch 0x7f2a7c001510 osd_map(66..66 src has 1..66) v4 2021-02-24T15:18:30.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.539+0000 7f2a697fa700 3 client.27255.objecter handle_osd_map got epochs [66,66] > 0 2021-02-24T15:18:30.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.539+0000 7f2a697fa700 3 client.27255.objecter handle_osd_map decoding full epoch 66 2021-02-24T15:18:30.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.539+0000 7f2a697fa700 20 client.27255.objecter dump_active .. 0 homeless 2021-02-24T15:18:30.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a815a7700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6789/0 conn(0x7f2a540027f0 legacy=0x7f2a54004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a697fa700 10 client.27255.objecter ms_handle_connect 0x7f2a540027f0 2021-02-24T15:18:30.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a697fa700 10 client.27255.objecter resend_mon_ops 2021-02-24T15:18:30.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321103535 0 0) 0x7f2a54006550 con 0x7f2a540027f0 2021-02-24T15:18:30.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a7c127300 con 0x7f2a540027f0 2021-02-24T15:18:30.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1601310558 0 0) 0x7f2a7c127300 con 0x7f2a540027f0 2021-02-24T15:18:30.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2a54006550 con 0x7f2a540027f0 2021-02-24T15:18:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2a78001320 con 0x7f2a540027f0 2021-02-24T15:18:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2484300623 0 0) 0x7f2a54006550 con 0x7f2a540027f0 2021-02-24T15:18:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.541+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a54009df0 con 0x7f2a540027f0 2021-02-24T15:18:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.542+0000 7f2a697fa700 10 client.27255.objecter ms_handle_connect 0x7f2a5c0316b0 2021-02-24T15:18:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.542+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f2a78004690 con 0x7f2a540027f0 2021-02-24T15:18:30.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.542+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6789/0 conn(0x7f2a540027f0 legacy=0x7f2a54004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.542+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6789/0 conn(0x7f2a540027f0 legacy=0x7f2a54004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:30.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.550+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2a54009a80 con 0x7f2a54008da0 2021-02-24T15:18:30.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a815a7700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6789/0 conn(0x7f2a54008da0 legacy=0x7f2a54009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a697fa700 10 client.27255.objecter ms_handle_connect 0x7f2a54008da0 2021-02-24T15:18:30.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a697fa700 10 client.27255.objecter resend_mon_ops 2021-02-24T15:18:30.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775433077 0 0) 0x7f2a54009a80 con 0x7f2a54008da0 2021-02-24T15:18:30.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a54006550 con 0x7f2a54008da0 2021-02-24T15:18:30.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2183789372 0 0) 0x7f2a54006550 con 0x7f2a54008da0 2021-02-24T15:18:30.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2a54009a80 con 0x7f2a54008da0 2021-02-24T15:18:30.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2a78004f00 con 0x7f2a54008da0 2021-02-24T15:18:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 348701387 0 0) 0x7f2a54009a80 con 0x7f2a54008da0 2021-02-24T15:18:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.552+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2a540086f0 con 0x7f2a54008da0 2021-02-24T15:18:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3942 (unknown 0 0 2012781789) 0x7f2a78005130 con 0x7f2a54008da0 2021-02-24T15:18:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6789/0 conn(0x7f2a54008da0 legacy=0x7f2a54009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a697fa700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6789/0 conn(0x7f2a54008da0 legacy=0x7f2a54009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:30.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 10 librados: watch_flush enter 2021-02-24T15:18:30.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 10 librados: watch_flush exit 2021-02-24T15:18:30.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 20 client.27255.objecter shutdown clearing up homeless session... 2021-02-24T15:18:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 10 client.27255.objecter successfully canceled tick 2021-02-24T15:18:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.181:6812/33484 conn(0x7f2a5c0316b0 legacy=0x7f2a5c033b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 >> v1:172.21.15.152:6789/0 conn(0x7f2a7c094540 legacy=0x7f2a7c124270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a81da8700 1 -- 172.21.15.152:0/2185156916 reap_dead start 2021-02-24T15:18:30.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a81da8700 1 -- 172.21.15.152:0/2185156916 reap_dead start 2021-02-24T15:18:30.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 shutdown_connections 2021-02-24T15:18:30.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 >> 172.21.15.152:0/2185156916 conn(0x7f2a7c09a7a0 msgr2=0x7f2a7c125d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 shutdown_connections 2021-02-24T15:18:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 1 -- 172.21.15.152:0/2185156916 wait complete. 2021-02-24T15:18:30.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.553+0000 7f2a825a9700 1 librados: shutdown 2021-02-24T15:18:30.646 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:18:30.647 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:30.647 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:30.647 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:18:30.648 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 14, 2021-02-24T15:18:30.648 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:18:30.648 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:18:30.648 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:18:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:18:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:18:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:30.650 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:18:30.650 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:18:30.650 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:30.651 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:30.651 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:30.651 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:30.651 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:30.652 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:30.653 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:30.653 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:30.654 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:30.654 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:30.654 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:18:30.654 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:18:30.655 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:30.655 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:30.655 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:30.656 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:30.656 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:30.656 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:30.656 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:18:30.658 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:18:30.658 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:18:30.658 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:18:30.658 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:18:30.659 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:18:30.659 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:30.659 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:30.659 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:18:30.660 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:18:30.660 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:18:30.660 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:18:30.661 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:18:30.661 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:30.661 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:18:30.661 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:30.661 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:30.662 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:30.663 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:30.663 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:30.664 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:30.664 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:30.665 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:30.665 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:30.665 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:30.665 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:18:30.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.666 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:18:30.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.667 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:30.667 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:30.668 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:30.668 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:30.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.668 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:30.668 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:18:30.669 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:30.669 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:30.669 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:30.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.670 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:18:30.670 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:18:30.670 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:30.671 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:30.671 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:30.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.672 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:30.672 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:30.672 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:30.672 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:30.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.673 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:30.674 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:18:30.674 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:30.675 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:30.675 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:30.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.675 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:18:30.676 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:18:30.676 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:30.676 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:30.676 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:30.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.677 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:30.677 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:30.677 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:30.678 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:30.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.678 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:30.679 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:18:30.679 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:30.697 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:30.697 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:30.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.697 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:18:30.698 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:18:30.698 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:30.698 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:30.699 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:30.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:30.699 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:30.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.700 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:18:30.700 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:18:30.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.700 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:30.701 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:30.701 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:30.701 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:30.702 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:30.702 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:18:30.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.702 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:30.702 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:30.703 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:30.703 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:30.703 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:30.703 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:18:30.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.704 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:30.704 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:30.704 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:18:30.704 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:30.705 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:30.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.705 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:18:30.705 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:18:30.715 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:18:30.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.838+0000 7ff762b50700 1 Processor -- start 2021-02-24T15:18:30.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.838+0000 7ff762b50700 1 -- start start 2021-02-24T15:18:30.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.839+0000 7ff762b50700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c097d40 con 0x7ff75c063220 2021-02-24T15:18:30.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.839+0000 7ff762b50700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c063d00 con 0x7ff75c099340 2021-02-24T15:18:30.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.839+0000 7ff762b50700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c097980 con 0x7ff75c062da0 2021-02-24T15:18:30.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.839+0000 7ff75bfff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff75c062da0 0x7ff75c12fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35308/0 (socket says 172.21.15.152:35308) 2021-02-24T15:18:30.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.839+0000 7ff7610ed700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff75c063220 0x7ff75c133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46832/0 (socket says 172.21.15.152:46832) 2021-02-24T15:18:30.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.839+0000 7ff75bfff700 1 -- 172.21.15.152:0/3727241659 learned_addr learned my addr 172.21.15.152:0/3727241659 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:30.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75bfff700 1 -- 172.21.15.152:0/3727241659 >> v1:172.21.15.152:6790/0 conn(0x7ff75c062da0 legacy=0x7ff75c12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff7610ed700 1 -- 172.21.15.152:0/3727241659 >> v1:172.21.15.152:6789/0 conn(0x7ff75c063220 legacy=0x7ff75c133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141559456 0 0) 0x7ff75c097d40 con 0x7ff75c063220 2021-02-24T15:18:30.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff740003230 con 0x7ff75c063220 2021-02-24T15:18:30.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934740969 0 0) 0x7ff75c097980 con 0x7ff75c062da0 2021-02-24T15:18:30.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff7608ec700 1 -- 172.21.15.152:0/3727241659 >> v1:172.21.15.181:6789/0 conn(0x7ff75c099340 legacy=0x7ff75c097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff75c097d40 con 0x7ff75c062da0 2021-02-24T15:18:30.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151188411 0 0) 0x7ff75c063d00 con 0x7ff75c099340 2021-02-24T15:18:30.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff75c097980 con 0x7ff75c099340 2021-02-24T15:18:30.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4279859913 0 0) 0x7ff740003230 con 0x7ff75c063220 2021-02-24T15:18:30.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 >> v1:172.21.15.152:6790/0 conn(0x7ff75c062da0 legacy=0x7ff75c12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.841+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 >> v1:172.21.15.181:6789/0 conn(0x7ff75c099340 legacy=0x7ff75c097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.842+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c08fac0 con 0x7ff75c063220 2021-02-24T15:18:30.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.842+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff754001cb0 con 0x7ff75c063220 2021-02-24T15:18:30.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.842+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff754001fc0 con 0x7ff75c063220 2021-02-24T15:18:30.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.842+0000 7ff75b7fe700 1 -- 172.21.15.152:0/3727241659 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff754004a10 con 0x7ff75c063220 2021-02-24T15:18:30.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.842+0000 7ff762b50700 1 -- 172.21.15.152:0/3727241659 >> v1:172.21.15.152:6789/0 conn(0x7ff75c063220 legacy=0x7ff75c133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.842+0000 7ff762b50700 1 -- 172.21.15.152:0/3727241659 shutdown_connections 2021-02-24T15:18:30.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.842+0000 7ff762b50700 1 -- 172.21.15.152:0/3727241659 >> 172.21.15.152:0/3727241659 conn(0x7ff75c09dcc0 msgr2=0x7ff75c09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:30.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.842+0000 7ff762b50700 1 -- 172.21.15.152:0/3727241659 shutdown_connections 2021-02-24T15:18:30.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.842+0000 7ff762b50700 1 -- 172.21.15.152:0/3727241659 wait complete. 2021-02-24T15:18:30.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.843+0000 7ff762b50700 1 librados: starting msgr at 2021-02-24T15:18:30.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.843+0000 7ff762b50700 1 librados: starting objecter 2021-02-24T15:18:30.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.843+0000 7ff762b50700 1 Processor -- start 2021-02-24T15:18:30.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.843+0000 7ff762b50700 1 -- start start 2021-02-24T15:18:30.854 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.843+0000 7ff762b50700 1 librados: setting wanted keys 2021-02-24T15:18:30.854 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.843+0000 7ff762b50700 1 librados: calling monclient init 2021-02-24T15:18:30.857 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.844+0000 7ff762b50700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c094e60 con 0x7ff75c063220 2021-02-24T15:18:30.858 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.844+0000 7ff762b50700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c095100 con 0x7ff75c099340 2021-02-24T15:18:30.858 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.844+0000 7ff762b50700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c0953a0 con 0x7ff75c062da0 2021-02-24T15:18:30.858 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.844+0000 7ff75bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff75c063220 0x7ff75c096850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46840/0 (socket says 172.21.15.152:46840) 2021-02-24T15:18:30.858 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.844+0000 7ff7608ec700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff75c062da0 0x7ff75c139f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35314/0 (socket says 172.21.15.152:35314) 2021-02-24T15:18:30.859 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.844+0000 7ff75bfff700 1 -- 172.21.15.152:0/1245929866 learned_addr learned my addr 172.21.15.152:0/1245929866 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:30.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff75bfff700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6789/0 conn(0x7ff75c063220 legacy=0x7ff75c096850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff7608ec700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6790/0 conn(0x7ff75c062da0 legacy=0x7ff75c139f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 10 client.?.objecter ms_handle_connect 0x7ff75c063220 2021-02-24T15:18:30.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:30.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 10 client.?.objecter ms_handle_connect 0x7ff75c062da0 2021-02-24T15:18:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091195205 0 0) 0x7ff75c094e60 con 0x7ff75c063220 2021-02-24T15:18:30.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff73c004bd0 con 0x7ff75c063220 2021-02-24T15:18:30.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478289719 0 0) 0x7ff75c0953a0 con 0x7ff75c062da0 2021-02-24T15:18:30.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff75c094e60 con 0x7ff75c062da0 2021-02-24T15:18:30.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 10 client.?.objecter ms_handle_connect 0x7ff75c099340 2021-02-24T15:18:30.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:30.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff7610ed700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.181:6789/0 conn(0x7ff75c099340 legacy=0x7ff75c142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3253086526 0 0) 0x7ff73c004bd0 con 0x7ff75c063220 2021-02-24T15:18:30.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff75c0953a0 con 0x7ff75c063220 2021-02-24T15:18:30.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff748001c60 con 0x7ff75c063220 2021-02-24T15:18:30.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2497667295 0 0) 0x7ff75c094e60 con 0x7ff75c062da0 2021-02-24T15:18:30.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff73c004bd0 con 0x7ff75c062da0 2021-02-24T15:18:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff750001c20 con 0x7ff75c062da0 2021-02-24T15:18:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830492186 0 0) 0x7ff75c095100 con 0x7ff75c099340 2021-02-24T15:18:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff75c094e60 con 0x7ff75c099340 2021-02-24T15:18:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1679285645 0 0) 0x7ff75c0953a0 con 0x7ff75c063220 2021-02-24T15:18:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6790/0 conn(0x7ff75c062da0 legacy=0x7ff75c139f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.181:6789/0 conn(0x7ff75c099340 legacy=0x7ff75c142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.936 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c093230 con 0x7ff75c063220 2021-02-24T15:18:30.936 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c13a630 con 0x7ff75c063220 2021-02-24T15:18:30.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff762b50700 10 client.27267.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:30.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c097120 con 0x7ff75c063220 2021-02-24T15:18:30.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff762b50700 1 librados: init done 2021-02-24T15:18:30.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff7480049d0 con 0x7ff75c063220 2021-02-24T15:18:30.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.846+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff748004ce0 con 0x7ff75c063220 2021-02-24T15:18:30.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.847+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff748004f00 con 0x7ff75c063220 2021-02-24T15:18:30.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.847+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff734006550 con 0x7ff7340027f0 2021-02-24T15:18:30.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.847+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(66..66 src has 1..66) v4 ==== 6551+0+0 (unknown 1392395739 0 0) 0x7ff74803b500 con 0x7ff75c063220 2021-02-24T15:18:30.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.847+0000 7ff758ff9700 10 client.27267.objecter ms_dispatch 0x7ff75c001510 osd_map(66..66 src has 1..66) v4 2021-02-24T15:18:30.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.847+0000 7ff758ff9700 3 client.27267.objecter handle_osd_map got epochs [66,66] > 0 2021-02-24T15:18:30.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.847+0000 7ff758ff9700 3 client.27267.objecter handle_osd_map decoding full epoch 66 2021-02-24T15:18:30.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.847+0000 7ff758ff9700 20 client.27267.objecter dump_active .. 0 homeless 2021-02-24T15:18:30.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.849+0000 7ff7608ec700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6790/0 conn(0x7ff7340027f0 legacy=0x7ff734004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.849+0000 7ff758ff9700 10 client.27267.objecter ms_handle_connect 0x7ff7340027f0 2021-02-24T15:18:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.849+0000 7ff758ff9700 10 client.27267.objecter resend_mon_ops 2021-02-24T15:18:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.849+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694032254 0 0) 0x7ff734006550 con 0x7ff7340027f0 2021-02-24T15:18:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff75c0953a0 con 0x7ff7340027f0 2021-02-24T15:18:30.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 227600794 0 0) 0x7ff75c0953a0 con 0x7ff7340027f0 2021-02-24T15:18:30.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff734006550 con 0x7ff7340027f0 2021-02-24T15:18:30.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff750002500 con 0x7ff7340027f0 2021-02-24T15:18:30.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1511330239 0 0) 0x7ff734006550 con 0x7ff7340027f0 2021-02-24T15:18:30.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff734009df0 con 0x7ff7340027f0 2021-02-24T15:18:30.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 10 client.27267.objecter ms_handle_connect 0x7ff73c031660 2021-02-24T15:18:30.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7ff750002810 con 0x7ff7340027f0 2021-02-24T15:18:30.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6790/0 conn(0x7ff7340027f0 legacy=0x7ff734004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.850+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6790/0 conn(0x7ff7340027f0 legacy=0x7ff734004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:30.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.858+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff734009a80 con 0x7ff734008da0 2021-02-24T15:18:30.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff7608ec700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6790/0 conn(0x7ff734008da0 legacy=0x7ff734009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:30.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 10 client.27267.objecter ms_handle_connect 0x7ff734008da0 2021-02-24T15:18:30.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 10 client.27267.objecter resend_mon_ops 2021-02-24T15:18:30.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013093241 0 0) 0x7ff734009a80 con 0x7ff734008da0 2021-02-24T15:18:30.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff734006550 con 0x7ff734008da0 2021-02-24T15:18:30.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3169151701 0 0) 0x7ff734006550 con 0x7ff734008da0 2021-02-24T15:18:30.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff734009a80 con 0x7ff734008da0 2021-02-24T15:18:30.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff7500054d0 con 0x7ff734008da0 2021-02-24T15:18:30.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 780855356 0 0) 0x7ff734009a80 con 0x7ff734008da0 2021-02-24T15:18:30.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff7340086f0 con 0x7ff734008da0 2021-02-24T15:18:30.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4110 (unknown 0 0 1832237177) 0x7ff750007780 con 0x7ff734008da0 2021-02-24T15:18:30.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6790/0 conn(0x7ff734008da0 legacy=0x7ff734009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.861+0000 7ff758ff9700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6790/0 conn(0x7ff734008da0 legacy=0x7ff734009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 10 librados: watch_flush enter 2021-02-24T15:18:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 10 librados: watch_flush exit 2021-02-24T15:18:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 20 client.27267.objecter shutdown clearing up homeless session... 2021-02-24T15:18:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 10 client.27267.objecter successfully canceled tick 2021-02-24T15:18:30.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.181:6812/33484 conn(0x7ff73c031660 legacy=0x7ff73c033b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 >> v1:172.21.15.152:6789/0 conn(0x7ff75c063220 legacy=0x7ff75c096850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:30.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff7610ed700 1 -- 172.21.15.152:0/1245929866 reap_dead start 2021-02-24T15:18:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff7610ed700 1 -- 172.21.15.152:0/1245929866 reap_dead start 2021-02-24T15:18:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 shutdown_connections 2021-02-24T15:18:30.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 >> 172.21.15.152:0/1245929866 conn(0x7ff75c09dcc0 msgr2=0x7ff75c09c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:30.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 shutdown_connections 2021-02-24T15:18:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 1 -- 172.21.15.152:0/1245929866 wait complete. 2021-02-24T15:18:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:30.862+0000 7ff762b50700 1 librados: shutdown 2021-02-24T15:18:30.963 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:18:30.964 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:30.964 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:30.964 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:18:30.964 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 14, 2021-02-24T15:18:30.964 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:18:30.965 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:18:30.965 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:18:30.965 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:18:30.965 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:30.965 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:18:30.970 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:30.970 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:18:30.971 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:18:30.971 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:30.971 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:30.971 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:30.972 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:30.972 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:30.972 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:30.972 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:30.972 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:30.973 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:30.973 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:30.973 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:18:30.973 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:18:30.973 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:30.974 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:30.974 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:30.974 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:30.974 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.981 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:18:30.981 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:18:30.981 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:18:30.981 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:18:30.981 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:18:30.982 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:18:30.982 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:30.983 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:30.984 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:18:30.984 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:18:30.985 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:18:30.985 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:18:30.985 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:18:30.986 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:30.986 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:18:30.986 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:30.986 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:30.987 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:30.987 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:30.987 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:30.988 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:30.988 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:30.988 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:30.988 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:30.988 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:30.989 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:18:30.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:30.989 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:18:30.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:30.989 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:30.990 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:30.990 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:30.990 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:31.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.001 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:31.001 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:18:31.002 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:31.002 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.003 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.003 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:18:31.004 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:18:31.004 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:31.005 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:31.005 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:31.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.006 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:31.007 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:31.007 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:31.009 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:31.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.009 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:31.010 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:18:31.010 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:31.010 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.011 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.011 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:18:31.011 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:18:31.011 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:31.012 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:31.012 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:31.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.013 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:31.013 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:31.013 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:31.013 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:31.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.014 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:31.014 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:18:31.014 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:31.014 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.015 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.015 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:18:31.015 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:18:31.015 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:31.016 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:31.016 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:31.016 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.016 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.017 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:18:31.017 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:18:31.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.018 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:31.018 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:31.018 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:31.019 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.019 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:31.019 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:18:31.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.019 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:31.020 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:31.020 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:18:31.020 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.020 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:31.021 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:18:31.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.021 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:31.021 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:31.022 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:18:31.022 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.022 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:31.022 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:18:31.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.023 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:31.023 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:31.023 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:31.023 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.023 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.024 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:18:31.024 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:18:31.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:18:31.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.148+0000 7f39840d9700 1 Processor -- start 2021-02-24T15:18:31.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.148+0000 7f39840d9700 1 -- start start 2021-02-24T15:18:31.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.148+0000 7f39840d9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c062660 con 0x7f397c0966a0 2021-02-24T15:18:31.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.148+0000 7f39840d9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c063af0 con 0x7f397c095bb0 2021-02-24T15:18:31.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.148+0000 7f39840d9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c063d90 con 0x7f397c068410 2021-02-24T15:18:31.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.149+0000 7f3982676700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f397c068410 legacy=0x7f397c133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-02-24T15:18:31.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.149+0000 7f3982676700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f397c068410 legacy=0x7f397c133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-24T15:18:31.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.149+0000 7f3982676700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f397c068410 0x7f397c133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify read banner and identify addresses failed 2021-02-24T15:18:31.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.149+0000 7f3981e75700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f397c0966a0 0x7f397c096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46850/0 (socket says 172.21.15.152:46850) 2021-02-24T15:18:31.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.149+0000 7f3981e75700 1 -- 172.21.15.152:0/3612120400 learned_addr learned my addr 172.21.15.152:0/3612120400 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:31.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3981e75700 1 -- 172.21.15.152:0/3612120400 >> v1:172.21.15.152:6789/0 conn(0x7f397c0966a0 legacy=0x7f397c096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3981674700 1 -- 172.21.15.152:0/3612120400 >> v1:172.21.15.181:6789/0 conn(0x7f397c095bb0 legacy=0x7f397c130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3980e73700 1 -- 172.21.15.152:0/3612120400 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697937465 0 0) 0x7f397c062660 con 0x7f397c0966a0 2021-02-24T15:18:31.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3980e73700 1 -- 172.21.15.152:0/3612120400 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3964003230 con 0x7f397c0966a0 2021-02-24T15:18:31.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3980e73700 1 -- 172.21.15.152:0/3612120400 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4115774936 0 0) 0x7f3964003230 con 0x7f397c0966a0 2021-02-24T15:18:31.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3980e73700 1 -- 172.21.15.152:0/3612120400 >> v1:172.21.15.152:6790/0 conn(0x7f397c068410 legacy=0x7f397c133990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:18:31.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3980e73700 1 -- 172.21.15.152:0/3612120400 >> v1:172.21.15.181:6789/0 conn(0x7f397c095bb0 legacy=0x7f397c130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3980e73700 1 -- 172.21.15.152:0/3612120400 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c064030 con 0x7f397c0966a0 2021-02-24T15:18:31.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3980e73700 1 -- 172.21.15.152:0/3612120400 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f396c001930 con 0x7f397c0966a0 2021-02-24T15:18:31.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3980e73700 1 -- 172.21.15.152:0/3612120400 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f396c001c40 con 0x7f397c0966a0 2021-02-24T15:18:31.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.151+0000 7f3980e73700 1 -- 172.21.15.152:0/3612120400 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f396c004750 con 0x7f397c0966a0 2021-02-24T15:18:31.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.152+0000 7f39840d9700 1 -- 172.21.15.152:0/3612120400 >> v1:172.21.15.152:6789/0 conn(0x7f397c0966a0 legacy=0x7f397c096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.152+0000 7f39840d9700 1 -- 172.21.15.152:0/3612120400 shutdown_connections 2021-02-24T15:18:31.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.152+0000 7f39840d9700 1 -- 172.21.15.152:0/3612120400 >> 172.21.15.152:0/3612120400 conn(0x7f397c09ba40 msgr2=0x7f397c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:31.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.152+0000 7f39840d9700 1 -- 172.21.15.152:0/3612120400 shutdown_connections 2021-02-24T15:18:31.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.152+0000 7f39840d9700 1 -- 172.21.15.152:0/3612120400 wait complete. 2021-02-24T15:18:31.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f39840d9700 1 librados: starting msgr at 2021-02-24T15:18:31.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f39840d9700 1 librados: starting objecter 2021-02-24T15:18:31.166 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f39840d9700 1 Processor -- start 2021-02-24T15:18:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f39840d9700 1 -- start start 2021-02-24T15:18:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f39840d9700 1 librados: setting wanted keys 2021-02-24T15:18:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f39840d9700 1 librados: calling monclient init 2021-02-24T15:18:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f39840d9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c063010 con 0x7f397c068410 2021-02-24T15:18:31.168 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f39840d9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c0675f0 con 0x7f397c0966a0 2021-02-24T15:18:31.168 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f39840d9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c134770 con 0x7f397c095bb0 2021-02-24T15:18:31.168 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f3981e75700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f397c068410 0x7f397c134060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46852/0 (socket says 172.21.15.152:46852) 2021-02-24T15:18:31.168 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.153+0000 7f3981e75700 1 -- 172.21.15.152:0/724977077 learned_addr learned my addr 172.21.15.152:0/724977077 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.155+0000 7f3981e75700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.152:6789/0 conn(0x7f397c068410 legacy=0x7f397c134060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.155+0000 7f3981674700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.152:6790/0 conn(0x7f397c095bb0 legacy=0x7f397c13a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.155+0000 7f3969ffb700 10 client.?.objecter ms_handle_connect 0x7f397c068410 2021-02-24T15:18:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.155+0000 7f3969ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 10 client.?.objecter ms_handle_connect 0x7f397c095bb0 2021-02-24T15:18:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 10 client.?.objecter ms_handle_connect 0x7f397c0966a0 2021-02-24T15:18:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3982676700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.181:6789/0 conn(0x7f397c0966a0 legacy=0x7f397c142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499638407 0 0) 0x7f397c063010 con 0x7f397c068410 2021-02-24T15:18:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f395c004bd0 con 0x7f397c068410 2021-02-24T15:18:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403600401 0 0) 0x7f397c134770 con 0x7f397c095bb0 2021-02-24T15:18:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c063010 con 0x7f397c095bb0 2021-02-24T15:18:31.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555379785 0 0) 0x7f397c0675f0 con 0x7f397c0966a0 2021-02-24T15:18:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c134770 con 0x7f397c0966a0 2021-02-24T15:18:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2160350900 0 0) 0x7f395c004bd0 con 0x7f397c068410 2021-02-24T15:18:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3981e75700 1 --1- 172.21.15.152:0/724977077 >> v1:172.21.15.152:6789/0 conn(0x7f397c068410 0x7f397c134060 :-1 s=OPENED pgs=8576 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f396c0018f0 mon_map magic: 0 v1 2021-02-24T15:18:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f397c0675f0 con 0x7f397c068410 2021-02-24T15:18:31.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1291388766 0 0) 0x7f397c063010 con 0x7f397c095bb0 2021-02-24T15:18:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f395c004bd0 con 0x7f397c095bb0 2021-02-24T15:18:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3978001b30 con 0x7f397c095bb0 2021-02-24T15:18:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3233462367 0 0) 0x7f397c134770 con 0x7f397c0966a0 2021-02-24T15:18:31.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f397c063010 con 0x7f397c0966a0 2021-02-24T15:18:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3974001d80 con 0x7f397c0966a0 2021-02-24T15:18:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f396c0018f0 con 0x7f397c068410 2021-02-24T15:18:31.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3397339266 0 0) 0x7f395c004bd0 con 0x7f397c095bb0 2021-02-24T15:18:31.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.181:6789/0 conn(0x7f397c0966a0 legacy=0x7f397c142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.152:6789/0 conn(0x7f397c068410 legacy=0x7f397c134060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c11ba40 con 0x7f397c095bb0 2021-02-24T15:18:31.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 125914799 0 0) 0x7f397c0675f0 con 0x7f397c068410 2021-02-24T15:18:31.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c13ab30 con 0x7f397c095bb0 2021-02-24T15:18:31.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3978002230 con 0x7f397c095bb0 2021-02-24T15:18:31.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3978002540 con 0x7f397c095bb0 2021-02-24T15:18:31.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f39840d9700 10 client.25169.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:31.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c11a570 con 0x7f397c095bb0 2021-02-24T15:18:31.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.156+0000 7f39840d9700 1 librados: init done 2021-02-24T15:18:31.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.157+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f39780026a0 con 0x7f397c095bb0 2021-02-24T15:18:31.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.157+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(66..66 src has 1..66) v4 ==== 6551+0+0 (unknown 1392395739 0 0) 0x7f397803b2e0 con 0x7f397c095bb0 2021-02-24T15:18:31.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.157+0000 7f3969ffb700 10 client.25169.objecter ms_dispatch 0x7f397c001510 osd_map(66..66 src has 1..66) v4 2021-02-24T15:18:31.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.157+0000 7f3969ffb700 3 client.25169.objecter handle_osd_map got epochs [66,66] > 0 2021-02-24T15:18:31.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.157+0000 7f3969ffb700 3 client.25169.objecter handle_osd_map decoding full epoch 66 2021-02-24T15:18:31.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.157+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f397c11afd0 con 0x7f397c096f50 2021-02-24T15:18:31.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.157+0000 7f3969ffb700 20 client.25169.objecter dump_active .. 0 homeless 2021-02-24T15:18:31.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 10 client.25169.objecter ms_handle_connect 0x7f397c096f50 2021-02-24T15:18:31.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 10 client.25169.objecter resend_mon_ops 2021-02-24T15:18:31.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 10 client.25169.objecter ms_handle_connect 0x7f395c0317b0 2021-02-24T15:18:31.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3982676700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.181:6789/0 conn(0x7f397c096f50 legacy=0x7f397c0579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794167407 0 0) 0x7f397c063010 con 0x7f397c096f50 2021-02-24T15:18:31.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c0675f0 con 0x7f397c096f50 2021-02-24T15:18:31.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1285883254 0 0) 0x7f397c0675f0 con 0x7f397c096f50 2021-02-24T15:18:31.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f397c063010 con 0x7f397c096f50 2021-02-24T15:18:31.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f39740020a0 con 0x7f397c096f50 2021-02-24T15:18:31.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3049304461 0 0) 0x7f397c063010 con 0x7f397c096f50 2021-02-24T15:18:31.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.160+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f397c058400 con 0x7f397c096f50 2021-02-24T15:18:31.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.161+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f3974004ee0 con 0x7f397c096f50 2021-02-24T15:18:31.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.161+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.181:6789/0 conn(0x7f397c096f50 legacy=0x7f397c0579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.161+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.181:6789/0 conn(0x7f397c096f50 legacy=0x7f397c0579e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:31.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.169+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f397c11afd0 con 0x7f397c1147d0 2021-02-24T15:18:31.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.171+0000 7f3969ffb700 10 client.25169.objecter ms_handle_connect 0x7f397c1147d0 2021-02-24T15:18:31.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.171+0000 7f3969ffb700 10 client.25169.objecter resend_mon_ops 2021-02-24T15:18:31.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.171+0000 7f3982676700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.181:6789/0 conn(0x7f397c1147d0 legacy=0x7f397c147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.171+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500620445 0 0) 0x7f3974005140 con 0x7f397c1147d0 2021-02-24T15:18:31.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.171+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c063010 con 0x7f397c1147d0 2021-02-24T15:18:31.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2124525842 0 0) 0x7f397c063010 con 0x7f397c1147d0 2021-02-24T15:18:31.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3974005140 con 0x7f397c1147d0 2021-02-24T15:18:31.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f39740055f0 con 0x7f397c1147d0 2021-02-24T15:18:31.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 825477515 0 0) 0x7f3974005140 con 0x7f397c1147d0 2021-02-24T15:18:31.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f397c044c90 con 0x7f397c1147d0 2021-02-24T15:18:31.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 225843749) 0x7f3974006ac0 con 0x7f397c1147d0 2021-02-24T15:18:31.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.181:6789/0 conn(0x7f397c1147d0 legacy=0x7f397c147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f3969ffb700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.181:6789/0 conn(0x7f397c1147d0 legacy=0x7f397c147bb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:31.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f39840d9700 10 librados: watch_flush enter 2021-02-24T15:18:31.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f39840d9700 10 librados: watch_flush exit 2021-02-24T15:18:31.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f39840d9700 20 client.25169.objecter shutdown clearing up homeless session... 2021-02-24T15:18:31.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.172+0000 7f39840d9700 10 client.25169.objecter successfully canceled tick 2021-02-24T15:18:31.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.173+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.181:6812/33484 conn(0x7f395c0317b0 legacy=0x7f395c033c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.173+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 >> v1:172.21.15.152:6790/0 conn(0x7f397c095bb0 legacy=0x7f397c13a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.173+0000 7f3982676700 1 -- 172.21.15.152:0/724977077 reap_dead start 2021-02-24T15:18:31.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.173+0000 7f3982676700 1 -- 172.21.15.152:0/724977077 reap_dead start 2021-02-24T15:18:31.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.173+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 shutdown_connections 2021-02-24T15:18:31.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.173+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 >> 172.21.15.152:0/724977077 conn(0x7f397c09ba40 msgr2=0x7f397c1120a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:31.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.173+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 shutdown_connections 2021-02-24T15:18:31.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.173+0000 7f39840d9700 1 -- 172.21.15.152:0/724977077 wait complete. 2021-02-24T15:18:31.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.173+0000 7f39840d9700 1 librados: shutdown 2021-02-24T15:18:31.197 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:18:31.197 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:31.197 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:31.198 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:18:31.198 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 14, 2021-02-24T15:18:31.198 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:18:31.198 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:18:31.198 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:18:31.199 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:18:31.199 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:31.199 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 1, 2021-02-24T15:18:31.199 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:31.199 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:18:31.200 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:18:31.200 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:31.200 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:31.201 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:31.201 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:31.201 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:31.202 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:31.202 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:31.202 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:31.202 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:31.203 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:31.203 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:18:31.203 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:18:31.203 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:31.203 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:31.204 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:31.204 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:31.204 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:31.204 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:31.204 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:31.205 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:31.205 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:31.205 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.205 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:18:31.206 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:18:31.206 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:18:31.206 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:18:31.206 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:18:31.207 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:18:31.207 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:31.207 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:31.208 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:18:31.208 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:18:31.208 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:18:31.208 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:18:31.208 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:18:31.209 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:31.209 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:18:31.209 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:31.209 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:31.209 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:31.210 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:31.210 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:31.210 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:31.210 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:31.210 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:31.211 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:31.211 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:31.211 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:18:31.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.212 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:18:31.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.212 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:31.213 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:31.213 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:31.213 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:31.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.213 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:31.214 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:18:31.214 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:31.214 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.214 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.215 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:18:31.215 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:18:31.215 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:31.215 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:31.215 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:31.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.216 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:31.216 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:31.216 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:31.217 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:31.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.217 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:31.217 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:18:31.218 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:31.218 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.218 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.218 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:18:31.219 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:18:31.219 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:31.219 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:31.219 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:31.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.220 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:31.220 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:31.220 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:31.220 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:31.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.221 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:31.221 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:18:31.222 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:31.222 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.222 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.223 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:18:31.223 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:18:31.223 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:31.224 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:31.224 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:31.224 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.224 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.225 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:18:31.225 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:18:31.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.225 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:31.226 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:31.226 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:31.226 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.226 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:31.226 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:18:31.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:31.227 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:31.227 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:31.227 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:18:31.227 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:31.228 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:31.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:31.228 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:18:31.228 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:18:31.229 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2021-02-24T15:18:31.229 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2021-02-24T15:18:31.348 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.347+0000 7f5577150700 1 Processor -- start 2021-02-24T15:18:31.349 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.347+0000 7f5577150700 1 -- start start 2021-02-24T15:18:31.350 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.347+0000 7f5577150700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55700639d0 con 0x7f55700635f0 2021-02-24T15:18:31.350 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.347+0000 7f5577150700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557009a060 con 0x7f55700974f0 2021-02-24T15:18:31.350 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.347+0000 7f5577150700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557009a300 con 0x7f5570097040 2021-02-24T15:18:31.350 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.347+0000 7f557614e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f55700635f0 0x7f557012abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46862/0 (socket says 172.21.15.152:46862) 2021-02-24T15:18:31.351 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.347+0000 7f557594d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f5570097040 0x7f557012fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35338/0 (socket says 172.21.15.152:35338) 2021-02-24T15:18:31.351 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.347+0000 7f557614e700 1 -- 172.21.15.152:0/1422765707 learned_addr learned my addr 172.21.15.152:0/1422765707 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:31.353 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557594d700 1 -- 172.21.15.152:0/1422765707 >> v1:172.21.15.152:6790/0 conn(0x7f5570097040 legacy=0x7f557012fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.353 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557614e700 1 -- 172.21.15.152:0/1422765707 >> v1:172.21.15.152:6789/0 conn(0x7f55700635f0 legacy=0x7f557012abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677741907 0 0) 0x7f557009a300 con 0x7f5570097040 2021-02-24T15:18:31.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5558003230 con 0x7f5570097040 2021-02-24T15:18:31.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650689771 0 0) 0x7f55700639d0 con 0x7f55700635f0 2021-02-24T15:18:31.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f557009a300 con 0x7f55700635f0 2021-02-24T15:18:31.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557694f700 1 -- 172.21.15.152:0/1422765707 >> v1:172.21.15.181:6789/0 conn(0x7f55700974f0 legacy=0x7f5570133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.355 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1286446677 0 0) 0x7f5558003230 con 0x7f5570097040 2021-02-24T15:18:31.355 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 >> v1:172.21.15.181:6789/0 conn(0x7f55700974f0 legacy=0x7f5570133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.355 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 >> v1:172.21.15.152:6789/0 conn(0x7f55700635f0 legacy=0x7f557012abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.355 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557008fb30 con 0x7f5570097040 2021-02-24T15:18:31.356 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f556c0019f0 con 0x7f5570097040 2021-02-24T15:18:31.356 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f556c001c60 con 0x7f5570097040 2021-02-24T15:18:31.356 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.350+0000 7f557514c700 1 -- 172.21.15.152:0/1422765707 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f556c004690 con 0x7f5570097040 2021-02-24T15:18:31.356 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 -- 172.21.15.152:0/1422765707 >> v1:172.21.15.152:6790/0 conn(0x7f5570097040 legacy=0x7f557012fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 -- 172.21.15.152:0/1422765707 shutdown_connections 2021-02-24T15:18:31.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 -- 172.21.15.152:0/1422765707 >> 172.21.15.152:0/1422765707 conn(0x7f557009d9e0 msgr2=0x7f557009ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:31.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 -- 172.21.15.152:0/1422765707 shutdown_connections 2021-02-24T15:18:31.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 -- 172.21.15.152:0/1422765707 wait complete. 2021-02-24T15:18:31.358 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 librados: starting msgr at 2021-02-24T15:18:31.358 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 librados: starting objecter 2021-02-24T15:18:31.362 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 Processor -- start 2021-02-24T15:18:31.362 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 -- start start 2021-02-24T15:18:31.363 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 librados: setting wanted keys 2021-02-24T15:18:31.363 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.351+0000 7f5577150700 1 librados: calling monclient init 2021-02-24T15:18:31.363 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.352+0000 7f5577150700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5570092050 con 0x7f5570097040 2021-02-24T15:18:31.364 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.352+0000 7f5577150700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55700922f0 con 0x7f55700974f0 2021-02-24T15:18:31.364 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.352+0000 7f5577150700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55700926b0 con 0x7f55700635f0 2021-02-24T15:18:31.364 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.352+0000 7f557614e700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f55700635f0 0x7f5570126ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35344/0 (socket says 172.21.15.152:35344) 2021-02-24T15:18:31.364 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.352+0000 7f557614e700 1 -- 172.21.15.152:0/239872659 learned_addr learned my addr 172.21.15.152:0/239872659 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:31.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f557614e700 1 -- 172.21.15.152:0/239872659 >> v1:172.21.15.152:6790/0 conn(0x7f55700635f0 legacy=0x7f5570126ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 10 client.?.objecter ms_handle_connect 0x7f55700635f0 2021-02-24T15:18:31.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:31.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f557594d700 1 -- 172.21.15.152:0/239872659 >> v1:172.21.15.152:6789/0 conn(0x7f5570097040 legacy=0x7f55701272b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 10 client.?.objecter ms_handle_connect 0x7f5570097040 2021-02-24T15:18:31.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:31.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041335052 0 0) 0x7f55700926b0 con 0x7f55700635f0 2021-02-24T15:18:31.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5550004bd0 con 0x7f55700635f0 2021-02-24T15:18:31.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765301484 0 0) 0x7f5570092050 con 0x7f5570097040 2021-02-24T15:18:31.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55700926b0 con 0x7f5570097040 2021-02-24T15:18:31.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 10 client.?.objecter ms_handle_connect 0x7f55700974f0 2021-02-24T15:18:31.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:31.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f557694f700 1 -- 172.21.15.152:0/239872659 >> v1:172.21.15.181:6789/0 conn(0x7f55700974f0 legacy=0x7f5570142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:31.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.354+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1121285288 0 0) 0x7f5550004bd0 con 0x7f55700635f0 2021-02-24T15:18:31.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5570092050 con 0x7f55700635f0 2021-02-24T15:18:31.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5560001bb0 con 0x7f55700635f0 2021-02-24T15:18:31.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1939306461 0 0) 0x7f55700926b0 con 0x7f5570097040 2021-02-24T15:18:31.376 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5550004bd0 con 0x7f5570097040 2021-02-24T15:18:31.376 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f556c004690 con 0x7f5570097040 2021-02-24T15:18:31.376 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 712579648 0 0) 0x7f5570092050 con 0x7f55700635f0 2021-02-24T15:18:31.376 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 >> v1:172.21.15.181:6789/0 conn(0x7f55700974f0 legacy=0x7f5570142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 >> v1:172.21.15.152:6789/0 conn(0x7f5570097040 legacy=0x7f55701272b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5570095df0 con 0x7f55700635f0 2021-02-24T15:18:31.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5570090180 con 0x7f55700635f0 2021-02-24T15:18:31.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f5577150700 10 client.25175.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:31.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5570090e20 con 0x7f55700635f0 2021-02-24T15:18:31.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f5577150700 1 librados: init done 2021-02-24T15:18:31.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5560004860 con 0x7f55700635f0 2021-02-24T15:18:31.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.355+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5560004b70 con 0x7f55700635f0 2021-02-24T15:18:31.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.356+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f5560004dd0 con 0x7f55700635f0 2021-02-24T15:18:31.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.356+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(66..66 src has 1..66) v4 ==== 6551+0+0 (unknown 1392395739 0 0) 0x7f556003b650 con 0x7f55700635f0 2021-02-24T15:18:31.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.356+0000 7f555e7fc700 10 client.25175.objecter ms_dispatch 0x7f5570001510 osd_map(66..66 src has 1..66) v4 2021-02-24T15:18:31.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.356+0000 7f555e7fc700 3 client.25175.objecter handle_osd_map got epochs [66,66] > 0 2021-02-24T15:18:31.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.356+0000 7f555e7fc700 3 client.25175.objecter handle_osd_map decoding full epoch 66 2021-02-24T15:18:31.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.356+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5554004d60 con 0x7f55700635f0 2021-02-24T15:18:31.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.356+0000 7f555e7fc700 20 client.25175.objecter dump_active .. 0 homeless 2021-02-24T15:18:31.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.358+0000 7f555e7fc700 10 client.25175.objecter ms_handle_connect 0x7f55500314e0 2021-02-24T15:18:31.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.360+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f55600053e0 con 0x7f55700635f0 2021-02-24T15:18:31.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.597+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f5554005820 con 0x7f55700635f0 2021-02-24T15:18:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.599+0000 7f555e7fc700 1 -- 172.21.15.152:0/239872659 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (unknown 246732539 0 0) 0x7f55600124f0 con 0x7f55700635f0 2021-02-24T15:18:31.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.601+0000 7f5577150700 10 librados: watch_flush enter 2021-02-24T15:18:31.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.601+0000 7f5577150700 10 librados: watch_flush exit 2021-02-24T15:18:31.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.601+0000 7f5577150700 20 client.25175.objecter shutdown clearing up homeless session... 2021-02-24T15:18:31.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.601+0000 7f5577150700 10 client.25175.objecter successfully canceled tick 2021-02-24T15:18:31.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.602+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 >> v1:172.21.15.181:6812/33484 conn(0x7f55500314e0 legacy=0x7f55500339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.602+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 >> v1:172.21.15.152:6790/0 conn(0x7f55700635f0 legacy=0x7f5570126ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:31.606 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.602+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:18:31.606 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.602+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=11,kv=6,logm=69} crc {auth=1115118448,config=3140514009,health=1541626271,kv=2558848642,logm=3760100332}) 2021-02-24T15:18:31.606 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.602+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=12,kv=6,logm=68} crc {auth=3090046580,config=3140514010,health=4181980233,kv=2558848642,logm=3550763271}) 2021-02-24T15:18:31.607 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.602+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:18:31.607 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.602+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=11,kv=6,logm=69} crc {auth=1115118448,config=3140514009,health=1541626271,kv=2558848642,logm=3760100332}) 2021-02-24T15:18:31.607 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.602+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=2,health=11,kv=6,logm=69} crc {auth=1115118448,config=3140514009,health=1564589738,kv=2558848642,logm=1185940577}) 2021-02-24T15:18:31.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.605+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 shutdown_connections 2021-02-24T15:18:31.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.605+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 >> 172.21.15.152:0/239872659 conn(0x7f557009d9e0 msgr2=0x7f557009b810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:31.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.605+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 shutdown_connections 2021-02-24T15:18:31.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.605+0000 7f5577150700 1 -- 172.21.15.152:0/239872659 wait complete. 2021-02-24T15:18:31.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:31.606+0000 7f5577150700 1 librados: shutdown 2021-02-24T15:18:31.620 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.619+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:18:31.621 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.619+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1453612438}) 2021-02-24T15:18:31.621 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.619+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1274440671}) 2021-02-24T15:18:31.621 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.619+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:18:31.621 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.619+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1453612438}) 2021-02-24T15:18:31.621 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.619+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=629148143}) 2021-02-24T15:18:31.627 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.624+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:18:31.627 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.625+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=18,mdsmap=3,mgr=6,mgr_metadata=1,mgrstat=14,mon_config_key=4,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=17,osdmap=28} crc {logm=741146016,mdsmap=1531151339,mgr=2254402315,mgr_metadata=3511068172,mgrstat=1866797772,mon_config_key=3951946154,monmap=1283604369,osd_metadata=4080698752,osd_pg_creating=4072814743,osd_snap=606782570,osdmap=2741451497}) 2021-02-24T15:18:31.628 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.625+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=16,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=20,osdmap=25} crc {logm=42825986,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=315606988,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=4072814743,osd_snap=3532288786,osdmap=4069197512}) 2021-02-24T15:18:31.628 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.625+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:18:31.628 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.625+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=18,mdsmap=3,mgr=6,mgr_metadata=1,mgrstat=14,mon_config_key=4,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=17,osdmap=28} crc {logm=741146016,mdsmap=1531151339,mgr=2254402315,mgr_metadata=3511068172,mgrstat=1866797772,mon_config_key=3951946154,monmap=1283604369,osd_metadata=4080698752,osd_pg_creating=4072814743,osd_snap=606782570,osdmap=2741451497}) 2021-02-24T15:18:31.628 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.625+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=18,mdsmap=3,mgr=7,mgr_command_descs=1,mgrstat=14,mon_config_key=4,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=18,osdmap=26} crc {logm=741146016,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgrstat=3804933110,mon_config_key=3951946154,monmap=2538103691,osd_metadata=851577385,osd_pg_creating=4072814743,osd_snap=1591335525,osdmap=3191589398}) 2021-02-24T15:18:31.636 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.630+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:18:31.636 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.630+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3877520973}) 2021-02-24T15:18:31.636 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.630+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=84} crc {osdmap=1904902931}) 2021-02-24T15:18:31.636 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.630+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:18:31.637 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.630+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3877520973}) 2021-02-24T15:18:31.637 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:18:31.630+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=87} crc {osdmap=519159400}) 2021-02-24T15:18:31.637 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2021-02-24T15:18:32.638 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:18:32.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:18:32.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.769+0000 7fc9858d3700 1 Processor -- start 2021-02-24T15:18:32.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.769+0000 7fc9858d3700 1 -- start start 2021-02-24T15:18:32.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.770+0000 7fc9858d3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9800922a0 con 0x7fc9800939f0 2021-02-24T15:18:32.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.770+0000 7fc9858d3700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc980092540 con 0x7fc98012e1c0 2021-02-24T15:18:32.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.770+0000 7fc9858d3700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9800927e0 con 0x7fc9800945b0 2021-02-24T15:18:32.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.770+0000 7fc97e7fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc9800939f0 0x7fc980090130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46886/0 (socket says 172.21.15.152:46886) 2021-02-24T15:18:32.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.770+0000 7fc97effd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc9800945b0 0x7fc98008fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35358/0 (socket says 172.21.15.152:35358) 2021-02-24T15:18:32.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.770+0000 7fc97e7fc700 1 -- 172.21.15.152:0/3185806786 learned_addr learned my addr 172.21.15.152:0/3185806786 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:32.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.772+0000 7fc97e7fc700 1 -- 172.21.15.152:0/3185806786 >> v1:172.21.15.152:6789/0 conn(0x7fc9800939f0 legacy=0x7fc980090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:32.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.772+0000 7fc97effd700 1 -- 172.21.15.152:0/3185806786 >> v1:172.21.15.152:6790/0 conn(0x7fc9800945b0 legacy=0x7fc98008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:32.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97f7fe700 1 -- 172.21.15.152:0/3185806786 >> v1:172.21.15.181:6789/0 conn(0x7fc98012e1c0 legacy=0x7fc9801305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:32.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869041396 0 0) 0x7fc9800922a0 con 0x7fc9800939f0 2021-02-24T15:18:32.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc96c003230 con 0x7fc9800939f0 2021-02-24T15:18:32.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296827704 0 0) 0x7fc9800927e0 con 0x7fc9800945b0 2021-02-24T15:18:32.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9800922a0 con 0x7fc9800945b0 2021-02-24T15:18:32.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3669974508 0 0) 0x7fc96c003230 con 0x7fc9800939f0 2021-02-24T15:18:32.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 >> v1:172.21.15.152:6790/0 conn(0x7fc9800945b0 legacy=0x7fc98008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:32.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 >> v1:172.21.15.181:6789/0 conn(0x7fc98012e1c0 legacy=0x7fc9801305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:32.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980092a80 con 0x7fc9800939f0 2021-02-24T15:18:32.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc9740019f0 con 0x7fc9800939f0 2021-02-24T15:18:32.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc974001c20 con 0x7fc9800939f0 2021-02-24T15:18:32.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc97dffb700 1 -- 172.21.15.152:0/3185806786 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc974004750 con 0x7fc9800939f0 2021-02-24T15:18:32.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.773+0000 7fc9858d3700 1 -- 172.21.15.152:0/3185806786 >> v1:172.21.15.152:6789/0 conn(0x7fc9800939f0 legacy=0x7fc980090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:32.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.774+0000 7fc9858d3700 1 -- 172.21.15.152:0/3185806786 shutdown_connections 2021-02-24T15:18:32.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.774+0000 7fc9858d3700 1 -- 172.21.15.152:0/3185806786 >> 172.21.15.152:0/3185806786 conn(0x7fc9800999a0 msgr2=0x7fc980099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:32.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.774+0000 7fc9858d3700 1 -- 172.21.15.152:0/3185806786 shutdown_connections 2021-02-24T15:18:32.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.774+0000 7fc9858d3700 1 -- 172.21.15.152:0/3185806786 wait complete. 2021-02-24T15:18:32.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.774+0000 7fc9858d3700 1 librados: starting msgr at 2021-02-24T15:18:32.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.774+0000 7fc9858d3700 1 librados: starting objecter 2021-02-24T15:18:32.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc9858d3700 1 Processor -- start 2021-02-24T15:18:32.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc9858d3700 1 -- start start 2021-02-24T15:18:32.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc9858d3700 1 librados: setting wanted keys 2021-02-24T15:18:32.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc9858d3700 1 librados: calling monclient init 2021-02-24T15:18:32.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc9858d3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc980064c40 con 0x7fc9800939f0 2021-02-24T15:18:32.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc9858d3700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc980065640 con 0x7fc98012e1c0 2021-02-24T15:18:32.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc9858d3700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9801368e0 con 0x7fc9800945b0 2021-02-24T15:18:32.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc97effd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc9800939f0 0x7fc980135ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46888/0 (socket says 172.21.15.152:46888) 2021-02-24T15:18:32.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc97e7fc700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc9800945b0 0x7fc9801361d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35366/0 (socket says 172.21.15.152:35366) 2021-02-24T15:18:32.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.775+0000 7fc97effd700 1 -- 172.21.15.152:0/3548874436 learned_addr learned my addr 172.21.15.152:0/3548874436 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:32.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc97effd700 1 -- 172.21.15.152:0/3548874436 >> v1:172.21.15.152:6789/0 conn(0x7fc9800939f0 legacy=0x7fc980135ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:32.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc97e7fc700 1 -- 172.21.15.152:0/3548874436 >> v1:172.21.15.152:6790/0 conn(0x7fc9800945b0 legacy=0x7fc9801361d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:32.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 10 client.?.objecter ms_handle_connect 0x7fc9800939f0 2021-02-24T15:18:32.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:32.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 10 client.?.objecter ms_handle_connect 0x7fc9800945b0 2021-02-24T15:18:32.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:32.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919211347 0 0) 0x7fc980064c40 con 0x7fc9800939f0 2021-02-24T15:18:32.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc960004bd0 con 0x7fc9800939f0 2021-02-24T15:18:32.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815549404 0 0) 0x7fc9801368e0 con 0x7fc9800945b0 2021-02-24T15:18:32.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc980064c40 con 0x7fc9800945b0 2021-02-24T15:18:32.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 10 client.?.objecter ms_handle_connect 0x7fc98012e1c0 2021-02-24T15:18:32.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc966ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:32.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.777+0000 7fc97f7fe700 1 -- 172.21.15.152:0/3548874436 >> v1:172.21.15.181:6789/0 conn(0x7fc98012e1c0 legacy=0x7fc98013e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:32.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3457218147 0 0) 0x7fc960004bd0 con 0x7fc9800939f0 2021-02-24T15:18:32.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc9801368e0 con 0x7fc9800939f0 2021-02-24T15:18:32.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2875824052 0 0) 0x7fc980064c40 con 0x7fc9800945b0 2021-02-24T15:18:32.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc960004bd0 con 0x7fc9800945b0 2021-02-24T15:18:32.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc9700044f0 con 0x7fc9800939f0 2021-02-24T15:18:32.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc9740019b0 con 0x7fc9800945b0 2021-02-24T15:18:32.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 823308454 0 0) 0x7fc9801368e0 con 0x7fc9800939f0 2021-02-24T15:18:32.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 >> v1:172.21.15.152:6790/0 conn(0x7fc9800945b0 legacy=0x7fc9801361d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:32.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 >> v1:172.21.15.181:6789/0 conn(0x7fc98012e1c0 legacy=0x7fc98013e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:32.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980066790 con 0x7fc9800939f0 2021-02-24T15:18:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc980066a90 con 0x7fc9800939f0 2021-02-24T15:18:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc9858d3700 10 client.27354.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9800674f0 con 0x7fc9800939f0 2021-02-24T15:18:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc9858d3700 1 librados: init done 2021-02-24T15:18:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc970004980 con 0x7fc9800939f0 2021-02-24T15:18:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.778+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc970004af0 con 0x7fc9800939f0 2021-02-24T15:18:32.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.779+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fc97000d6a0 con 0x7fc9800939f0 2021-02-24T15:18:32.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.779+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(67..67 src has 1..67) v4 ==== 6469+0+0 (unknown 2408050194 0 0) 0x7fc97003b380 con 0x7fc9800939f0 2021-02-24T15:18:32.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.779+0000 7fc966ffd700 10 client.27354.objecter ms_dispatch 0x7fc980001510 osd_map(67..67 src has 1..67) v4 2021-02-24T15:18:32.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.779+0000 7fc966ffd700 3 client.27354.objecter handle_osd_map got epochs [67,67] > 0 2021-02-24T15:18:32.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.779+0000 7fc966ffd700 3 client.27354.objecter handle_osd_map decoding full epoch 67 2021-02-24T15:18:32.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.779+0000 7fc966ffd700 20 client.27354.objecter dump_active .. 0 homeless 2021-02-24T15:18:32.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.779+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc958004d60 con 0x7fc9800939f0 2021-02-24T15:18:32.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.782+0000 7fc966ffd700 10 client.27354.objecter ms_handle_connect 0x7fc9600314b0 2021-02-24T15:18:32.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:32.783+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fc970012600 con 0x7fc9800939f0 2021-02-24T15:18:33.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.062+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc958005590 con 0x7fc9800939f0 2021-02-24T15:18:33.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.063+0000 7fc966ffd700 1 -- 172.21.15.152:0/3548874436 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 1930804919) 0x7fc9700121f0 con 0x7fc9800939f0 2021-02-24T15:18:33.067 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:18:33.072 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.064+0000 7fc9858d3700 10 librados: watch_flush enter 2021-02-24T15:18:33.072 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 10 librados: watch_flush exit 2021-02-24T15:18:33.076 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 20 client.27354.objecter shutdown clearing up homeless session... 2021-02-24T15:18:33.076 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 10 client.27354.objecter successfully canceled tick 2021-02-24T15:18:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 >> v1:172.21.15.181:6812/33484 conn(0x7fc9600314b0 legacy=0x7fc960033970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 >> v1:172.21.15.152:6789/0 conn(0x7fc9800939f0 legacy=0x7fc980135ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 shutdown_connections 2021-02-24T15:18:33.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 >> 172.21.15.152:0/3548874436 conn(0x7fc9800999a0 msgr2=0x7fc98012d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:33.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 shutdown_connections 2021-02-24T15:18:33.080 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 1 -- 172.21.15.152:0/3548874436 wait complete. 2021-02-24T15:18:33.080 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.065+0000 7fc9858d3700 1 librados: shutdown 2021-02-24T15:18:33.084 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:18:33.086 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-02-24T15:18:33.087 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:18:33.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.219+0000 7f458af4c700 1 Processor -- start 2021-02-24T15:18:33.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.219+0000 7f458af4c700 1 -- start start 2021-02-24T15:18:33.222 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.220+0000 7f458af4c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45840637e0 con 0x7f4584063070 2021-02-24T15:18:33.222 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.220+0000 7f458af4c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4584097500 con 0x7f4584068390 2021-02-24T15:18:33.223 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.220+0000 7f458af4c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4584063d40 con 0x7f4584131270 2021-02-24T15:18:33.223 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.220+0000 7f4588ce8700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4584063070 0x7f45840966e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46896/0 (socket says 172.21.15.152:46896) 2021-02-24T15:18:33.223 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.220+0000 7f45894e9700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f4584131270 0x7f4584133660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35372/0 (socket says 172.21.15.152:35372) 2021-02-24T15:18:33.223 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.220+0000 7f4588ce8700 1 -- 172.21.15.152:0/62974897 learned_addr learned my addr 172.21.15.152:0/62974897 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:33.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.222+0000 7f45894e9700 1 -- 172.21.15.152:0/62974897 >> v1:172.21.15.152:6790/0 conn(0x7f4584131270 legacy=0x7f4584133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.222+0000 7f4588ce8700 1 -- 172.21.15.152:0/62974897 >> v1:172.21.15.152:6789/0 conn(0x7f4584063070 legacy=0x7f45840966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.222+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706451128 0 0) 0x7f4584063d40 con 0x7f4584131270 2021-02-24T15:18:33.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.222+0000 7f4583fff700 1 -- 172.21.15.152:0/62974897 >> v1:172.21.15.181:6789/0 conn(0x7f4584068390 legacy=0x7f4584096df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.222+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4568003230 con 0x7f4584131270 2021-02-24T15:18:33.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.222+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904578654 0 0) 0x7f45840637e0 con 0x7f4584063070 2021-02-24T15:18:33.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.222+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4584063d40 con 0x7f4584063070 2021-02-24T15:18:33.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3796673268 0 0) 0x7f4584063d40 con 0x7f4584063070 2021-02-24T15:18:33.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 >> v1:172.21.15.152:6790/0 conn(0x7f4584131270 legacy=0x7f4584133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 >> v1:172.21.15.181:6789/0 conn(0x7f4584068390 legacy=0x7f4584096df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584063fe0 con 0x7f4584063070 2021-02-24T15:18:33.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f45780019f0 con 0x7f4584063070 2021-02-24T15:18:33.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4578001c60 con 0x7f4584063070 2021-02-24T15:18:33.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f45837fe700 1 -- 172.21.15.152:0/62974897 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4578004750 con 0x7f4584063070 2021-02-24T15:18:33.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f458af4c700 1 -- 172.21.15.152:0/62974897 >> v1:172.21.15.152:6789/0 conn(0x7f4584063070 legacy=0x7f45840966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f458af4c700 1 -- 172.21.15.152:0/62974897 shutdown_connections 2021-02-24T15:18:33.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f458af4c700 1 -- 172.21.15.152:0/62974897 >> 172.21.15.152:0/62974897 conn(0x7f458409ba40 msgr2=0x7f458409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:33.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f458af4c700 1 -- 172.21.15.152:0/62974897 shutdown_connections 2021-02-24T15:18:33.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.223+0000 7f458af4c700 1 -- 172.21.15.152:0/62974897 wait complete. 2021-02-24T15:18:33.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.224+0000 7f458af4c700 1 librados: starting msgr at 2021-02-24T15:18:33.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.224+0000 7f458af4c700 1 librados: starting objecter 2021-02-24T15:18:33.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.224+0000 7f458af4c700 1 Processor -- start 2021-02-24T15:18:33.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.224+0000 7f458af4c700 1 -- start start 2021-02-24T15:18:33.239 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.224+0000 7f458af4c700 1 librados: setting wanted keys 2021-02-24T15:18:33.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.224+0000 7f458af4c700 1 librados: calling monclient init 2021-02-24T15:18:33.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.225+0000 7f458af4c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4584112410 con 0x7f4584063070 2021-02-24T15:18:33.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.225+0000 7f458af4c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4584067100 con 0x7f4584068390 2021-02-24T15:18:33.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.225+0000 7f458af4c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45841141e0 con 0x7f4584131270 2021-02-24T15:18:33.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.225+0000 7f4588ce8700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4584063070 0x7f45840662e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46900/0 (socket says 172.21.15.152:46900) 2021-02-24T15:18:33.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.225+0000 7f4588ce8700 1 -- 172.21.15.152:0/3922751243 learned_addr learned my addr 172.21.15.152:0/3922751243 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:33.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f45894e9700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6790/0 conn(0x7f4584131270 legacy=0x7f4584142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.241 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4588ce8700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6789/0 conn(0x7f4584063070 legacy=0x7f45840662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 10 client.?.objecter ms_handle_connect 0x7f4584131270 2021-02-24T15:18:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 10 client.?.objecter ms_handle_connect 0x7f4584063070 2021-02-24T15:18:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4583fff700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.181:6789/0 conn(0x7f4584068390 legacy=0x7f45840669f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 10 client.?.objecter ms_handle_connect 0x7f4584068390 2021-02-24T15:18:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303986428 0 0) 0x7f45841141e0 con 0x7f4584131270 2021-02-24T15:18:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4564004bd0 con 0x7f4584131270 2021-02-24T15:18:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308370593 0 0) 0x7f4584112410 con 0x7f4584063070 2021-02-24T15:18:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45841141e0 con 0x7f4584063070 2021-02-24T15:18:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384080222 0 0) 0x7f4584067100 con 0x7f4584068390 2021-02-24T15:18:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4584112410 con 0x7f4584068390 2021-02-24T15:18:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 722322351 0 0) 0x7f4564004bd0 con 0x7f4584131270 2021-02-24T15:18:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4584067100 con 0x7f4584131270 2021-02-24T15:18:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f457c001fe0 con 0x7f4584131270 2021-02-24T15:18:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2952191337 0 0) 0x7f45841141e0 con 0x7f4584063070 2021-02-24T15:18:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4564004bd0 con 0x7f4584063070 2021-02-24T15:18:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f45780019b0 con 0x7f4584063070 2021-02-24T15:18:33.246 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3298315810 0 0) 0x7f4584112410 con 0x7f4584068390 2021-02-24T15:18:33.246 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f45841141e0 con 0x7f4584068390 2021-02-24T15:18:33.246 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.227+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4570001b60 con 0x7f4584068390 2021-02-24T15:18:33.246 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3195207269 0 0) 0x7f4584067100 con 0x7f4584131270 2021-02-24T15:18:33.247 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.181:6789/0 conn(0x7f4584068390 legacy=0x7f45840669f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.247 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6789/0 conn(0x7f4584063070 legacy=0x7f45840662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.247 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584114480 con 0x7f4584131270 2021-02-24T15:18:33.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4584095770 con 0x7f4584131270 2021-02-24T15:18:33.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f458af4c700 10 client.25247.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4584129da0 con 0x7f4584131270 2021-02-24T15:18:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f458af4c700 1 librados: init done 2021-02-24T15:18:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f457c004be0 con 0x7f4584131270 2021-02-24T15:18:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f457c004ef0 con 0x7f4584131270 2021-02-24T15:18:33.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f457c0050d0 con 0x7f4584131270 2021-02-24T15:18:33.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.228+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f455c006550 con 0x7f455c0027f0 2021-02-24T15:18:33.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.229+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(68..68 src has 1..68) v4 ==== 6950+0+0 (unknown 1876475697 0 0) 0x7f457c03b8a0 con 0x7f4584131270 2021-02-24T15:18:33.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.229+0000 7f4580ff9700 10 client.25247.objecter ms_dispatch 0x7f4584001510 osd_map(68..68 src has 1..68) v4 2021-02-24T15:18:33.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.229+0000 7f4580ff9700 3 client.25247.objecter handle_osd_map got epochs [68,68] > 0 2021-02-24T15:18:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.229+0000 7f4580ff9700 3 client.25247.objecter handle_osd_map decoding full epoch 68 2021-02-24T15:18:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.229+0000 7f4580ff9700 20 client.25247.objecter dump_active .. 0 homeless 2021-02-24T15:18:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 10 client.25247.objecter ms_handle_connect 0x7f455c0027f0 2021-02-24T15:18:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 10 client.25247.objecter resend_mon_ops 2021-02-24T15:18:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4588ce8700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6789/0 conn(0x7f455c0027f0 legacy=0x7f455c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180855010 0 0) 0x7f455c006550 con 0x7f455c0027f0 2021-02-24T15:18:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4584067100 con 0x7f455c0027f0 2021-02-24T15:18:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1989955147 0 0) 0x7f4584067100 con 0x7f455c0027f0 2021-02-24T15:18:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f455c006550 con 0x7f455c0027f0 2021-02-24T15:18:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4578005170 con 0x7f455c0027f0 2021-02-24T15:18:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 10 client.25247.objecter ms_handle_connect 0x7f45640317c0 2021-02-24T15:18:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3369181237 0 0) 0x7f455c006550 con 0x7f455c0027f0 2021-02-24T15:18:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f455c009df0 con 0x7f455c0027f0 2021-02-24T15:18:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f4578007350 con 0x7f455c0027f0 2021-02-24T15:18:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.231+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6789/0 conn(0x7f455c0027f0 legacy=0x7f455c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.232+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6789/0 conn(0x7f455c0027f0 legacy=0x7f455c004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.239+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f455c009a80 con 0x7f455c008da0 2021-02-24T15:18:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 10 client.25247.objecter ms_handle_connect 0x7f455c008da0 2021-02-24T15:18:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4588ce8700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6789/0 conn(0x7f455c008da0 legacy=0x7f455c009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 10 client.25247.objecter resend_mon_ops 2021-02-24T15:18:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528259735 0 0) 0x7f455c009a80 con 0x7f455c008da0 2021-02-24T15:18:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f455c006550 con 0x7f455c008da0 2021-02-24T15:18:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 514740295 0 0) 0x7f455c006550 con 0x7f455c008da0 2021-02-24T15:18:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f455c009a80 con 0x7f455c008da0 2021-02-24T15:18:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4578005890 con 0x7f455c008da0 2021-02-24T15:18:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 897455638 0 0) 0x7f455c009a80 con 0x7f455c008da0 2021-02-24T15:18:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f455c0086f0 con 0x7f455c008da0 2021-02-24T15:18:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3942 (unknown 0 0 549700209) 0x7f4578007620 con 0x7f455c008da0 2021-02-24T15:18:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6789/0 conn(0x7f455c008da0 legacy=0x7f455c009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.242+0000 7f4580ff9700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6789/0 conn(0x7f455c008da0 legacy=0x7f455c009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:33.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 10 librados: watch_flush enter 2021-02-24T15:18:33.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 10 librados: watch_flush exit 2021-02-24T15:18:33.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 20 client.25247.objecter shutdown clearing up homeless session... 2021-02-24T15:18:33.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 10 client.25247.objecter successfully canceled tick 2021-02-24T15:18:33.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.181:6812/33484 conn(0x7f45640317c0 legacy=0x7f4564033c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 >> v1:172.21.15.152:6790/0 conn(0x7f4584131270 legacy=0x7f4584142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f45894e9700 1 -- 172.21.15.152:0/3922751243 reap_dead start 2021-02-24T15:18:33.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f45894e9700 1 -- 172.21.15.152:0/3922751243 reap_dead start 2021-02-24T15:18:33.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 shutdown_connections 2021-02-24T15:18:33.266 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 >> 172.21.15.152:0/3922751243 conn(0x7f458409ba40 msgr2=0x7f45841309e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:33.266 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 shutdown_connections 2021-02-24T15:18:33.266 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 1 -- 172.21.15.152:0/3922751243 wait complete. 2021-02-24T15:18:33.266 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.243+0000 7f458af4c700 1 librados: shutdown 2021-02-24T15:18:33.267 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:18:33.267 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:33.267 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:33.267 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:18:33.267 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 14, 2021-02-24T15:18:33.268 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:18:33.268 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:18:33.268 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:18:33.268 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:18:33.268 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.269 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:18:33.269 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:33.270 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:18:33.270 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:18:33.270 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:33.270 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:33.271 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:33.271 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:33.271 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:33.278 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:33.279 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:33.279 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:33.279 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:33.279 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.280 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:18:33.280 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:18:33.281 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:33.281 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:33.281 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:33.281 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:33.281 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:33.282 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:33.282 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:33.282 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:33.282 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:33.282 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.283 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:18:33.283 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:18:33.283 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:18:33.284 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:18:33.284 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:18:33.284 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:18:33.285 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:33.285 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:33.285 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:18:33.285 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:18:33.286 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:18:33.286 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:18:33.286 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:18:33.286 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:33.286 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:18:33.287 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:33.287 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:33.287 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:33.287 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:33.287 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:33.288 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:33.288 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:33.288 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:33.288 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:33.288 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.289 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:18:33.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.289 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:18:33.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.289 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:33.290 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:33.290 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:33.290 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:33.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.292 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:33.292 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:18:33.292 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:33.292 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.292 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.293 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:18:33.293 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:18:33.293 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:33.293 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:33.294 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:33.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.294 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:33.294 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:33.295 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:33.295 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:33.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.295 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:33.295 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:18:33.296 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:33.296 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.296 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.296 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:18:33.297 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:18:33.297 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:33.297 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:33.297 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:33.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.298 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:33.298 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:33.298 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:33.299 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:33.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.299 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:33.299 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:18:33.299 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:33.300 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.300 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.300 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:18:33.300 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:18:33.301 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:33.301 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:33.301 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:33.302 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.302 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.302 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:18:33.303 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:18:33.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.303 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:33.303 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:33.304 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:33.304 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.304 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.304 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:18:33.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.305 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:33.305 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:33.305 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:33.305 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.305 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.306 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:18:33.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.306 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:33.306 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:33.306 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:18:33.307 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.307 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.307 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:18:33.307 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:18:33.309 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:18:33.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.432+0000 7f7584f48700 1 Processor -- start 2021-02-24T15:18:33.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.432+0000 7f7584f48700 1 -- start start 2021-02-24T15:18:33.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.432+0000 7f7584f48700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7580097d40 con 0x7f7580062da0 2021-02-24T15:18:33.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.432+0000 7f7584f48700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7580063d00 con 0x7f7580099340 2021-02-24T15:18:33.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.432+0000 7f7584f48700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7580097980 con 0x7f7580063220 2021-02-24T15:18:33.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.433+0000 7f757ed9d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f7580063220 0x7f7580133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35388/0 (socket says 172.21.15.152:35388) 2021-02-24T15:18:33.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.433+0000 7f757dd9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7580062da0 0x7f758012fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46912/0 (socket says 172.21.15.152:46912) 2021-02-24T15:18:33.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.433+0000 7f757ed9d700 1 -- 172.21.15.152:0/4096482737 learned_addr learned my addr 172.21.15.152:0/4096482737 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:33.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757dd9b700 1 -- 172.21.15.152:0/4096482737 >> v1:172.21.15.152:6789/0 conn(0x7f7580062da0 legacy=0x7f758012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757ed9d700 1 -- 172.21.15.152:0/4096482737 >> v1:172.21.15.152:6790/0 conn(0x7f7580063220 legacy=0x7f7580133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757e59c700 1 -- 172.21.15.152:0/4096482737 >> v1:172.21.15.181:6789/0 conn(0x7f7580099340 legacy=0x7f7580097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278628933 0 0) 0x7f7580097d40 con 0x7f7580062da0 2021-02-24T15:18:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7564003230 con 0x7f7580062da0 2021-02-24T15:18:33.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672709397 0 0) 0x7f7580097980 con 0x7f7580063220 2021-02-24T15:18:33.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7580097d40 con 0x7f7580063220 2021-02-24T15:18:33.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041193795 0 0) 0x7f7580063d00 con 0x7f7580099340 2021-02-24T15:18:33.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7580097980 con 0x7f7580099340 2021-02-24T15:18:33.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 152366877 0 0) 0x7f7580097980 con 0x7f7580099340 2021-02-24T15:18:33.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 >> v1:172.21.15.152:6790/0 conn(0x7f7580063220 legacy=0x7f7580133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 >> v1:172.21.15.152:6789/0 conn(0x7f7580062da0 legacy=0x7f758012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758008fac0 con 0x7f7580099340 2021-02-24T15:18:33.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75700018a0 con 0x7f7580099340 2021-02-24T15:18:33.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7570001bb0 con 0x7f7580099340 2021-02-24T15:18:33.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.435+0000 7f757d59a700 1 -- 172.21.15.152:0/4096482737 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7570002060 con 0x7f7580099340 2021-02-24T15:18:33.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.436+0000 7f7584f48700 1 -- 172.21.15.152:0/4096482737 >> v1:172.21.15.181:6789/0 conn(0x7f7580099340 legacy=0x7f7580097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.436+0000 7f7584f48700 1 -- 172.21.15.152:0/4096482737 shutdown_connections 2021-02-24T15:18:33.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.436+0000 7f7584f48700 1 -- 172.21.15.152:0/4096482737 >> 172.21.15.152:0/4096482737 conn(0x7f758009dcc0 msgr2=0x7f758009e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:33.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.436+0000 7f7584f48700 1 -- 172.21.15.152:0/4096482737 shutdown_connections 2021-02-24T15:18:33.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.436+0000 7f7584f48700 1 -- 172.21.15.152:0/4096482737 wait complete. 2021-02-24T15:18:33.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f7584f48700 1 librados: starting msgr at 2021-02-24T15:18:33.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f7584f48700 1 librados: starting objecter 2021-02-24T15:18:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f7584f48700 1 Processor -- start 2021-02-24T15:18:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f7584f48700 1 -- start start 2021-02-24T15:18:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f7584f48700 1 librados: setting wanted keys 2021-02-24T15:18:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f7584f48700 1 librados: calling monclient init 2021-02-24T15:18:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f7584f48700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75800998b0 con 0x7f7580062da0 2021-02-24T15:18:33.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f7584f48700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7580095090 con 0x7f7580063220 2021-02-24T15:18:33.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f7584f48700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7580126260 con 0x7f7580099340 2021-02-24T15:18:33.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f757e59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7580062da0 0x7f758013a0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46916/0 (socket says 172.21.15.152:46916) 2021-02-24T15:18:33.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.437+0000 7f757e59c700 1 -- 172.21.15.152:0/146113309 learned_addr learned my addr 172.21.15.152:0/146113309 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:33.462 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.439+0000 7f757e59c700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6789/0 conn(0x7f7580062da0 legacy=0x7f758013a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.462 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.439+0000 7f757ed9d700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6790/0 conn(0x7f7580099340 legacy=0x7f7580142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.462 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.439+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 DispatchQueue::entry inject delay of 0.002000 2021-02-24T15:18:33.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.440+0000 7f757dd9b700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.181:6789/0 conn(0x7f7580063220 legacy=0x7f7580096fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 10 client.?.objecter ms_handle_connect 0x7f7580062da0 2021-02-24T15:18:33.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 10 client.?.objecter ms_handle_connect 0x7f7580099340 2021-02-24T15:18:33.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 10 client.?.objecter ms_handle_connect 0x7f7580063220 2021-02-24T15:18:33.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457329030 0 0) 0x7f75800998b0 con 0x7f7580062da0 2021-02-24T15:18:33.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f755c004bd0 con 0x7f7580062da0 2021-02-24T15:18:33.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129215782 0 0) 0x7f7580095090 con 0x7f7580063220 2021-02-24T15:18:33.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75800998b0 con 0x7f7580063220 2021-02-24T15:18:33.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.441+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813386598 0 0) 0x7f7580126260 con 0x7f7580099340 2021-02-24T15:18:33.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7580095090 con 0x7f7580099340 2021-02-24T15:18:33.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1018400382 0 0) 0x7f755c004bd0 con 0x7f7580062da0 2021-02-24T15:18:33.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7580126260 con 0x7f7580062da0 2021-02-24T15:18:33.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75700018a0 con 0x7f7580062da0 2021-02-24T15:18:33.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3718732074 0 0) 0x7f7580095090 con 0x7f7580099340 2021-02-24T15:18:33.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f755c004bd0 con 0x7f7580099340 2021-02-24T15:18:33.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7578001fe0 con 0x7f7580099340 2021-02-24T15:18:33.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2834227026 0 0) 0x7f75800998b0 con 0x7f7580063220 2021-02-24T15:18:33.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7580095090 con 0x7f7580063220 2021-02-24T15:18:33.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7574001c60 con 0x7f7580063220 2021-02-24T15:18:33.468 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2440527717 0 0) 0x7f755c004bd0 con 0x7f7580099340 2021-02-24T15:18:33.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.181:6789/0 conn(0x7f7580063220 legacy=0x7f7580096fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6789/0 conn(0x7f7580062da0 legacy=0x7f758013a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7580095b70 con 0x7f7580099340 2021-02-24T15:18:33.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758013a8b0 con 0x7f7580099340 2021-02-24T15:18:33.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f7584f48700 10 client.25253.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:33.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7580094550 con 0x7f7580099340 2021-02-24T15:18:33.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f7584f48700 1 librados: init done 2021-02-24T15:18:33.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7578004b20 con 0x7f7580099340 2021-02-24T15:18:33.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.442+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7578004e30 con 0x7f7580099340 2021-02-24T15:18:33.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.443+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f757800d930 con 0x7f7580099340 2021-02-24T15:18:33.472 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.443+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f7560006550 con 0x7f75600027f0 2021-02-24T15:18:33.472 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.443+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(68..68 src has 1..68) v4 ==== 6950+0+0 (unknown 1876475697 0 0) 0x7f757803b840 con 0x7f7580099340 2021-02-24T15:18:33.472 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.443+0000 7f756e7fc700 10 client.25253.objecter ms_dispatch 0x7f7580001510 osd_map(68..68 src has 1..68) v4 2021-02-24T15:18:33.472 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.443+0000 7f756e7fc700 3 client.25253.objecter handle_osd_map got epochs [68,68] > 0 2021-02-24T15:18:33.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.443+0000 7f756e7fc700 3 client.25253.objecter handle_osd_map decoding full epoch 68 2021-02-24T15:18:33.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.443+0000 7f756e7fc700 20 client.25253.objecter dump_active .. 0 homeless 2021-02-24T15:18:33.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f757e59c700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6790/0 conn(0x7f75600027f0 legacy=0x7f7560004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.474 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f756e7fc700 10 client.25253.objecter ms_handle_connect 0x7f75600027f0 2021-02-24T15:18:33.474 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f756e7fc700 10 client.25253.objecter resend_mon_ops 2021-02-24T15:18:33.474 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674907134 0 0) 0x7f7560006550 con 0x7f75600027f0 2021-02-24T15:18:33.474 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f755c004bd0 con 0x7f75600027f0 2021-02-24T15:18:33.475 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2878748490 0 0) 0x7f755c004bd0 con 0x7f75600027f0 2021-02-24T15:18:33.475 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7560006550 con 0x7f75600027f0 2021-02-24T15:18:33.475 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7570002b80 con 0x7f75600027f0 2021-02-24T15:18:33.475 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2154726416 0 0) 0x7f7560006550 con 0x7f75600027f0 2021-02-24T15:18:33.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.445+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7560009df0 con 0x7f75600027f0 2021-02-24T15:18:33.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.446+0000 7f756e7fc700 10 client.25253.objecter ms_handle_connect 0x7f755c031830 2021-02-24T15:18:33.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.446+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f7570001580 con 0x7f75600027f0 2021-02-24T15:18:33.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.446+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6790/0 conn(0x7f75600027f0 legacy=0x7f7560004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.477 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.446+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6790/0 conn(0x7f75600027f0 legacy=0x7f7560004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:33.481 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.453+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f7560007520 con 0x7f75600068c0 2021-02-24T15:18:33.482 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f757e59c700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6790/0 conn(0x7f75600068c0 legacy=0x7f7560006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.482 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 10 client.25253.objecter ms_handle_connect 0x7f75600068c0 2021-02-24T15:18:33.483 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 10 client.25253.objecter resend_mon_ops 2021-02-24T15:18:33.483 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042550011 0 0) 0x7f7560007520 con 0x7f75600068c0 2021-02-24T15:18:33.483 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7560006550 con 0x7f75600068c0 2021-02-24T15:18:33.484 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3668187140 0 0) 0x7f7560006550 con 0x7f75600068c0 2021-02-24T15:18:33.484 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7560007520 con 0x7f75600068c0 2021-02-24T15:18:33.484 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f75700059b0 con 0x7f75600068c0 2021-02-24T15:18:33.485 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1169742306 0 0) 0x7f7560007520 con 0x7f75600068c0 2021-02-24T15:18:33.485 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7560008720 con 0x7f75600068c0 2021-02-24T15:18:33.485 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4110 (unknown 0 0 1003276882) 0x7f7570005d50 con 0x7f75600068c0 2021-02-24T15:18:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6790/0 conn(0x7f75600068c0 legacy=0x7f7560006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.456+0000 7f756e7fc700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6790/0 conn(0x7f75600068c0 legacy=0x7f7560006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 10 librados: watch_flush enter 2021-02-24T15:18:33.487 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 10 librados: watch_flush exit 2021-02-24T15:18:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 20 client.25253.objecter shutdown clearing up homeless session... 2021-02-24T15:18:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 10 client.25253.objecter successfully canceled tick 2021-02-24T15:18:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.181:6812/33484 conn(0x7f755c031830 legacy=0x7f755c033cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 >> v1:172.21.15.152:6790/0 conn(0x7f7580099340 legacy=0x7f7580142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f757ed9d700 1 -- 172.21.15.152:0/146113309 reap_dead start 2021-02-24T15:18:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f757ed9d700 1 -- 172.21.15.152:0/146113309 reap_dead start 2021-02-24T15:18:33.490 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 shutdown_connections 2021-02-24T15:18:33.490 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 >> 172.21.15.152:0/146113309 conn(0x7f758009dcc0 msgr2=0x7f758009c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:33.490 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 shutdown_connections 2021-02-24T15:18:33.490 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 1 -- 172.21.15.152:0/146113309 wait complete. 2021-02-24T15:18:33.491 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.457+0000 7f7584f48700 1 librados: shutdown 2021-02-24T15:18:33.491 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:18:33.491 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:33.491 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:33.492 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:18:33.492 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 14, 2021-02-24T15:18:33.492 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:18:33.492 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:18:33.493 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:18:33.493 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:18:33.493 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.493 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:18:33.494 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:33.494 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:18:33.494 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:18:33.494 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:33.494 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:33.495 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:33.495 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:33.495 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:33.495 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:33.496 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:33.496 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:33.496 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:33.496 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.496 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:18:33.497 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:18:33.497 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:33.497 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:33.498 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:33.498 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:33.498 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:33.498 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:33.498 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:33.499 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:33.499 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:33.499 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.499 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:18:33.500 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:18:33.500 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:18:33.500 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:18:33.500 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:18:33.501 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:18:33.501 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:33.501 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:33.501 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:18:33.502 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:18:33.502 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:18:33.502 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:18:33.502 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:18:33.503 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:33.503 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:18:33.503 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:33.503 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:33.503 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:33.504 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:33.504 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:33.504 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:33.504 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:33.505 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:33.505 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:33.505 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.505 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:18:33.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.506 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:18:33.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.506 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:33.506 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:33.507 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:33.507 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:33.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.507 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:33.507 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:18:33.508 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:33.508 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.508 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.509 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:18:33.509 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:18:33.509 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:33.510 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:33.510 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:33.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.511 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:33.511 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:33.511 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:33.511 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:33.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.512 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:33.512 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:18:33.512 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:33.512 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.512 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.513 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:18:33.513 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:18:33.513 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:33.514 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:33.514 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:33.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.514 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:33.515 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:33.515 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:33.515 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:33.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.515 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:33.516 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:18:33.516 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:33.516 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.516 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.517 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:18:33.517 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:18:33.517 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:33.517 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:33.518 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:33.518 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.518 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.518 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:18:33.519 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:18:33.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.519 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:33.519 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:33.519 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:33.520 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.520 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.520 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:18:33.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.521 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:33.521 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:33.521 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:18:33.521 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.521 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.522 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:18:33.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.522 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:33.522 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:33.523 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6 2021-02-24T15:18:33.523 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.523 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.523 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:18:33.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.524 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:33.524 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:33.524 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:33.525 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.525 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.525 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:18:33.525 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:18:33.526 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:18:33.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.645+0000 7f068be1a700 1 Processor -- start 2021-02-24T15:18:33.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.645+0000 7f068be1a700 1 -- start start 2021-02-24T15:18:33.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.645+0000 7f068be1a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0684068930 con 0x7f0684090720 2021-02-24T15:18:33.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.645+0000 7f068be1a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0684068bd0 con 0x7f0684097550 2021-02-24T15:18:33.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.645+0000 7f068be1a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068408e260 con 0x7f0684090ba0 2021-02-24T15:18:33.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.646+0000 7f06893b5700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0684090720 0x7f068412fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46928/0 (socket says 172.21.15.152:46928) 2021-02-24T15:18:33.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.646+0000 7f068a3b7700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f0684090ba0 0x7f06841334d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35408/0 (socket says 172.21.15.152:35408) 2021-02-24T15:18:33.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.646+0000 7f06893b5700 1 -- 172.21.15.152:0/2904331906 learned_addr learned my addr 172.21.15.152:0/2904331906 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:33.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f06893b5700 1 -- 172.21.15.152:0/2904331906 >> v1:172.21.15.152:6789/0 conn(0x7f0684090720 legacy=0x7f068412fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f068a3b7700 1 -- 172.21.15.152:0/2904331906 >> v1:172.21.15.152:6790/0 conn(0x7f0684090ba0 legacy=0x7f06841334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0689bb6700 1 -- 172.21.15.152:0/2904331906 >> v1:172.21.15.181:6789/0 conn(0x7f0684097550 legacy=0x7f0684127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172386063 0 0) 0x7f068408e260 con 0x7f0684090ba0 2021-02-24T15:18:33.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f066c003230 con 0x7f0684090ba0 2021-02-24T15:18:33.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859002436 0 0) 0x7f0684068930 con 0x7f0684090720 2021-02-24T15:18:33.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f068408e260 con 0x7f0684090720 2021-02-24T15:18:33.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987167030 0 0) 0x7f0684068bd0 con 0x7f0684097550 2021-02-24T15:18:33.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0684068930 con 0x7f0684097550 2021-02-24T15:18:33.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 501008927 0 0) 0x7f0684068930 con 0x7f0684097550 2021-02-24T15:18:33.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 >> v1:172.21.15.152:6790/0 conn(0x7f0684090ba0 legacy=0x7f06841334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.658 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 >> v1:172.21.15.152:6789/0 conn(0x7f0684090720 legacy=0x7f068412fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684067fd0 con 0x7f0684097550 2021-02-24T15:18:33.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f06800018a0 con 0x7f0684097550 2021-02-24T15:18:33.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0680001bc0 con 0x7f0684097550 2021-02-24T15:18:33.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.648+0000 7f0688bb4700 1 -- 172.21.15.152:0/2904331906 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0680002060 con 0x7f0684097550 2021-02-24T15:18:33.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.649+0000 7f068be1a700 1 -- 172.21.15.152:0/2904331906 >> v1:172.21.15.181:6789/0 conn(0x7f0684097550 legacy=0x7f0684127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.649+0000 7f068be1a700 1 -- 172.21.15.152:0/2904331906 shutdown_connections 2021-02-24T15:18:33.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.649+0000 7f068be1a700 1 -- 172.21.15.152:0/2904331906 >> 172.21.15.152:0/2904331906 conn(0x7f068409ab10 msgr2=0x7f0684096ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:33.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.649+0000 7f068be1a700 1 -- 172.21.15.152:0/2904331906 shutdown_connections 2021-02-24T15:18:33.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.649+0000 7f068be1a700 1 -- 172.21.15.152:0/2904331906 wait complete. 2021-02-24T15:18:33.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.649+0000 7f068be1a700 1 librados: starting msgr at 2021-02-24T15:18:33.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.649+0000 7f068be1a700 1 librados: starting objecter 2021-02-24T15:18:33.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.650+0000 7f068be1a700 1 Processor -- start 2021-02-24T15:18:33.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.650+0000 7f068be1a700 1 -- start start 2021-02-24T15:18:33.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.650+0000 7f068be1a700 1 librados: setting wanted keys 2021-02-24T15:18:33.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.650+0000 7f068be1a700 1 librados: calling monclient init 2021-02-24T15:18:33.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.650+0000 7f068be1a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0684133bf0 con 0x7f0684090ba0 2021-02-24T15:18:33.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.650+0000 7f068be1a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0684068230 con 0x7f0684097550 2021-02-24T15:18:33.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.650+0000 7f068be1a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068408d0c0 con 0x7f0684090720 2021-02-24T15:18:33.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.650+0000 7f0689bb6700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f0684090720 0x7f068408d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35410/0 (socket says 172.21.15.152:35410) 2021-02-24T15:18:33.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.650+0000 7f0689bb6700 1 -- 172.21.15.152:0/2229929272 learned_addr learned my addr 172.21.15.152:0/2229929272 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:33.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.652+0000 7f06893b5700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.152:6789/0 conn(0x7f0684090ba0 legacy=0x7f068408a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.652+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 DispatchQueue::entry inject delay of 0.002000 2021-02-24T15:18:33.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.652+0000 7f0689bb6700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.152:6790/0 conn(0x7f0684090720 legacy=0x7f068408d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.652+0000 7f068a3b7700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.181:6789/0 conn(0x7f0684097550 legacy=0x7f06841420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 10 client.?.objecter ms_handle_connect 0x7f0684090ba0 2021-02-24T15:18:33.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 10 client.?.objecter ms_handle_connect 0x7f0684090720 2021-02-24T15:18:33.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 10 client.?.objecter ms_handle_connect 0x7f0684097550 2021-02-24T15:18:33.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316203350 0 0) 0x7f0684133bf0 con 0x7f0684090ba0 2021-02-24T15:18:33.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0664004bd0 con 0x7f0684090ba0 2021-02-24T15:18:33.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859436774 0 0) 0x7f0684068230 con 0x7f0684097550 2021-02-24T15:18:33.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0684133bf0 con 0x7f0684097550 2021-02-24T15:18:33.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150143928 0 0) 0x7f068408d0c0 con 0x7f0684090720 2021-02-24T15:18:33.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.654+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0684068230 con 0x7f0684090720 2021-02-24T15:18:33.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1783414101 0 0) 0x7f0664004bd0 con 0x7f0684090ba0 2021-02-24T15:18:33.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f068408d0c0 con 0x7f0684090ba0 2021-02-24T15:18:33.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0674001bb0 con 0x7f0684090ba0 2021-02-24T15:18:33.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4078723163 0 0) 0x7f0684068230 con 0x7f0684090720 2021-02-24T15:18:33.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0664004bd0 con 0x7f0684090720 2021-02-24T15:18:33.678 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2237048802 0 0) 0x7f0684133bf0 con 0x7f0684097550 2021-02-24T15:18:33.678 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0684068230 con 0x7f0684097550 2021-02-24T15:18:33.680 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f06800018a0 con 0x7f0684090720 2021-02-24T15:18:33.680 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f067c001c10 con 0x7f0684097550 2021-02-24T15:18:33.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2702934837 0 0) 0x7f068408d0c0 con 0x7f0684090ba0 2021-02-24T15:18:33.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.152:6790/0 conn(0x7f0684090720 legacy=0x7f068408d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.181:6789/0 conn(0x7f0684097550 legacy=0x7f06841420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068408d360 con 0x7f0684090ba0 2021-02-24T15:18:33.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068408abe0 con 0x7f0684090ba0 2021-02-24T15:18:33.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0674004860 con 0x7f0684090ba0 2021-02-24T15:18:33.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0674004b70 con 0x7f0684090ba0 2021-02-24T15:18:33.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f068be1a700 10 client.27378.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:33.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0684089e50 con 0x7f0684090ba0 2021-02-24T15:18:33.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.655+0000 7f068be1a700 1 librados: init done 2021-02-24T15:18:33.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.656+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f067400d670 con 0x7f0684090ba0 2021-02-24T15:18:33.684 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.656+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(68..68 src has 1..68) v4 ==== 6950+0+0 (unknown 1876475697 0 0) 0x7f067403b640 con 0x7f0684090ba0 2021-02-24T15:18:33.684 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.656+0000 7f0671ffb700 10 client.27378.objecter ms_dispatch 0x7f0684001510 osd_map(68..68 src has 1..68) v4 2021-02-24T15:18:33.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.656+0000 7f0671ffb700 3 client.27378.objecter handle_osd_map got epochs [68,68] > 0 2021-02-24T15:18:33.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.656+0000 7f0671ffb700 3 client.27378.objecter handle_osd_map decoding full epoch 68 2021-02-24T15:18:33.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.656+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f0684125ab0 con 0x7f06840914f0 2021-02-24T15:18:33.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.656+0000 7f0671ffb700 20 client.27378.objecter dump_active .. 0 homeless 2021-02-24T15:18:33.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.658+0000 7f068a3b7700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.181:6789/0 conn(0x7f06840914f0 legacy=0x7f06840918d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.658+0000 7f0671ffb700 10 client.27378.objecter ms_handle_connect 0x7f06840914f0 2021-02-24T15:18:33.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.658+0000 7f0671ffb700 10 client.27378.objecter resend_mon_ops 2021-02-24T15:18:33.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.658+0000 7f0671ffb700 10 client.27378.objecter ms_handle_connect 0x7f06640319b0 2021-02-24T15:18:33.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.658+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495933504 0 0) 0x7f0684125ab0 con 0x7f06840914f0 2021-02-24T15:18:33.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.659+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f068408d0c0 con 0x7f06840914f0 2021-02-24T15:18:33.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.659+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2871285013 0 0) 0x7f068408d0c0 con 0x7f06840914f0 2021-02-24T15:18:33.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.659+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0684125ab0 con 0x7f06840914f0 2021-02-24T15:18:33.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.659+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f067c004d30 con 0x7f06840914f0 2021-02-24T15:18:33.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.659+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1725961961 0 0) 0x7f0684125ab0 con 0x7f06840914f0 2021-02-24T15:18:33.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.659+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0684058400 con 0x7f06840914f0 2021-02-24T15:18:33.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.659+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f067c006f80 con 0x7f06840914f0 2021-02-24T15:18:33.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.659+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.181:6789/0 conn(0x7f06840914f0 legacy=0x7f06840918d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.659+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.181:6789/0 conn(0x7f06840914f0 legacy=0x7f06840918d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:33.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.667+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f0684068620 con 0x7f0684027010 2021-02-24T15:18:33.690 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f068a3b7700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.181:6789/0 conn(0x7f0684027010 legacy=0x7f0684147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.690 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 10 client.27378.objecter ms_handle_connect 0x7f0684027010 2021-02-24T15:18:33.690 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 10 client.27378.objecter resend_mon_ops 2021-02-24T15:18:33.690 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176162987 0 0) 0x7f0684068620 con 0x7f0684027010 2021-02-24T15:18:33.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0684125ab0 con 0x7f0684027010 2021-02-24T15:18:33.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3330970767 0 0) 0x7f0684125ab0 con 0x7f0684027010 2021-02-24T15:18:33.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0684068620 con 0x7f0684027010 2021-02-24T15:18:33.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f067c005480 con 0x7f0684027010 2021-02-24T15:18:33.692 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2955618197 0 0) 0x7f0684068620 con 0x7f0684027010 2021-02-24T15:18:33.692 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0684044c90 con 0x7f0684027010 2021-02-24T15:18:33.692 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 2487392632) 0x7f067c007210 con 0x7f0684027010 2021-02-24T15:18:33.692 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.181:6789/0 conn(0x7f0684027010 legacy=0x7f0684147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.670+0000 7f0671ffb700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.181:6789/0 conn(0x7f0684027010 legacy=0x7f0684147830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:33.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 10 librados: watch_flush enter 2021-02-24T15:18:33.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 10 librados: watch_flush exit 2021-02-24T15:18:33.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 20 client.27378.objecter shutdown clearing up homeless session... 2021-02-24T15:18:33.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 10 client.27378.objecter successfully canceled tick 2021-02-24T15:18:33.694 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.181:6812/33484 conn(0x7f06640319b0 legacy=0x7f0664033e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.694 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 >> v1:172.21.15.152:6789/0 conn(0x7f0684090ba0 legacy=0x7f068408a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.694 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068a3b7700 1 -- 172.21.15.152:0/2229929272 reap_dead start 2021-02-24T15:18:33.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 shutdown_connections 2021-02-24T15:18:33.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 >> 172.21.15.152:0/2229929272 conn(0x7f068409ab10 msgr2=0x7f0684126170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:33.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 shutdown_connections 2021-02-24T15:18:33.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 1 -- 172.21.15.152:0/2229929272 wait complete. 2021-02-24T15:18:33.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.671+0000 7f068be1a700 1 librados: shutdown 2021-02-24T15:18:33.696 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:18:33.696 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:33.696 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:18:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 14, 2021-02-24T15:18:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:18:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:18:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:18:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:18:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.699 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:18:33.699 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:33.699 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:18:33.699 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:18:33.700 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:33.700 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:33.700 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:33.700 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:33.701 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:33.701 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:33.702 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:33.702 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:33.702 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:33.702 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.703 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:18:33.703 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:18:33.703 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:33.703 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:33.704 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:33.704 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:33.704 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:33.704 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:33.704 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:33.705 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:33.705 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:33.705 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.706 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:18:33.706 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:18:33.706 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:18:33.707 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:18:33.707 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:18:33.707 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:18:33.707 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:33.708 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:33.708 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:18:33.708 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:18:33.708 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:18:33.709 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:18:33.709 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:18:33.709 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:33.709 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:18:33.709 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:33.710 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:33.710 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:33.710 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:33.711 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:33.711 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:33.711 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:33.711 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:33.711 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:33.712 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.712 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:18:33.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.712 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:18:33.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.713 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:33.713 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:33.714 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:33.714 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:33.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.714 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:33.715 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:18:33.715 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:33.715 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.715 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.716 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:18:33.716 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:18:33.716 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:33.716 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:33.717 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:33.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.717 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:33.717 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:33.718 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:33.718 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:33.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.718 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:33.719 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:18:33.719 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:33.719 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.719 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.720 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:18:33.720 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:18:33.721 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:33.721 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:33.721 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:33.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.722 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:33.723 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:33.723 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:33.723 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:33.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.724 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:33.724 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:18:33.724 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:33.724 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.725 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.725 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:18:33.725 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:18:33.726 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:33.726 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:33.726 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:33.727 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.727 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.727 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:18:33.728 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:18:33.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.728 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:33.728 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:33.729 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:33.729 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.729 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:33.730 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:18:33.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:33.730 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:33.730 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:33.731 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:18:33.731 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:33.731 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:33.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:33.732 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:18:33.732 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:18:33.733 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2021-02-24T15:18:33.734 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2021-02-24T15:18:33.734 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2021-02-24T15:18:33.734 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2021-02-24T15:18:33.735 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-02-24T15:18:33.736 INFO:teuthology.orchestra.run:waiting for 300 2021-02-24T15:18:33.745 INFO:tasks.ceph.mon.c:Stopped 2021-02-24T15:18:33.745 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2021-02-24T15:18:33.746 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:18:33.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.900+0000 7f69a6b3f700 1 Processor -- start 2021-02-24T15:18:33.902 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.900+0000 7f69a6b3f700 1 -- start start 2021-02-24T15:18:33.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.900+0000 7f69a6b3f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a0063aa0 con 0x7f69a0130c60 2021-02-24T15:18:33.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.900+0000 7f69a6b3f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a0093e50 con 0x7f69a00681d0 2021-02-24T15:18:33.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.900+0000 7f69a6b3f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a0063cf0 con 0x7f69a012d150 2021-02-24T15:18:33.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.900+0000 7f69a533c700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f69a012d150 legacy=0x7f69a012f540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:33.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.901+0000 7f69a633e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f69a0130c60 0x7f69a0133050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46964/0 (socket says 172.21.15.152:46964) 2021-02-24T15:18:33.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.901+0000 7f69a633e700 1 -- 172.21.15.152:0/4158254950 learned_addr learned my addr 172.21.15.152:0/4158254950 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:33.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a633e700 1 -- 172.21.15.152:0/4158254950 >> v1:172.21.15.152:6789/0 conn(0x7f69a0130c60 legacy=0x7f69a0133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a4b3b700 1 -- 172.21.15.152:0/4158254950 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401012520 0 0) 0x7f69a0063aa0 con 0x7f69a0130c60 2021-02-24T15:18:33.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a4b3b700 1 -- 172.21.15.152:0/4158254950 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6988003230 con 0x7f69a0130c60 2021-02-24T15:18:33.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a5b3d700 1 -- 172.21.15.152:0/4158254950 >> v1:172.21.15.181:6789/0 conn(0x7f69a00681d0 legacy=0x7f69a0063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a4b3b700 1 -- 172.21.15.152:0/4158254950 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4181180558 0 0) 0x7f6988003230 con 0x7f69a0130c60 2021-02-24T15:18:33.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a4b3b700 1 -- 172.21.15.152:0/4158254950 >> v1:172.21.15.152:6790/0 conn(0x7f69a012d150 legacy=0x7f69a012f540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:18:33.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a4b3b700 1 -- 172.21.15.152:0/4158254950 >> v1:172.21.15.181:6789/0 conn(0x7f69a00681d0 legacy=0x7f69a0063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a4b3b700 1 -- 172.21.15.152:0/4158254950 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a0063fb0 con 0x7f69a0130c60 2021-02-24T15:18:33.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a4b3b700 1 -- 172.21.15.152:0/4158254950 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6998001cb0 con 0x7f69a0130c60 2021-02-24T15:18:33.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a4b3b700 1 -- 172.21.15.152:0/4158254950 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6998001fc0 con 0x7f69a0130c60 2021-02-24T15:18:33.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.903+0000 7f69a4b3b700 1 -- 172.21.15.152:0/4158254950 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6998004ad0 con 0x7f69a0130c60 2021-02-24T15:18:33.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.904+0000 7f69a6b3f700 1 -- 172.21.15.152:0/4158254950 >> v1:172.21.15.152:6789/0 conn(0x7f69a0130c60 legacy=0x7f69a0133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.904+0000 7f69a6b3f700 1 -- 172.21.15.152:0/4158254950 shutdown_connections 2021-02-24T15:18:33.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.904+0000 7f69a6b3f700 1 -- 172.21.15.152:0/4158254950 >> 172.21.15.152:0/4158254950 conn(0x7f69a009b950 msgr2=0x7f69a009bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:33.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.904+0000 7f69a6b3f700 1 -- 172.21.15.152:0/4158254950 shutdown_connections 2021-02-24T15:18:33.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.904+0000 7f69a6b3f700 1 -- 172.21.15.152:0/4158254950 wait complete. 2021-02-24T15:18:33.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.904+0000 7f69a6b3f700 1 librados: starting msgr at 2021-02-24T15:18:33.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.904+0000 7f69a6b3f700 1 librados: starting objecter 2021-02-24T15:18:33.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a6b3f700 1 Processor -- start 2021-02-24T15:18:33.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a6b3f700 1 -- start start 2021-02-24T15:18:33.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a6b3f700 1 librados: setting wanted keys 2021-02-24T15:18:33.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a6b3f700 1 librados: calling monclient init 2021-02-24T15:18:33.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a6b3f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a0095700 con 0x7f69a00681d0 2021-02-24T15:18:33.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a6b3f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a0134300 con 0x7f69a012d150 2021-02-24T15:18:33.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a6b3f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a012f350 con 0x7f69a0130c60 2021-02-24T15:18:33.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a633e700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f69a0130c60 legacy=0x7f69a0142a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:33.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a5b3d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f69a00681d0 0x7f69a012e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46966/0 (socket says 172.21.15.152:46966) 2021-02-24T15:18:33.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.905+0000 7f69a5b3d700 1 -- 172.21.15.152:0/518446568 learned_addr learned my addr 172.21.15.152:0/518446568 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:33.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.907+0000 7f69a5b3d700 1 -- 172.21.15.152:0/518446568 >> v1:172.21.15.152:6789/0 conn(0x7f69a00681d0 legacy=0x7f69a012e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.907+0000 7f698dffb700 10 client.?.objecter ms_handle_connect 0x7f69a00681d0 2021-02-24T15:18:33.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.907+0000 7f698dffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.907+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317798346 0 0) 0x7f69a0095700 con 0x7f69a00681d0 2021-02-24T15:18:33.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.907+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6980004bd0 con 0x7f69a00681d0 2021-02-24T15:18:33.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 10 client.?.objecter ms_handle_connect 0x7f69a012d150 2021-02-24T15:18:33.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:33.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f69a533c700 1 -- 172.21.15.152:0/518446568 >> v1:172.21.15.181:6789/0 conn(0x7f69a012d150 legacy=0x7f69a012ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:33.918 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 640488835 0 0) 0x7f6980004bd0 con 0x7f69a00681d0 2021-02-24T15:18:33.918 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f69a0095700 con 0x7f69a00681d0 2021-02-24T15:18:33.918 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6990001a00 con 0x7f69a00681d0 2021-02-24T15:18:33.918 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 887377372 0 0) 0x7f69a0095700 con 0x7f69a00681d0 2021-02-24T15:18:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 >> v1:172.21.15.152:6790/0 conn(0x7f69a0130c60 legacy=0x7f69a0142a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:18:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 >> v1:172.21.15.181:6789/0 conn(0x7f69a012d150 legacy=0x7f69a012ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a0097d40 con 0x7f69a00681d0 2021-02-24T15:18:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a0130070 con 0x7f69a00681d0 2021-02-24T15:18:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6990002230 con 0x7f69a00681d0 2021-02-24T15:18:33.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6990002540 con 0x7f69a00681d0 2021-02-24T15:18:33.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f69a6b3f700 10 client.27384.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:33.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a0098ce0 con 0x7f69a00681d0 2021-02-24T15:18:33.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.908+0000 7f69a6b3f700 1 librados: init done 2021-02-24T15:18:33.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.909+0000 7f69a5b3d700 1 --1- 172.21.15.152:0/518446568 >> v1:172.21.15.152:6789/0 conn(0x7f69a00681d0 0x7f69a012e530 :-1 s=OPENED pgs=8628 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f699003b460 osd_map(68..68 src has 1..68) v4 2021-02-24T15:18:33.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.909+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f69900026a0 con 0x7f69a00681d0 2021-02-24T15:18:33.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.909+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a00678d0 con 0x7f69a00681d0 2021-02-24T15:18:33.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.911+0000 7f698dffb700 10 client.27384.objecter ms_handle_connect 0x7f69800313b0 2021-02-24T15:18:33.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.913+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(68..68 src has 1..68) v4 ==== 6950+0+0 (unknown 1876475697 0 0) 0x7f699003b460 con 0x7f69a00681d0 2021-02-24T15:18:33.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.913+0000 7f698dffb700 10 client.27384.objecter ms_dispatch 0x7f69a0001510 osd_map(68..68 src has 1..68) v4 2021-02-24T15:18:33.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.913+0000 7f698dffb700 3 client.27384.objecter handle_osd_map got epochs [68,68] > 0 2021-02-24T15:18:33.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.913+0000 7f698dffb700 3 client.27384.objecter handle_osd_map decoding full epoch 68 2021-02-24T15:18:33.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:33.913+0000 7f698dffb700 20 client.27384.objecter dump_active .. 0 homeless 2021-02-24T15:18:34.739 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.737+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f69900122d0 con 0x7f69a00681d0 2021-02-24T15:18:34.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.977+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f69a0097500 con 0x7f69a00681d0 2021-02-24T15:18:34.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.978+0000 7f698dffb700 1 -- 172.21.15.152:0/518446568 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 2873821286) 0x7f69900122d0 con 0x7f69a00681d0 2021-02-24T15:18:34.980 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:18:34.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.979+0000 7f69a6b3f700 10 librados: watch_flush enter 2021-02-24T15:18:34.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.979+0000 7f69a6b3f700 10 librados: watch_flush exit 2021-02-24T15:18:34.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.979+0000 7f69a6b3f700 20 client.27384.objecter shutdown clearing up homeless session... 2021-02-24T15:18:34.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.979+0000 7f69a6b3f700 10 client.27384.objecter successfully canceled tick 2021-02-24T15:18:34.983 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.979+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 >> v1:172.21.15.181:6812/33484 conn(0x7f69800313b0 legacy=0x7f6980033870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:34.983 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.979+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 >> v1:172.21.15.152:6789/0 conn(0x7f69a00681d0 legacy=0x7f69a012e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:34.983 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.979+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 shutdown_connections 2021-02-24T15:18:34.983 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.979+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 >> 172.21.15.152:0/518446568 conn(0x7f69a009b950 msgr2=0x7f69a0065c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:34.983 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.980+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 shutdown_connections 2021-02-24T15:18:34.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.980+0000 7f69a6b3f700 1 -- 172.21.15.152:0/518446568 wait complete. 2021-02-24T15:18:34.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:34.980+0000 7f69a6b3f700 1 librados: shutdown 2021-02-24T15:18:37.994 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:18:38.123 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.121+0000 7fe140e2d700 1 Processor -- start 2021-02-24T15:18:38.124 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.121+0000 7fe140e2d700 1 -- start start 2021-02-24T15:18:38.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.122+0000 7fe140e2d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c062660 con 0x7fe13c068410 2021-02-24T15:18:38.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.122+0000 7fe140e2d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c063af0 con 0x7fe13c095bb0 2021-02-24T15:18:38.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.122+0000 7fe140e2d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c063d90 con 0x7fe13c0966a0 2021-02-24T15:18:38.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.122+0000 7fe13a59c700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe13c096a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.122+0000 7fe13ad9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe13c068410 0x7fe13c133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46986/0 (socket says 172.21.15.152:46986) 2021-02-24T15:18:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.122+0000 7fe13ad9d700 1 -- 172.21.15.152:0/2627826553 learned_addr learned my addr 172.21.15.152:0/2627826553 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:38.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.124+0000 7fe13ad9d700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6789/0 conn(0x7fe13c068410 legacy=0x7fe13c133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:38.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.125+0000 7fe139d9b700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.181:6789/0 conn(0x7fe13c095bb0 legacy=0x7fe13c130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:38.324 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.323+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe13c096a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:38.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:38.724+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe13c096a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:39.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:39.525+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe13c096a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:41.124 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.123+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe13c096a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:18:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.123+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.181:6789/0 conn(0x7fe13c095bb0 legacy=0x7fe13c130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.123+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6789/0 conn(0x7fe13c068410 legacy=0x7fe13c133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.123+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c064030 con 0x7fe118006c30 2021-02-24T15:18:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.123+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c063d90 con 0x7fe13c095bb0 2021-02-24T15:18:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.123+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118010180 con 0x7fe13c0966a0 2021-02-24T15:18:41.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.123+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:41.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.125+0000 7fe139d9b700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6789/0 conn(0x7fe118006c30 legacy=0x7fe1180090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:41.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.125+0000 7fe13ad9d700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.181:6789/0 conn(0x7fe13c095bb0 legacy=0x7fe11800c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:41.324 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.324+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:41.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:41.725+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:42.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:42.526+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:44.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.123+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:18:44.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.123+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.181:6789/0 conn(0x7fe13c095bb0 legacy=0x7fe11800c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:44.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.123+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6789/0 conn(0x7fe118006c30 legacy=0x7fe1180090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:44.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.124+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118011390 con 0x7fe118006c30 2021-02-24T15:18:44.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.124+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118010180 con 0x7fe1180104c0 2021-02-24T15:18:44.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.124+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11800b9d0 con 0x7fe13c0966a0 2021-02-24T15:18:44.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.124+0000 7fe139d9b700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:44.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.126+0000 7fe13ad9d700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6789/0 conn(0x7fe118006c30 legacy=0x7fe1180090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:44.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.126+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.181:6789/0 conn(0x7fe1180104c0 legacy=0x7fe1180108e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:44.325 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.325+0000 7fe139d9b700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:44.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:44.726+0000 7fe139d9b700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:45.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:45.527+0000 7fe139d9b700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:47.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.124+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:18:47.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.124+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.181:6789/0 conn(0x7fe1180104c0 legacy=0x7fe1180108e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:47.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.124+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6789/0 conn(0x7fe118006c30 legacy=0x7fe1180090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:47.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.124+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11800cb70 con 0x7fe11800a9c0 2021-02-24T15:18:47.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.124+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11800b9d0 con 0x7fe1180104c0 2021-02-24T15:18:47.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.124+0000 7fe12bfff700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11800cf20 con 0x7fe13c0966a0 2021-02-24T15:18:47.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.124+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:47.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.126+0000 7fe139d9b700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6789/0 conn(0x7fe11800a9c0 legacy=0x7fe11800ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:47.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.126+0000 7fe13ad9d700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.181:6789/0 conn(0x7fe1180104c0 legacy=0x7fe1180108e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.325+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:47.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.726+0000 7fe13a59c700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:47.876 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.875+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230416614 0 0) 0x7fe11800b9d0 con 0x7fe1180104c0 2021-02-24T15:18:47.876 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.875+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe120003230 con 0x7fe1180104c0 2021-02-24T15:18:47.879 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.879+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944598769 0 0) 0x7fe11800cb70 con 0x7fe11800a9c0 2021-02-24T15:18:47.880 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.879+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe11800b9d0 con 0x7fe11800a9c0 2021-02-24T15:18:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.900+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2913706375 0 0) 0x7fe11800b9d0 con 0x7fe11800a9c0 2021-02-24T15:18:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.900+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6790/0 conn(0x7fe13c0966a0 legacy=0x7fe1180054f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:18:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.900+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.181:6789/0 conn(0x7fe1180104c0 legacy=0x7fe1180108e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.900+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11800b500 con 0x7fe11800a9c0 2021-02-24T15:18:47.902 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.900+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe1300019d0 con 0x7fe11800a9c0 2021-02-24T15:18:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.903+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe130001ce0 con 0x7fe11800a9c0 2021-02-24T15:18:47.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.903+0000 7fe13959a700 1 -- 172.21.15.152:0/2627826553 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe130002060 con 0x7fe11800a9c0 2021-02-24T15:18:47.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.903+0000 7fe140e2d700 1 -- 172.21.15.152:0/2627826553 >> v1:172.21.15.152:6789/0 conn(0x7fe11800a9c0 legacy=0x7fe11800ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.904+0000 7fe140e2d700 1 -- 172.21.15.152:0/2627826553 shutdown_connections 2021-02-24T15:18:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.904+0000 7fe140e2d700 1 -- 172.21.15.152:0/2627826553 >> 172.21.15.152:0/2627826553 conn(0x7fe13c09ba40 msgr2=0x7fe13c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.904+0000 7fe140e2d700 1 -- 172.21.15.152:0/2627826553 shutdown_connections 2021-02-24T15:18:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.904+0000 7fe140e2d700 1 -- 172.21.15.152:0/2627826553 wait complete. 2021-02-24T15:18:47.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe140e2d700 1 librados: starting msgr at 2021-02-24T15:18:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe140e2d700 1 librados: starting objecter 2021-02-24T15:18:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe140e2d700 1 Processor -- start 2021-02-24T15:18:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe140e2d700 1 -- start start 2021-02-24T15:18:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe140e2d700 1 librados: setting wanted keys 2021-02-24T15:18:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe140e2d700 1 librados: calling monclient init 2021-02-24T15:18:47.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe140e2d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c063010 con 0x7fe1180104c0 2021-02-24T15:18:47.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe140e2d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c11af50 con 0x7fe13c0966a0 2021-02-24T15:18:47.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe140e2d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c09aab0 con 0x7fe11800a9c0 2021-02-24T15:18:47.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe13a59c700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fe11800a9c0 legacy=0x7fe13c13a580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:47.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe139d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe1180104c0 0x7fe13c134040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47038/0 (socket says 172.21.15.152:47038) 2021-02-24T15:18:47.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.905+0000 7fe139d9b700 1 -- 172.21.15.152:0/4263641087 learned_addr learned my addr 172.21.15.152:0/4263641087 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:47.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.908+0000 7fe139d9b700 1 -- 172.21.15.152:0/4263641087 >> v1:172.21.15.152:6789/0 conn(0x7fe1180104c0 legacy=0x7fe13c134040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:47.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.908+0000 7fe12a7fc700 10 client.?.objecter ms_handle_connect 0x7fe1180104c0 2021-02-24T15:18:47.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.908+0000 7fe12a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:47.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.908+0000 7fe12a7fc700 10 client.?.objecter ms_handle_connect 0x7fe13c0966a0 2021-02-24T15:18:47.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.908+0000 7fe12a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:47.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.908+0000 7fe13ad9d700 1 -- 172.21.15.152:0/4263641087 >> v1:172.21.15.181:6789/0 conn(0x7fe13c0966a0 legacy=0x7fe13c142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:47.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266182829 0 0) 0x7fe13c063010 con 0x7fe1180104c0 2021-02-24T15:18:47.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe118009610 con 0x7fe1180104c0 2021-02-24T15:18:47.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491892326 0 0) 0x7fe13c11af50 con 0x7fe13c0966a0 2021-02-24T15:18:47.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe13c063010 con 0x7fe13c0966a0 2021-02-24T15:18:47.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 550369941 0 0) 0x7fe11800b500 con 0x7fe1180104c0 2021-02-24T15:18:47.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe13c11af50 con 0x7fe1180104c0 2021-02-24T15:18:47.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe1300017f0 con 0x7fe1180104c0 2021-02-24T15:18:47.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1236981301 0 0) 0x7fe13c063010 con 0x7fe13c0966a0 2021-02-24T15:18:47.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe11800b500 con 0x7fe13c0966a0 2021-02-24T15:18:47.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe134001d50 con 0x7fe13c0966a0 2021-02-24T15:18:47.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2713310511 0 0) 0x7fe13c11af50 con 0x7fe1180104c0 2021-02-24T15:18:47.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 >> v1:172.21.15.152:6790/0 conn(0x7fe11800a9c0 legacy=0x7fe13c13a580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:18:47.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.910+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 >> v1:172.21.15.181:6789/0 conn(0x7fe13c0966a0 legacy=0x7fe13c142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:47.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.911+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c134750 con 0x7fe1180104c0 2021-02-24T15:18:47.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.911+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13c11a550 con 0x7fe1180104c0 2021-02-24T15:18:47.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.911+0000 7fe140e2d700 10 client.27390.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:47.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.911+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13c118f10 con 0x7fe1180104c0 2021-02-24T15:18:47.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.911+0000 7fe140e2d700 1 librados: init done 2021-02-24T15:18:47.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.911+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe1300015e0 con 0x7fe1180104c0 2021-02-24T15:18:47.929 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.911+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe130002720 con 0x7fe1180104c0 2021-02-24T15:18:47.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.911+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fe130002900 con 0x7fe1180104c0 2021-02-24T15:18:47.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.912+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(68..68 src has 1..68) v4 ==== 6950+0+0 (unknown 1876475697 0 0) 0x7fe13003b650 con 0x7fe1180104c0 2021-02-24T15:18:47.930 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.912+0000 7fe12a7fc700 10 client.27390.objecter ms_dispatch 0x7fe13c001510 osd_map(68..68 src has 1..68) v4 2021-02-24T15:18:47.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.912+0000 7fe12a7fc700 3 client.27390.objecter handle_osd_map got epochs [68,68] > 0 2021-02-24T15:18:47.931 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.912+0000 7fe12a7fc700 3 client.27390.objecter handle_osd_map decoding full epoch 68 2021-02-24T15:18:47.932 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.912+0000 7fe12a7fc700 20 client.27390.objecter dump_active .. 0 homeless 2021-02-24T15:18:47.932 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.912+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c004d60 con 0x7fe1180104c0 2021-02-24T15:18:47.933 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.914+0000 7fe12a7fc700 10 client.27390.objecter ms_handle_connect 0x7fe118032a40 2021-02-24T15:18:47.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:47.944+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fe130012810 con 0x7fe1180104c0 2021-02-24T15:18:48.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.179+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe11c005590 con 0x7fe1180104c0 2021-02-24T15:18:48.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.179+0000 7fe12a7fc700 1 -- 172.21.15.152:0/4263641087 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1336 (unknown 254746657 0 3816005330) 0x7fe130012400 con 0x7fe1180104c0 2021-02-24T15:18:48.180 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":18,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:18:48.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 10 librados: watch_flush enter 2021-02-24T15:18:48.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 10 librados: watch_flush exit 2021-02-24T15:18:48.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 20 client.27390.objecter shutdown clearing up homeless session... 2021-02-24T15:18:48.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 10 client.27390.objecter successfully canceled tick 2021-02-24T15:18:48.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 >> v1:172.21.15.181:6812/33484 conn(0x7fe118032a40 legacy=0x7fe118034f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 >> v1:172.21.15.152:6789/0 conn(0x7fe1180104c0 legacy=0x7fe13c134040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 shutdown_connections 2021-02-24T15:18:48.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 >> 172.21.15.152:0/4263641087 conn(0x7fe13c09ba40 msgr2=0x7fe13c09acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:48.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 shutdown_connections 2021-02-24T15:18:48.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 1 -- 172.21.15.152:0/4263641087 wait complete. 2021-02-24T15:18:48.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.181+0000 7fe140e2d700 1 librados: shutdown 2021-02-24T15:18:48.193 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2021-02-24T15:18:48.194 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:18:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.314+0000 7f19f22cb700 1 Processor -- start 2021-02-24T15:18:48.316 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.314+0000 7f19f22cb700 1 -- start start 2021-02-24T15:18:48.316 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.315+0000 7f19f22cb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec097d40 con 0x7f19ec062da0 2021-02-24T15:18:48.316 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.315+0000 7f19f22cb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec063d00 con 0x7f19ec063220 2021-02-24T15:18:48.317 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.315+0000 7f19f22cb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec097980 con 0x7f19ec099340 2021-02-24T15:18:48.317 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.315+0000 7f19ebfff700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f19ec099340 legacy=0x7f19ec097270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:48.317 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.315+0000 7f19eb7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f19ec062da0 0x7f19ec12fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47046/0 (socket says 172.21.15.152:47046) 2021-02-24T15:18:48.317 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.315+0000 7f19eb7fe700 1 -- 172.21.15.152:0/970050194 learned_addr learned my addr 172.21.15.152:0/970050194 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eb7fe700 1 -- 172.21.15.152:0/970050194 >> v1:172.21.15.152:6789/0 conn(0x7f19ec062da0 legacy=0x7f19ec12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eaffd700 1 -- 172.21.15.152:0/970050194 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153173903 0 0) 0x7f19ec097d40 con 0x7f19ec062da0 2021-02-24T15:18:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eaffd700 1 -- 172.21.15.152:0/970050194 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19cc003230 con 0x7f19ec062da0 2021-02-24T15:18:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19f0868700 1 -- 172.21.15.152:0/970050194 >> v1:172.21.15.181:6789/0 conn(0x7f19ec063220 legacy=0x7f19ec133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eaffd700 1 -- 172.21.15.152:0/970050194 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1680559233 0 0) 0x7f19cc003230 con 0x7f19ec062da0 2021-02-24T15:18:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eaffd700 1 -- 172.21.15.152:0/970050194 >> v1:172.21.15.152:6790/0 conn(0x7f19ec099340 legacy=0x7f19ec097270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:18:48.322 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eaffd700 1 -- 172.21.15.152:0/970050194 >> v1:172.21.15.181:6789/0 conn(0x7f19ec063220 legacy=0x7f19ec133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.322 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eaffd700 1 -- 172.21.15.152:0/970050194 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec08fac0 con 0x7f19ec062da0 2021-02-24T15:18:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eaffd700 1 -- 172.21.15.152:0/970050194 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f19dc001930 con 0x7f19ec062da0 2021-02-24T15:18:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eaffd700 1 -- 172.21.15.152:0/970050194 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f19dc001c40 con 0x7f19ec062da0 2021-02-24T15:18:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.317+0000 7f19eaffd700 1 -- 172.21.15.152:0/970050194 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f19dc004750 con 0x7f19ec062da0 2021-02-24T15:18:48.324 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.318+0000 7f19f22cb700 1 -- 172.21.15.152:0/970050194 >> v1:172.21.15.152:6789/0 conn(0x7f19ec062da0 legacy=0x7f19ec12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.324 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.318+0000 7f19f22cb700 1 -- 172.21.15.152:0/970050194 shutdown_connections 2021-02-24T15:18:48.332 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.318+0000 7f19f22cb700 1 -- 172.21.15.152:0/970050194 >> 172.21.15.152:0/970050194 conn(0x7f19ec09dcc0 msgr2=0x7f19ec09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:48.339 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.318+0000 7f19f22cb700 1 -- 172.21.15.152:0/970050194 shutdown_connections 2021-02-24T15:18:48.339 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.318+0000 7f19f22cb700 1 -- 172.21.15.152:0/970050194 wait complete. 2021-02-24T15:18:48.339 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19f22cb700 1 librados: starting msgr at 2021-02-24T15:18:48.343 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19f22cb700 1 librados: starting objecter 2021-02-24T15:18:48.343 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19f22cb700 1 Processor -- start 2021-02-24T15:18:48.343 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19f22cb700 1 -- start start 2021-02-24T15:18:48.343 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19f22cb700 1 librados: setting wanted keys 2021-02-24T15:18:48.344 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19f22cb700 1 librados: calling monclient init 2021-02-24T15:18:48.344 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19f22cb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec094a60 con 0x7f19ec062da0 2021-02-24T15:18:48.344 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19f22cb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec095b70 con 0x7f19ec099340 2021-02-24T15:18:48.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19f22cb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec095e10 con 0x7f19ec063220 2021-02-24T15:18:48.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19eb7fe700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f19ec063220 legacy=0x7f19ec0972c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:48.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19ebfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f19ec062da0 0x7f19ec13a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47050/0 (socket says 172.21.15.152:47050) 2021-02-24T15:18:48.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.319+0000 7f19ebfff700 1 -- 172.21.15.152:0/3891058675 learned_addr learned my addr 172.21.15.152:0/3891058675 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19ebfff700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.152:6789/0 conn(0x7f19ec062da0 legacy=0x7f19ec13a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 10 client.?.objecter ms_handle_connect 0x7f19ec062da0 2021-02-24T15:18:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082961927 0 0) 0x7f19ec094a60 con 0x7f19ec062da0 2021-02-24T15:18:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d0004bd0 con 0x7f19ec062da0 2021-02-24T15:18:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 10 client.?.objecter ms_handle_connect 0x7f19ec099340 2021-02-24T15:18:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19f0868700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.181:6789/0 conn(0x7f19ec099340 legacy=0x7f19ec142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3484590711 0 0) 0x7f19d0004bd0 con 0x7f19ec062da0 2021-02-24T15:18:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19ec094a60 con 0x7f19ec062da0 2021-02-24T15:18:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f19d4004300 con 0x7f19ec062da0 2021-02-24T15:18:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840557192 0 0) 0x7f19ec095b70 con 0x7f19ec099340 2021-02-24T15:18:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d0004bd0 con 0x7f19ec099340 2021-02-24T15:18:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3861147984 0 0) 0x7f19ec094a60 con 0x7f19ec062da0 2021-02-24T15:18:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.152:6790/0 conn(0x7f19ec063220 legacy=0x7f19ec0972c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:18:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.181:6789/0 conn(0x7f19ec099340 legacy=0x7f19ec142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec0998b0 con 0x7f19ec062da0 2021-02-24T15:18:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec13a770 con 0x7f19ec062da0 2021-02-24T15:18:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19f22cb700 10 client.27399.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:48.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec093d20 con 0x7f19ec062da0 2021-02-24T15:18:48.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19f22cb700 1 librados: init done 2021-02-24T15:18:48.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f19d40045f0 con 0x7f19ec062da0 2021-02-24T15:18:48.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.322+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f19d4004900 con 0x7f19ec062da0 2021-02-24T15:18:48.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.323+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f19c4006550 con 0x7f19c40027f0 2021-02-24T15:18:48.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.323+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f19d4004b30 con 0x7f19ec062da0 2021-02-24T15:18:48.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.323+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(68..68 src has 1..68) v4 ==== 6950+0+0 (unknown 1876475697 0 0) 0x7f19d403b810 con 0x7f19ec062da0 2021-02-24T15:18:48.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.323+0000 7f19e3fff700 10 client.27399.objecter ms_dispatch 0x7f19ec001510 osd_map(68..68 src has 1..68) v4 2021-02-24T15:18:48.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.323+0000 7f19e3fff700 3 client.27399.objecter handle_osd_map got epochs [68,68] > 0 2021-02-24T15:18:48.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.323+0000 7f19e3fff700 3 client.27399.objecter handle_osd_map decoding full epoch 68 2021-02-24T15:18:48.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.323+0000 7f19e3fff700 20 client.27399.objecter dump_active .. 0 homeless 2021-02-24T15:18:48.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.325+0000 7f19e3fff700 10 client.27399.objecter ms_handle_connect 0x7f19c40027f0 2021-02-24T15:18:48.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.325+0000 7f19e3fff700 10 client.27399.objecter resend_mon_ops 2021-02-24T15:18:48.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.325+0000 7f19eb7fe700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.152:6789/0 conn(0x7f19c40027f0 legacy=0x7f19c4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.325+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622528897 0 0) 0x7f19c4006550 con 0x7f19c40027f0 2021-02-24T15:18:48.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.325+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ec094a60 con 0x7f19c40027f0 2021-02-24T15:18:48.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.325+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2740805173 0 0) 0x7f19ec094a60 con 0x7f19c40027f0 2021-02-24T15:18:48.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.325+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19c4006550 con 0x7f19c40027f0 2021-02-24T15:18:48.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.325+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f19dc0016e0 con 0x7f19c40027f0 2021-02-24T15:18:48.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.326+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2464517979 0 0) 0x7f19c4006550 con 0x7f19c40027f0 2021-02-24T15:18:48.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.326+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19c4009df0 con 0x7f19c40027f0 2021-02-24T15:18:48.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.326+0000 7f19e3fff700 10 client.27399.objecter ms_handle_connect 0x7f19d0031350 2021-02-24T15:18:48.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.326+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f19dc001890 con 0x7f19c40027f0 2021-02-24T15:18:48.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.326+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.152:6789/0 conn(0x7f19c40027f0 legacy=0x7f19c4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.326+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.152:6789/0 conn(0x7f19c40027f0 legacy=0x7f19c4004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:48.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.334+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f19c4009a80 con 0x7f19c4008da0 2021-02-24T15:18:48.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.336+0000 7f19e3fff700 10 client.27399.objecter ms_handle_connect 0x7f19c4008da0 2021-02-24T15:18:48.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.336+0000 7f19eb7fe700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.152:6789/0 conn(0x7f19c4008da0 legacy=0x7f19c4009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.336+0000 7f19e3fff700 10 client.27399.objecter resend_mon_ops 2021-02-24T15:18:48.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.336+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658998696 0 0) 0x7f19c4009a80 con 0x7f19c4008da0 2021-02-24T15:18:48.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.336+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c4006550 con 0x7f19c4008da0 2021-02-24T15:18:48.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.336+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3075365952 0 0) 0x7f19c4006550 con 0x7f19c4008da0 2021-02-24T15:18:48.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19c4009a80 con 0x7f19c4008da0 2021-02-24T15:18:48.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f19dc004e90 con 0x7f19c4008da0 2021-02-24T15:18:48.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1897815294 0 0) 0x7f19c4009a80 con 0x7f19c4008da0 2021-02-24T15:18:48.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f19c40086f0 con 0x7f19c4008da0 2021-02-24T15:18:48.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4101 (unknown 0 0 1699964417) 0x7f19dc0070b0 con 0x7f19c4008da0 2021-02-24T15:18:48.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.152:6789/0 conn(0x7f19c4008da0 legacy=0x7f19c4009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19e3fff700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.152:6789/0 conn(0x7f19c4008da0 legacy=0x7f19c4009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:48.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 10 librados: watch_flush enter 2021-02-24T15:18:48.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 10 librados: watch_flush exit 2021-02-24T15:18:48.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 20 client.27399.objecter shutdown clearing up homeless session... 2021-02-24T15:18:48.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 10 client.27399.objecter successfully canceled tick 2021-02-24T15:18:48.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.181:6812/33484 conn(0x7f19d0031350 legacy=0x7f19d0033810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 >> v1:172.21.15.152:6789/0 conn(0x7f19ec062da0 legacy=0x7f19ec13a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f0868700 1 -- 172.21.15.152:0/3891058675 reap_dead start 2021-02-24T15:18:48.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f0868700 1 -- 172.21.15.152:0/3891058675 reap_dead start 2021-02-24T15:18:48.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 shutdown_connections 2021-02-24T15:18:48.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 >> 172.21.15.152:0/3891058675 conn(0x7f19ec09dcc0 msgr2=0x7f19ec09c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:48.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 shutdown_connections 2021-02-24T15:18:48.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 1 -- 172.21.15.152:0/3891058675 wait complete. 2021-02-24T15:18:48.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.337+0000 7f19f22cb700 1 librados: shutdown 2021-02-24T15:18:48.396 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:18:48.396 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:48.396 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:48.396 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:18:48.397 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 18, 2021-02-24T15:18:48.397 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:18:48.397 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:18:48.397 INFO:teuthology.orchestra.run.smithi152.stdout: 1 2021-02-24T15:18:48.398 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.398 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:18:48.399 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:48.399 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:18:48.400 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:18:48.400 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:48.400 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:48.400 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:48.401 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:48.401 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:48.401 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:48.401 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:48.401 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:48.402 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:48.402 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.402 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:18:48.403 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:18:48.403 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:48.403 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:48.403 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:48.413 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:48.414 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:48.414 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:48.415 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:48.415 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:48.415 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:48.416 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.416 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:18:48.418 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:18:48.418 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:18:48.418 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:18:48.418 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:18:48.418 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:18:48.419 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:48.419 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:48.419 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:18:48.419 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:18:48.420 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:18:48.420 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:18:48.420 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:18:48.420 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:48.421 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:18:48.421 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:48.421 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:48.421 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:48.421 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:48.422 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:48.422 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:48.422 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:48.423 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:48.423 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:48.423 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.423 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:18:48.424 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.424 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:18:48.424 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.425 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:18:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:18:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:18:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:18:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:18:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:18:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:18:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:18:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:18:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:18:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:18:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:18:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:18:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:18:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:18:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:18:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:18:48.454 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:18:48.454 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:18:48.587 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.581+0000 7f1bb2b94700 1 Processor -- start 2021-02-24T15:18:48.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.581+0000 7f1bb2b94700 1 -- start start 2021-02-24T15:18:48.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.582+0000 7f1bb2b94700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac129990 con 0x7f1bac0974f0 2021-02-24T15:18:48.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.582+0000 7f1bb2b94700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac12a2c0 con 0x7f1bac097040 2021-02-24T15:18:48.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.582+0000 7f1bb2b94700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac09a300 con 0x7f1bac097b10 2021-02-24T15:18:48.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.582+0000 7f1bb1b92700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f1bac097b10 legacy=0x7f1bac129bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:48.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.582+0000 7f1bb2393700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1bac0974f0 0x7f1bac133160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47066/0 (socket says 172.21.15.152:47066) 2021-02-24T15:18:48.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.582+0000 7f1bb2393700 1 -- 172.21.15.152:0/3410076336 learned_addr learned my addr 172.21.15.152:0/3410076336 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:48.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.584+0000 7f1bb2393700 1 -- 172.21.15.152:0/3410076336 >> v1:172.21.15.152:6789/0 conn(0x7f1bac0974f0 legacy=0x7f1bac133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.584+0000 7f1bb0b90700 1 -- 172.21.15.152:0/3410076336 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314600974 0 0) 0x7f1bac129990 con 0x7f1bac0974f0 2021-02-24T15:18:48.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.584+0000 7f1bb0b90700 1 -- 172.21.15.152:0/3410076336 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b94003230 con 0x7f1bac0974f0 2021-02-24T15:18:48.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb1391700 1 -- 172.21.15.152:0/3410076336 >> v1:172.21.15.181:6789/0 conn(0x7f1bac097040 legacy=0x7f1bac12fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb0b90700 1 -- 172.21.15.152:0/3410076336 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 297730217 0 0) 0x7f1b94003230 con 0x7f1bac0974f0 2021-02-24T15:18:48.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb0b90700 1 -- 172.21.15.152:0/3410076336 >> v1:172.21.15.152:6790/0 conn(0x7f1bac097b10 legacy=0x7f1bac129bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:18:48.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb0b90700 1 -- 172.21.15.152:0/3410076336 >> v1:172.21.15.181:6789/0 conn(0x7f1bac097040 legacy=0x7f1bac12fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb0b90700 1 -- 172.21.15.152:0/3410076336 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac08fb30 con 0x7f1bac0974f0 2021-02-24T15:18:48.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb0b90700 1 -- 172.21.15.152:0/3410076336 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1ba4001cb0 con 0x7f1bac0974f0 2021-02-24T15:18:48.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb0b90700 1 -- 172.21.15.152:0/3410076336 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1ba4001fc0 con 0x7f1bac0974f0 2021-02-24T15:18:48.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb0b90700 1 -- 172.21.15.152:0/3410076336 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1ba4004ad0 con 0x7f1bac0974f0 2021-02-24T15:18:48.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb2b94700 1 -- 172.21.15.152:0/3410076336 >> v1:172.21.15.152:6789/0 conn(0x7f1bac0974f0 legacy=0x7f1bac133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb2b94700 1 -- 172.21.15.152:0/3410076336 shutdown_connections 2021-02-24T15:18:48.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb2b94700 1 -- 172.21.15.152:0/3410076336 >> 172.21.15.152:0/3410076336 conn(0x7f1bac09d9e0 msgr2=0x7f1bac09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:48.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb2b94700 1 -- 172.21.15.152:0/3410076336 shutdown_connections 2021-02-24T15:18:48.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.585+0000 7f1bb2b94700 1 -- 172.21.15.152:0/3410076336 wait complete. 2021-02-24T15:18:48.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.586+0000 7f1bb2b94700 1 librados: starting msgr at 2021-02-24T15:18:48.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.586+0000 7f1bb2b94700 1 librados: starting objecter 2021-02-24T15:18:48.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.586+0000 7f1bb2b94700 1 Processor -- start 2021-02-24T15:18:48.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.586+0000 7f1bb2b94700 1 -- start start 2021-02-24T15:18:48.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.586+0000 7f1bb2b94700 1 librados: setting wanted keys 2021-02-24T15:18:48.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.586+0000 7f1bb2b94700 1 librados: calling monclient init 2021-02-24T15:18:48.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.587+0000 7f1bb2b94700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac114730 con 0x7f1bac097040 2021-02-24T15:18:48.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.587+0000 7f1bb2b94700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac114960 con 0x7f1bac0974f0 2021-02-24T15:18:48.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.587+0000 7f1bb2b94700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac114c00 con 0x7f1bac097b10 2021-02-24T15:18:48.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.587+0000 7f1bb2393700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f1bac097b10 legacy=0x7f1bac142160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:18:48.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.587+0000 7f1bb1b92700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1bac097040 0x7f1bac139e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47068/0 (socket says 172.21.15.152:47068) 2021-02-24T15:18:48.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.587+0000 7f1bb1b92700 1 -- 172.21.15.152:0/512944847 learned_addr learned my addr 172.21.15.152:0/512944847 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:18:48.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1bb1b92700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.152:6789/0 conn(0x7f1bac097040 legacy=0x7f1bac139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 10 client.?.objecter ms_handle_connect 0x7f1bac097040 2021-02-24T15:18:48.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:48.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526856125 0 0) 0x7f1bac114730 con 0x7f1bac097040 2021-02-24T15:18:48.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b8c004bd0 con 0x7f1bac097040 2021-02-24T15:18:48.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 10 client.?.objecter ms_handle_connect 0x7f1bac0974f0 2021-02-24T15:18:48.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:18:48.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1bb1391700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.181:6789/0 conn(0x7f1bac0974f0 legacy=0x7f1bac1271c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1834899455 0 0) 0x7f1b8c004bd0 con 0x7f1bac097040 2021-02-24T15:18:48.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1bac114730 con 0x7f1bac097040 2021-02-24T15:18:48.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1b9c004240 con 0x7f1bac097040 2021-02-24T15:18:48.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48813575 0 0) 0x7f1bac114960 con 0x7f1bac0974f0 2021-02-24T15:18:48.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b8c004bd0 con 0x7f1bac0974f0 2021-02-24T15:18:48.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 435959274 0 0) 0x7f1bac114730 con 0x7f1bac097040 2021-02-24T15:18:48.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.152:6790/0 conn(0x7f1bac097b10 legacy=0x7f1bac142160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:18:48.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.181:6789/0 conn(0x7f1bac0974f0 legacy=0x7f1bac1271c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.589+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac0993d0 con 0x7f1bac097040 2021-02-24T15:18:48.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac095a60 con 0x7f1bac097040 2021-02-24T15:18:48.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1b9c004550 con 0x7f1bac097040 2021-02-24T15:18:48.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1b9c004860 con 0x7f1bac097040 2021-02-24T15:18:48.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1bb2b94700 10 client.27411.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:18:48.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bac1278d0 con 0x7f1bac097040 2021-02-24T15:18:48.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1bb2b94700 1 librados: init done 2021-02-24T15:18:48.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f1b9c004a80 con 0x7f1bac097040 2021-02-24T15:18:48.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f1bac09b920 con 0x7f1bac08ffd0 2021-02-24T15:18:48.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(68..68 src has 1..68) v4 ==== 6950+0+0 (unknown 1876475697 0 0) 0x7f1b9c03b760 con 0x7f1bac097040 2021-02-24T15:18:48.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1b99ffb700 10 client.27411.objecter ms_dispatch 0x7f1bac001510 osd_map(68..68 src has 1..68) v4 2021-02-24T15:18:48.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1b99ffb700 3 client.27411.objecter handle_osd_map got epochs [68,68] > 0 2021-02-24T15:18:48.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.590+0000 7f1b99ffb700 3 client.27411.objecter handle_osd_map decoding full epoch 68 2021-02-24T15:18:48.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.591+0000 7f1b99ffb700 20 client.27411.objecter dump_active .. 0 homeless 2021-02-24T15:18:48.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 10 client.27411.objecter ms_handle_connect 0x7f1bac08ffd0 2021-02-24T15:18:48.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 10 client.27411.objecter resend_mon_ops 2021-02-24T15:18:48.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1bb1391700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.181:6789/0 conn(0x7f1bac08ffd0 legacy=0x7f1bac0903b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478947141 0 0) 0x7f1bac09b920 con 0x7f1bac08ffd0 2021-02-24T15:18:48.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bac114730 con 0x7f1bac08ffd0 2021-02-24T15:18:48.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 10 client.27411.objecter ms_handle_connect 0x7f1b8c031450 2021-02-24T15:18:48.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2674677127 0 0) 0x7f1bac114730 con 0x7f1bac08ffd0 2021-02-24T15:18:48.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1bac09b920 con 0x7f1bac08ffd0 2021-02-24T15:18:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1ba8001b40 con 0x7f1bac08ffd0 2021-02-24T15:18:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 998789545 0 0) 0x7f1bac09b920 con 0x7f1bac08ffd0 2021-02-24T15:18:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.593+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bac062e30 con 0x7f1bac08ffd0 2021-02-24T15:18:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.594+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f1ba80054d0 con 0x7f1bac08ffd0 2021-02-24T15:18:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.594+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.181:6789/0 conn(0x7f1bac08ffd0 legacy=0x7f1bac0903b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.594+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.181:6789/0 conn(0x7f1bac08ffd0 legacy=0x7f1bac0903b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:48.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.602+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f1bac058400 con 0x7f1bac027010 2021-02-24T15:18:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.604+0000 7f1bb1391700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.181:6789/0 conn(0x7f1bac027010 legacy=0x7f1bac1478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:18:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.604+0000 7f1b99ffb700 10 client.27411.objecter ms_handle_connect 0x7f1bac027010 2021-02-24T15:18:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.604+0000 7f1b99ffb700 10 client.27411.objecter resend_mon_ops 2021-02-24T15:18:48.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.604+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325963086 0 0) 0x7f1bac058400 con 0x7f1bac027010 2021-02-24T15:18:48.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.604+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bac09b920 con 0x7f1bac027010 2021-02-24T15:18:48.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1536193264 0 0) 0x7f1bac09b920 con 0x7f1bac027010 2021-02-24T15:18:48.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1bac058400 con 0x7f1bac027010 2021-02-24T15:18:48.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1ba8002400 con 0x7f1bac027010 2021-02-24T15:18:48.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3538685937 0 0) 0x7f1bac058400 con 0x7f1bac027010 2021-02-24T15:18:48.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1bac098f90 con 0x7f1bac027010 2021-02-24T15:18:48.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3929 (unknown 0 0 418472901) 0x7f1ba80026d0 con 0x7f1bac027010 2021-02-24T15:18:48.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.181:6789/0 conn(0x7f1bac027010 legacy=0x7f1bac1478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1b99ffb700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.181:6789/0 conn(0x7f1bac027010 legacy=0x7f1bac1478a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:18:48.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1bb2b94700 10 librados: watch_flush enter 2021-02-24T15:18:48.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1bb2b94700 10 librados: watch_flush exit 2021-02-24T15:18:48.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1bb2b94700 20 client.27411.objecter shutdown clearing up homeless session... 2021-02-24T15:18:48.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.605+0000 7f1bb2b94700 10 client.27411.objecter successfully canceled tick 2021-02-24T15:18:48.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.606+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.181:6812/33484 conn(0x7f1b8c031450 legacy=0x7f1b8c033910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.606+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 >> v1:172.21.15.152:6789/0 conn(0x7f1bac097040 legacy=0x7f1bac139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:18:48.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.606+0000 7f1bb2393700 1 -- 172.21.15.152:0/512944847 reap_dead start 2021-02-24T15:18:48.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.606+0000 7f1bb2393700 1 -- 172.21.15.152:0/512944847 reap_dead start 2021-02-24T15:18:48.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.606+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 shutdown_connections 2021-02-24T15:18:48.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.606+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 >> 172.21.15.152:0/512944847 conn(0x7f1bac09d9e0 msgr2=0x7f1bac12dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:18:48.658 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.606+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 shutdown_connections 2021-02-24T15:18:48.658 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.606+0000 7f1bb2b94700 1 -- 172.21.15.152:0/512944847 wait complete. 2021-02-24T15:18:48.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:18:48.606+0000 7f1bb2b94700 1 librados: shutdown 2021-02-24T15:18:48.659 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:18:48.659 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:48.660 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:48.660 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:18:48.660 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 18, 2021-02-24T15:18:48.660 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:18:48.660 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:18:48.661 INFO:teuthology.orchestra.run.smithi152.stdout: 1 2021-02-24T15:18:48.661 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.661 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:18:48.661 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:48.666 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:18:48.667 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:18:48.667 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:48.667 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:48.667 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:48.667 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:48.668 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:48.668 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:48.668 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:48.668 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:48.669 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:48.669 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.670 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:18:48.670 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:18:48.670 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:48.671 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:48.672 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:48.672 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:48.672 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:48.673 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:48.673 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:48.673 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:48.673 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:48.674 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.674 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:18:48.674 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:18:48.674 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:18:48.675 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:18:48.675 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:18:48.675 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:18:48.685 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:48.685 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:18:48.686 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:18:48.686 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:18:48.686 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:18:48.686 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:18:48.687 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:18:48.687 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:18:48.687 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:18:48.687 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:18:48.688 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:18:48.688 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:18:48.688 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:18:48.688 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:18:48.689 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:18:48.689 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:18:48.689 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:18:48.689 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:18:48.701 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.701 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:18:48.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.705 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:18:48.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.705 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:18:48.706 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:18:48.706 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:48.706 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:48.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.707 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:48.707 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:18:48.707 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:48.708 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.708 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.708 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:18:48.709 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:18:48.709 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:48.709 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:48.709 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:48.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.715 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:18:48.715 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:18:48.715 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:48.715 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:48.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.716 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:48.716 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:18:48.716 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:48.717 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.718 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.718 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:18:48.719 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:18:48.719 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:48.720 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:48.720 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:48.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.721 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:18:48.721 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:18:48.721 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:18:48.721 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:18:48.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.722 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:18:48.722 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:18:48.722 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:18:48.722 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.723 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.723 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:18:48.723 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:18:48.723 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:18:48.724 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:18:48.724 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:18:48.724 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.724 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.725 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:18:48.725 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:18:48.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.725 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:48.725 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:48.726 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:18:48.726 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.726 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.726 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:18:48.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.727 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:48.727 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:48.727 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:18:48.727 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.728 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:18:48.728 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:18:48.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:18:48.728 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:18:48.728 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:18:48.729 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 7 2021-02-24T15:18:48.729 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:18:48.730 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:18:48.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:18:48.730 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:18:48.731 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:18:48.732 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-02-24T15:18:54.291 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2021-02-24T15:18:54.291 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] Global test environment set-up. 2021-02-24T15:18:54.292 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2021-02-24T15:18:54.292 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2021-02-24T15:18:54.292 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2021-02-24T15:18:54.293 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-02-24T15:18:54.293 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: 2021-02-24T15:18:54.293 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2021-02-24T15:18:54.293 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: seed 36839 2021-02-24T15:18:54.294 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2021-02-24T15:18:54.294 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (2 ms) 2021-02-24T15:18:54.294 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2021-02-24T15:18:54.294 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (254 ms) 2021-02-24T15:18:54.294 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2021-02-24T15:18:54.295 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (35 ms) 2021-02-24T15:18:54.295 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2021-02-24T15:18:54.295 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (20 ms) 2021-02-24T15:18:54.295 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2021-02-24T15:18:54.296 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (24 ms) 2021-02-24T15:18:54.296 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2021-02-24T15:18:54.296 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (6 ms) 2021-02-24T15:18:54.296 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2021-02-24T15:18:54.296 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (4 ms) 2021-02-24T15:18:54.297 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2021-02-24T15:18:54.297 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (5 ms) 2021-02-24T15:18:54.297 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2021-02-24T15:18:54.298 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (2 ms) 2021-02-24T15:18:54.298 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2021-02-24T15:18:54.298 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (27 ms) 2021-02-24T15:18:54.298 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2021-02-24T15:18:54.298 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (6 ms) 2021-02-24T15:18:54.299 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2021-02-24T15:18:54.299 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (4 ms) 2021-02-24T15:18:54.299 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2021-02-24T15:18:54.299 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (22 ms) 2021-02-24T15:18:54.300 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2021-02-24T15:18:54.300 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: osd_max_attr_size = 0 2021-02-24T15:18:54.300 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2021-02-24T15:18:54.300 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (3936 ms) 2021-02-24T15:18:54.301 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2021-02-24T15:18:54.301 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (1024 ms) 2021-02-24T15:18:54.301 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2021-02-24T15:18:54.301 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: waiting for initial deep scrubs... 2021-02-24T15:18:54.302 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: done waiting, doing copies 2021-02-24T15:18:54.302 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: waiting for final deep scrubs... 2021-02-24T15:18:54.302 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: done waiting 2021-02-24T15:18:54.303 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (61709 ms) 2021-02-24T15:18:54.303 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2021-02-24T15:18:54.303 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (10 ms) 2021-02-24T15:18:54.303 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2021-02-24T15:18:54.303 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (7 ms) 2021-02-24T15:18:54.304 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2021-02-24T15:18:54.304 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (12071 ms) 2021-02-24T15:18:54.304 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2021-02-24T15:18:54.304 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2021-02-24T15:18:54.304 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2021-02-24T15:18:54.305 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2021-02-24T15:18:54.305 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2021-02-24T15:18:54.305 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2021-02-24T15:19:03.075 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 22 tests from LibRadosMi api_misc: done. 2021-02-24T15:19:03.075 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (5822 ms) 2021-02-24T15:19:03.076 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (5822 ms total) 2021-02-24T15:19:03.076 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:19:03.076 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2021-02-24T15:19:03.076 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2021-02-24T15:19:03.076 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2021-02-24T15:19:03.077 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2021-02-24T15:19:03.077 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMisc.Exec (71 ms) 2021-02-24T15:19:03.077 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2021-02-24T15:19:03.077 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (22 ms) 2021-02-24T15:19:03.078 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2021-02-24T15:19:03.078 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (5 ms) 2021-02-24T15:19:03.078 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2021-02-24T15:19:03.078 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4964 ms) 2021-02-24T15:19:03.078 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2021-02-24T15:19:03.079 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2021-02-24T15:19:03.079 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2021-02-24T15:19:03.079 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2021-02-24T15:19:03.079 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2021-02-24T15:19:03.079 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (77754 ms) 2021-02-24T15:19:03.080 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] 8 tests from LibRadosMisc (82816 ms total) 2021-02-24T15:19:03.080 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: 2021-02-24T15:19:03.080 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [----------] Global test environment tear-down 2021-02-24T15:19:03.080 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [==========] 11 tests from 4 test suites ran. (90800 ms total) 2021-02-24T15:19:03.081 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc: [ PASSED ] 11 tests. 2021-02-24T15:19:15.044 INFO:tasks.ceph.osd.4.smithi181.stderr:2021-02-24T15:19:15.040+0000 7f1c24b24700 -1 osd.4 pg_epoch: 95 pg[104.1s0( v 94'3 (0'0,94'3] local-lis/les=84/85 n=2 ec=84/84 lis/c=84/84 les/c/f=85/85/0 sis=84) [4,2,3]p4(0) r=0 lpr=84 crt=94'3 lcod 93'1 mlcod 93'1 active+clean+snaptrim trimq=[b~1] ps=[2~1,6~2]] removing snap head 2021-02-24T15:19:19.165 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2021-02-24T15:19:19.165 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [==========] Running 18 tests from 4 test suites. 2021-02-24T15:19:19.166 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2021-02-24T15:19:19.166 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2021-02-24T15:19:19.166 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: seed 36934 2021-02-24T15:19:19.166 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2021-02-24T15:19:19.167 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (1970 ms) 2021-02-24T15:19:19.167 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2021-02-24T15:19:19.167 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2024 ms) 2021-02-24T15:19:19.167 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2021-02-24T15:19:19.167 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2040 ms) 2021-02-24T15:19:19.168 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2021-02-24T15:19:19.168 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1861 ms) 2021-02-24T15:19:19.168 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2021-02-24T15:19:19.168 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4204 ms) 2021-02-24T15:19:19.168 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (12099 ms total) 2021-02-24T15:19:19.169 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: 2021-02-24T15:19:19.169 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP 2021-02-24T15:19:19.169 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2021-02-24T15:19:19.169 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (5355 ms) 2021-02-24T15:19:19.169 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2021-02-24T15:19:19.170 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3709 ms) 2021-02-24T15:19:19.170 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2021-02-24T15:19:19.170 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (5812 ms) 2021-02-24T15:19:19.170 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2021-02-24T15:19:19.171 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3993 ms) 2021-02-24T15:19:19.171 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2021-02-24T15:19:19.171 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2153 ms) 2021-02-24T15:19:19.172 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2021-02-24T15:19:19.172 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: deleting snap 23 in pool test-rados-api-smithi181-36934-7 2021-02-24T15:19:19.172 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: waiting for snaps to purge 2021-02-24T15:19:19.172 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17852 ms) 2021-02-24T15:19:19.173 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP (38874 ms total) 2021-02-24T15:19:19.173 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: 2021-02-24T15:19:19.173 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2021-02-24T15:19:19.173 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2021-02-24T15:19:19.174 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3384 ms) 2021-02-24T15:19:19.174 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2021-02-24T15:19:19.174 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2007 ms) 2021-02-24T15:19:19.175 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2021-02-24T15:19:19.175 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2020 ms) 2021-02-24T15:19:19.175 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2021-02-24T15:19:19.175 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (1721 ms) 2021-02-24T15:19:19.175 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9132 ms total) 2021-02-24T15:19:19.176 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: 2021-02-24T15:19:19.177 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2021-02-24T15:19:19.177 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2021-02-24T15:19:19.177 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4017 ms) 2021-02-24T15:19:19.177 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2021-02-24T15:19:19.177 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3971 ms) 2021-02-24T15:19:19.178 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2021-02-24T15:19:19.178 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4009 ms) 2021-02-24T15:19:19.179 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11997 ms total) 2021-02-24T15:19:19.180 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: 2021-02-24T15:19:19.180 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2021-02-24T15:19:19.180 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [==========] 18 tests from 4 test suites ran. (106899 ms total) 2021-02-24T15:19:19.180 INFO:tasks.workunit.client.0.smithi181.stdout: api_snapshots_pp: [ PASSED ] 18 tests. 2021-02-24T15:19:19.181 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:19:19.181 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36794 2021-02-24T15:19:19.181 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36794 2021-02-24T15:19:19.181 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:19:19.182 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36765 2021-02-24T15:19:19.182 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36765 2021-02-24T15:19:19.182 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:19:19.182 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36749 2021-02-24T15:19:19.182 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36749 2021-02-24T15:19:20.049 INFO:tasks.workunit.client.0.smithi181.stdout:scPP (79168 ms total) 2021-02-24T15:19:20.049 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: 2021-02-24T15:19:20.049 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2021-02-24T15:19:20.050 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2021-02-24T15:19:20.050 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (237 ms) 2021-02-24T15:19:20.050 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (237 ms total) 2021-02-24T15:19:20.050 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: 2021-02-24T15:19:20.051 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2021-02-24T15:19:20.051 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2021-02-24T15:19:20.051 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (26 ms) 2021-02-24T15:19:20.051 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2021-02-24T15:19:20.051 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (11 ms) 2021-02-24T15:19:20.052 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (37 ms total) 2021-02-24T15:19:20.052 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: 2021-02-24T15:19:20.052 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2021-02-24T15:19:20.052 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2021-02-24T15:19:20.053 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (18 ms) 2021-02-24T15:19:20.053 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2021-02-24T15:19:20.053 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (15 ms) 2021-02-24T15:19:20.053 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (33 ms total) 2021-02-24T15:19:20.054 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: 2021-02-24T15:19:20.054 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2021-02-24T15:19:20.054 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2021-02-24T15:19:20.054 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (39 ms) 2021-02-24T15:19:20.054 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2021-02-24T15:19:20.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (9 ms) 2021-02-24T15:19:20.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (48 ms total) 2021-02-24T15:19:20.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: 2021-02-24T15:19:20.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2021-02-24T15:19:20.056 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2021-02-24T15:19:20.056 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1037 ms) 2021-02-24T15:19:20.056 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1037 ms total) 2021-02-24T15:19:20.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: 2021-02-24T15:19:20.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [----------] Global test environment tear-down 2021-02-24T15:19:20.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (107779 ms total) 2021-02-24T15:19:20.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_misc_pp: [ PASSED ] 31 tests. 2021-02-24T15:19:29.226 INFO:tasks.workunit.client.0.smithi181.stdout:t: : entry=12 expected=12 2021-02-24T15:19:29.226 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:d83876eb:::4:head 2021-02-24T15:19:29.226 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:d83876eb:::4:head expected=8:d83876eb:::4:head 2021-02-24T15:19:29.227 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:d83876eb:::4:head -> 4 2021-02-24T15:19:29.227 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=4 expected=4 2021-02-24T15:19:29.227 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:cfc208b3:::3:head 2021-02-24T15:19:29.227 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:cfc208b3:::3:head expected=8:cfc208b3:::3:head 2021-02-24T15:19:29.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:cfc208b3:::3:head -> 3 2021-02-24T15:19:29.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=3 expected=3 2021-02-24T15:19:29.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:c4fdafeb:::6:head 2021-02-24T15:19:29.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:c4fdafeb:::6:head expected=8:c4fdafeb:::6:head 2021-02-24T15:19:29.228 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:c4fdafeb:::6:head -> 6 2021-02-24T15:19:29.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=6 expected=6 2021-02-24T15:19:29.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:bd63b0f1:::8:head 2021-02-24T15:19:29.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:bd63b0f1:::8:head expected=8:bd63b0f1:::8:head 2021-02-24T15:19:29.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:bd63b0f1:::8:head -> 8 2021-02-24T15:19:29.229 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=8 expected=8 2021-02-24T15:19:29.230 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:02547ec2:::1:head 2021-02-24T15:19:29.230 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:02547ec2:::1:head expected=8:02547ec2:::1:head 2021-02-24T15:19:29.230 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:02547ec2:::1:head -> 1 2021-02-24T15:19:29.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=1 expected=1 2021-02-24T15:19:29.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:5c6b0b28:::7:head 2021-02-24T15:19:29.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:5c6b0b28:::7:head expected=8:5c6b0b28:::7:head 2021-02-24T15:19:29.231 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:5c6b0b28:::7:head -> 7 2021-02-24T15:19:29.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=7 expected=7 2021-02-24T15:19:29.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : seek to 8:566253c9:::13:head 2021-02-24T15:19:29.232 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : cursor()=8:566253c9:::13:head expected=8:566253c9:::13:head 2021-02-24T15:19:29.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: > 8:566253c9:::13:head -> 13 2021-02-24T15:19:29.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: : entry=13 expected=13 2021-02-24T15:19:29.233 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (529 ms) 2021-02-24T15:19:29.236 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2021-02-24T15:19:29.236 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (88839 ms) 2021-02-24T15:19:29.236 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2021-02-24T15:19:29.237 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: split 0/5 -> MIN 8:33333333::::head 2021-02-24T15:19:29.237 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: split 1/5 -> 8:33333333::::head 8:66666666::::head 2021-02-24T15:19:29.237 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: split 2/5 -> 8:66666666::::head 8:99999999::::head 2021-02-24T15:19:29.237 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: split 3/5 -> 8:99999999::::head 8:cccccccc::::head 2021-02-24T15:19:29.238 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: split 4/5 -> 8:cccccccc::::head MAX 2021-02-24T15:19:29.238 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (20574 ms) 2021-02-24T15:19:29.238 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [----------] 6 tests from LibRadosList (110571 ms total) 2021-02-24T15:19:29.238 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 2021-02-24T15:19:29.239 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [----------] 3 tests from LibRadosListEC 2021-02-24T15:19:29.239 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2021-02-24T15:19:29.239 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1057 ms) 2021-02-24T15:19:29.239 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2021-02-24T15:19:29.240 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: myset foo1,foo2,foo3 2021-02-24T15:19:29.240 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo1 2021-02-24T15:19:29.240 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo2 2021-02-24T15:19:29.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo3 2021-02-24T15:19:29.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: myset foo1,foo4,foo5 2021-02-24T15:19:29.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo4 2021-02-24T15:19:29.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo5 2021-02-24T15:19:29.241 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo1 2021-02-24T15:19:29.242 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: myset foo6,foo7 2021-02-24T15:19:29.242 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo7 2021-02-24T15:19:29.242 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: foo6 2021-02-24T15:19:29.243 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-02-24T15:19:29.243 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns1:foo4 2021-02-24T15:19:29.243 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns1:foo5 2021-02-24T15:19:29.243 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns2:foo7 2021-02-24T15:19:29.243 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns2:foo6 2021-02-24T15:19:29.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: ns1:foo1 2021-02-24T15:19:29.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: :foo1 2021-02-24T15:19:29.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: :foo2 2021-02-24T15:19:29.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: :foo3 2021-02-24T15:19:29.244 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (93 ms) 2021-02-24T15:19:29.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2021-02-24T15:19:29.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 1 0 2021-02-24T15:19:29.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 10 0 2021-02-24T15:19:29.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 13 0 2021-02-24T15:19:29.245 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 7 0 2021-02-24T15:19:29.246 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 14 0 2021-02-24T15:19:29.246 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 0 0 2021-02-24T15:19:29.246 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 15 0 2021-02-24T15:19:29.246 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 11 0 2021-02-24T15:19:35.051 INFO:tasks.workunit.client.0.smithi181.stdout: api_lis api_aio: Running main() from gmock_main.cc 2021-02-24T15:19:35.051 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [==========] Running 40 tests from 2 test suites. 2021-02-24T15:19:35.051 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [----------] Global test environment set-up. 2021-02-24T15:19:35.052 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [----------] 24 tests from LibRadosAio 2021-02-24T15:19:35.052 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2021-02-24T15:19:35.052 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2895 ms) 2021-02-24T15:19:35.052 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2021-02-24T15:19:35.053 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (3026 ms) 2021-02-24T15:19:35.053 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2021-02-24T15:19:35.053 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3098 ms) 2021-02-24T15:19:35.053 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2021-02-24T15:19:35.053 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3002 ms) 2021-02-24T15:19:35.054 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2021-02-24T15:19:35.054 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2805 ms) 2021-02-24T15:19:35.054 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2021-02-24T15:19:35.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3138 ms) 2021-02-24T15:19:35.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2021-02-24T15:19:35.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3007 ms) 2021-02-24T15:19:35.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2021-02-24T15:19:35.056 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3091 ms) 2021-02-24T15:19:35.056 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2021-02-24T15:19:35.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (2963 ms) 2021-02-24T15:19:35.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2021-02-24T15:19:35.058 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2795 ms) 2021-02-24T15:19:35.058 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2021-02-24T15:19:35.058 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3015 ms) 2021-02-24T15:19:35.059 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2021-02-24T15:19:35.059 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (2995 ms) 2021-02-24T15:19:35.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2021-02-24T15:19:35.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3152 ms) 2021-02-24T15:19:35.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2021-02-24T15:19:35.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (40105 ms) 2021-02-24T15:19:35.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2021-02-24T15:19:35.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.Flush (3005 ms) 2021-02-24T15:19:35.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2021-02-24T15:19:35.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2737 ms) 2021-02-24T15:19:35.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2021-02-24T15:19:35.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3008 ms) 2021-02-24T15:19:35.062 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2021-02-24T15:19:35.062 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3031 ms) 2021-02-24T15:19:35.062 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2021-02-24T15:19:35.062 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (2986 ms) 2021-02-24T15:19:35.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2021-02-24T15:19:35.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2984 ms) 2021-02-24T15:19:35.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2021-02-24T15:19:35.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2998 ms) 2021-02-24T15:19:35.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2021-02-24T15:19:35.065 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3027 ms) 2021-02-24T15:19:35.065 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2021-02-24T15:19:35.065 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2977 ms) 2021-02-24T15:19:35.065 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2021-02-24T15:19:35.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3023 ms) 2021-02-24T15:19:35.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [----------] 24 tests from LibRadosAio (108864 ms total) 2021-02-24T15:19:35.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: 2021-02-24T15:19:35.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2021-02-24T15:19:35.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2021-02-24T15:19:35.067 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6979 ms) 2021-02-24T15:19:35.067 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2021-02-24T15:19:35.067 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7009 ms) 2021-02-24T15:19:35.068 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.Rt: 5 0 2021-02-24T15:19:35.069 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 8 0 2021-02-24T15:19:35.069 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 6 0 2021-02-24T15:19:35.069 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 3 0 2021-02-24T15:19:35.069 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 4 0 2021-02-24T15:19:35.069 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 12 0 2021-02-24T15:19:35.070 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 9 0 2021-02-24T15:19:35.070 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 2 0 2021-02-24T15:19:35.070 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-02-24T15:19:35.070 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (111 ms) 2021-02-24T15:19:35.070 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [----------] 3 tests from LibRadosListEC (1261 ms total) 2021-02-24T15:19:35.071 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 2021-02-24T15:19:35.071 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [----------] 1 test from LibRadosListNP 2021-02-24T15:19:35.071 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2021-02-24T15:19:35.071 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3017 ms) 2021-02-24T15:19:35.072 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [----------] 1 test from LibRadosListNP (3017 ms total) 2021-02-24T15:19:35.072 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: 2021-02-24T15:19:35.072 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [----------] Global test environment tear-down 2021-02-24T15:19:35.072 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [==========] 10 tests from 3 test suites ran. (122830 ms total) 2021-02-24T15:19:35.072 INFO:tasks.workunit.client.0.smithi181.stdout: api_list: [ PASSED ] 10 tests. 2021-02-24T15:19:35.073 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:19:35.073 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36991 2021-02-24T15:19:35.073 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36991 2021-02-24T15:19:35.074 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:19:35.074 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36954 2021-02-24T15:19:35.074 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36954 2021-02-24T15:19:35.074 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:19:35.075 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37179 2021-02-24T15:19:35.075 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37179 2021-02-24T15:19:35.075 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:19:35.075 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36717 2021-02-24T15:19:35.075 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36717 2021-02-24T15:19:41.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: Running main() from gmock_main.cc 2021-02-24T15:19:41.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [==========] Running 53 tests from 4 test suites. 2021-02-24T15:19:41.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] Global test environment set-up. 2021-02-24T15:19:41.055 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] 28 tests from LibRadosAio 2021-02-24T15:19:41.056 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2021-02-24T15:19:41.056 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2898 ms) 2021-02-24T15:19:41.056 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2021-02-24T15:19:41.056 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (19100 ms) 2021-02-24T15:19:41.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2021-02-24T15:19:41.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (6017 ms) 2021-02-24T15:19:41.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2021-02-24T15:19:41.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (2814 ms) 2021-02-24T15:19:41.057 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2021-02-24T15:19:41.058 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3016 ms) 2021-02-24T15:19:41.058 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2021-02-24T15:19:41.058 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3105 ms) 2021-02-24T15:19:41.058 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2021-02-24T15:19:41.058 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2872 ms) 2021-02-24T15:19:41.059 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2021-02-24T15:19:41.059 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (8025 ms) 2021-02-24T15:19:41.059 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2021-02-24T15:19:41.059 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (11566 ms) 2021-02-24T15:19:41.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2021-02-24T15:19:41.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (18279 ms) 2021-02-24T15:19:41.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2021-02-24T15:19:41.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3399 ms) 2021-02-24T15:19:41.060 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2021-02-24T15:19:41.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3021 ms) 2021-02-24T15:19:41.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2021-02-24T15:19:41.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (2728 ms) 2021-02-24T15:19:41.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2021-02-24T15:19:41.061 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3004 ms) 2021-02-24T15:19:41.062 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2021-02-24T15:19:41.062 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3006 ms) 2021-02-24T15:19:41.062 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2021-02-24T15:19:41.062 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2984 ms) 2021-02-24T15:19:41.063 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2021-02-24T15:19:41.063 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3003 ms) 2021-02-24T15:19:41.063 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2021-02-24T15:19:41.063 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2998 ms) 2021-02-24T15:19:41.063 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2021-02-24T15:19:41.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3008 ms) 2021-02-24T15:19:41.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2021-02-24T15:19:41.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3006 ms) 2021-02-24T15:19:41.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2021-02-24T15:19:41.064 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3025 ms) 2021-02-24T15:19:41.065 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2021-02-24T15:19:41.065 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3511 ms) 2021-02-24T15:19:41.065 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2021-02-24T15:19:41.065 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2459 ms) 2021-02-24T15:19:41.065 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2021-02-24T15:19:41.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (2992 ms) 2021-02-24T15:19:41.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2021-02-24T15:19:41.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripAppendPP (3012 ms) 2021-02-24T15:19:41.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2021-02-24T15:19:41.066 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2993 ms) 2021-02-24T15:19:41.067 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2021-02-24T15:20:12.075 INFO:tasks.ceph.osd.4.smithi181.stderr:2021-02-24T15:20:12.073+0000 7f1c28b2c700 -1 osd.4 pg_epoch: 152 pg[57.1( v 148'20 (0'0,148'20] local-lis/les=30/31 n=3 ec=30/30 lis/c=30/30 les/c/f=31/31/0 sis=30) [4,2] r=0 lpr=30 crt=148'20 lcod 147'18 mlcod 147'18 active+clean+snaptrim trimq=[f~1]] removing snap head 2021-02-24T15:20:18.733 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2021-02-24T15:20:18.734 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2021-02-24T15:20:18.735 INFO:tasks.ceph.mon.c:Restarting daemon 2021-02-24T15:20:18.735 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-02-24T15:20:18.738 INFO:tasks.ceph.mon.c:Started 2021-02-24T15:20:18.738 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:20:18.739 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:20:18.879 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.878+0000 7f75373fb700 1 Processor -- start 2021-02-24T15:20:18.879 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.878+0000 7f75373fb700 1 -- start start 2021-02-24T15:20:18.880 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.879+0000 7f75373fb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75300922a0 con 0x7f753012e1c0 2021-02-24T15:20:18.880 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.879+0000 7f75373fb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7530092540 con 0x7f75300945b0 2021-02-24T15:20:18.881 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.879+0000 7f75373fb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75300927e0 con 0x7f75300939f0 2021-02-24T15:20:18.881 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.879+0000 7f7534996700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f75300939f0 0x7f7530090130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35720/0 (socket says 172.21.15.152:35720) 2021-02-24T15:20:18.881 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.879+0000 7f7535998700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f753012e1c0 0x7f75301305b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47244/0 (socket says 172.21.15.152:47244) 2021-02-24T15:20:18.881 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.879+0000 7f7534996700 1 -- 172.21.15.152:0/3057689497 learned_addr learned my addr 172.21.15.152:0/3057689497 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:18.884 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.881+0000 7f7534996700 1 -- 172.21.15.152:0/3057689497 >> v1:172.21.15.152:6790/0 conn(0x7f75300939f0 legacy=0x7f7530090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:18.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.881+0000 7f7535998700 1 -- 172.21.15.152:0/3057689497 >> v1:172.21.15.152:6789/0 conn(0x7f753012e1c0 legacy=0x7f75301305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:18.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.881+0000 7f7535197700 1 -- 172.21.15.152:0/3057689497 >> v1:172.21.15.181:6789/0 conn(0x7f75300945b0 legacy=0x7f753008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:18.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.881+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069143454 0 0) 0x7f75300922a0 con 0x7f753012e1c0 2021-02-24T15:20:18.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.881+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7518003230 con 0x7f753012e1c0 2021-02-24T15:20:18.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726635950 0 0) 0x7f7530092540 con 0x7f75300945b0 2021-02-24T15:20:18.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75300922a0 con 0x7f75300945b0 2021-02-24T15:20:18.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2085559778 0 0) 0x7f7518003230 con 0x7f753012e1c0 2021-02-24T15:20:18.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 >> v1:172.21.15.152:6790/0 conn(0x7f75300939f0 legacy=0x7f7530090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:18.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 >> v1:172.21.15.181:6789/0 conn(0x7f75300945b0 legacy=0x7f753008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:18.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530092a80 con 0x7f753012e1c0 2021-02-24T15:20:18.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7528001be0 con 0x7f753012e1c0 2021-02-24T15:20:18.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7528001ef0 con 0x7f753012e1c0 2021-02-24T15:20:18.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f751ffff700 1 -- 172.21.15.152:0/3057689497 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7528004870 con 0x7f753012e1c0 2021-02-24T15:20:18.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f75373fb700 1 -- 172.21.15.152:0/3057689497 >> v1:172.21.15.152:6789/0 conn(0x7f753012e1c0 legacy=0x7f75301305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:18.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f75373fb700 1 -- 172.21.15.152:0/3057689497 shutdown_connections 2021-02-24T15:20:18.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f75373fb700 1 -- 172.21.15.152:0/3057689497 >> 172.21.15.152:0/3057689497 conn(0x7f75300999a0 msgr2=0x7f7530099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:18.888 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f75373fb700 1 -- 172.21.15.152:0/3057689497 shutdown_connections 2021-02-24T15:20:18.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.882+0000 7f75373fb700 1 -- 172.21.15.152:0/3057689497 wait complete. 2021-02-24T15:20:18.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.883+0000 7f75373fb700 1 librados: starting msgr at 2021-02-24T15:20:18.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.883+0000 7f75373fb700 1 librados: starting objecter 2021-02-24T15:20:18.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.883+0000 7f75373fb700 1 Processor -- start 2021-02-24T15:20:18.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.883+0000 7f75373fb700 1 -- start start 2021-02-24T15:20:18.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.883+0000 7f75373fb700 1 librados: setting wanted keys 2021-02-24T15:20:18.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.883+0000 7f75373fb700 1 librados: calling monclient init 2021-02-24T15:20:18.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.884+0000 7f75373fb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75300917d0 con 0x7f75300939f0 2021-02-24T15:20:18.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.884+0000 7f75373fb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7530065eb0 con 0x7f75300945b0 2021-02-24T15:20:18.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.884+0000 7f75373fb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7530110dd0 con 0x7f753012e1c0 2021-02-24T15:20:18.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.884+0000 7f7535197700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f75300939f0 0x7f7530065090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47248/0 (socket says 172.21.15.152:47248) 2021-02-24T15:20:18.892 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.884+0000 7f7535197700 1 -- 172.21.15.152:0/4120500126 learned_addr learned my addr 172.21.15.152:0/4120500126 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:18.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f7535197700 1 -- 172.21.15.152:0/4120500126 >> v1:172.21.15.152:6789/0 conn(0x7f75300939f0 legacy=0x7f7530065090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:18.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f7535998700 1 -- 172.21.15.152:0/4120500126 >> v1:172.21.15.152:6790/0 conn(0x7f753012e1c0 legacy=0x7f75301426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:18.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 10 client.?.objecter ms_handle_connect 0x7f75300939f0 2021-02-24T15:20:18.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:18.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 10 client.?.objecter ms_handle_connect 0x7f753012e1c0 2021-02-24T15:20:18.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:18.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374474640 0 0) 0x7f75300917d0 con 0x7f75300939f0 2021-02-24T15:20:18.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7510004bd0 con 0x7f75300939f0 2021-02-24T15:20:18.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 10 client.?.objecter ms_handle_connect 0x7f75300945b0 2021-02-24T15:20:18.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:18.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f7534996700 1 -- 172.21.15.152:0/4120500126 >> v1:172.21.15.181:6789/0 conn(0x7f75300945b0 legacy=0x7f75300657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:18.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285347629 0 0) 0x7f7530065eb0 con 0x7f75300945b0 2021-02-24T15:20:18.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75300917d0 con 0x7f75300945b0 2021-02-24T15:20:18.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 288114617 0 0) 0x7f7510004bd0 con 0x7f75300939f0 2021-02-24T15:20:18.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7530065eb0 con 0x7f75300939f0 2021-02-24T15:20:18.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.886+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f752c001d10 con 0x7f75300939f0 2021-02-24T15:20:18.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 790996621 0 0) 0x7f7530065eb0 con 0x7f75300939f0 2021-02-24T15:20:18.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 >> v1:172.21.15.152:6790/0 conn(0x7f753012e1c0 legacy=0x7f75301426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:18.899 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 >> v1:172.21.15.181:6789/0 conn(0x7f75300945b0 legacy=0x7f75300657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:18.899 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530111070 con 0x7f75300939f0 2021-02-24T15:20:18.899 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7530127dc0 con 0x7f75300939f0 2021-02-24T15:20:18.899 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f75373fb700 10 client.27795.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:18.899 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f75301115f0 con 0x7f75300939f0 2021-02-24T15:20:18.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f75373fb700 1 librados: init done 2021-02-24T15:20:18.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f752c002330 con 0x7f75300939f0 2021-02-24T15:20:18.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f752c002640 con 0x7f75300939f0 2021-02-24T15:20:18.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f752c0027a0 con 0x7f75300939f0 2021-02-24T15:20:18.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.888+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(158..158 src has 1..158) v4 ==== 5769+0+0 (unknown 3559973170 0 0) 0x7f752c03b210 con 0x7f75300939f0 2021-02-24T15:20:18.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.888+0000 7f751d7fa700 10 client.27795.objecter ms_dispatch 0x7f7530001510 osd_map(158..158 src has 1..158) v4 2021-02-24T15:20:18.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.888+0000 7f751d7fa700 3 client.27795.objecter handle_osd_map got epochs [158,158] > 0 2021-02-24T15:20:18.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.888+0000 7f751d7fa700 3 client.27795.objecter handle_osd_map decoding full epoch 158 2021-02-24T15:20:18.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.887+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7508004d60 con 0x7f75300939f0 2021-02-24T15:20:18.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.888+0000 7f751d7fa700 20 client.27795.objecter dump_active .. 0 homeless 2021-02-24T15:20:18.902 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.890+0000 7f751d7fa700 10 client.27795.objecter ms_handle_connect 0x7f75100315a0 2021-02-24T15:20:18.902 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:18.892+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f752c012740 con 0x7f75300939f0 2021-02-24T15:20:19.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.133+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7508005010 con 0x7f75300939f0 2021-02-24T15:20:19.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.133+0000 7f751d7fa700 1 -- 172.21.15.152:0/4120500126 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1337 (unknown 254746657 0 367199130) 0x7f752c012330 con 0x7f75300939f0 2021-02-24T15:20:19.134 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":18,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":91,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:20:19.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.134+0000 7f75373fb700 10 librados: watch_flush enter 2021-02-24T15:20:19.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.134+0000 7f75373fb700 10 librados: watch_flush exit 2021-02-24T15:20:19.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.135+0000 7f75373fb700 20 client.27795.objecter shutdown clearing up homeless session... 2021-02-24T15:20:19.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.135+0000 7f75373fb700 10 client.27795.objecter successfully canceled tick 2021-02-24T15:20:19.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.135+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 >> v1:172.21.15.181:6812/33484 conn(0x7f75100315a0 legacy=0x7f7510033a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:19.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.135+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 >> v1:172.21.15.152:6789/0 conn(0x7f75300939f0 legacy=0x7f7530065090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:19.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.135+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 shutdown_connections 2021-02-24T15:20:19.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.135+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 >> 172.21.15.152:0/4120500126 conn(0x7f75300999a0 msgr2=0x7f75300977d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:19.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.135+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 shutdown_connections 2021-02-24T15:20:19.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.135+0000 7f75373fb700 1 -- 172.21.15.152:0/4120500126 wait complete. 2021-02-24T15:20:19.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:19.135+0000 7f75373fb700 1 librados: shutdown 2021-02-24T15:20:22.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:20:22.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.279+0000 7efe987a1700 1 Processor -- start 2021-02-24T15:20:22.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.279+0000 7efe987a1700 1 -- start start 2021-02-24T15:20:22.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.280+0000 7efe987a1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe90062660 con 0x7efe900966a0 2021-02-24T15:20:22.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.280+0000 7efe987a1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe90063af0 con 0x7efe90068410 2021-02-24T15:20:22.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.280+0000 7efe987a1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe90063d90 con 0x7efe90095bb0 2021-02-24T15:20:22.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.280+0000 7efe95d3c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7efe90095bb0 0x7efe90130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35736/0 (socket says 172.21.15.152:35736) 2021-02-24T15:20:22.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.280+0000 7efe95d3c700 1 -- 172.21.15.152:0/3241883514 learned_addr learned my addr 172.21.15.152:0/3241883514 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:22.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.280+0000 7efe9653d700 1 --1- 172.21.15.152:0/3241883514 >> v1:172.21.15.152:6789/0 conn(0x7efe900966a0 0x7efe90096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47258/0 (socket says 172.21.15.152:47258) 2021-02-24T15:20:22.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.282+0000 7efe95d3c700 1 -- 172.21.15.152:0/3241883514 >> v1:172.21.15.152:6790/0 conn(0x7efe90095bb0 legacy=0x7efe90130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.282+0000 7efe9653d700 1 -- 172.21.15.152:0/3241883514 >> v1:172.21.15.152:6789/0 conn(0x7efe900966a0 legacy=0x7efe90096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.282+0000 7efe96d3e700 1 -- 172.21.15.152:0/3241883514 >> v1:172.21.15.181:6789/0 conn(0x7efe90068410 legacy=0x7efe90133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493080593 0 0) 0x7efe90062660 con 0x7efe900966a0 2021-02-24T15:20:22.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe78003230 con 0x7efe900966a0 2021-02-24T15:20:22.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126278318 0 0) 0x7efe90063af0 con 0x7efe90068410 2021-02-24T15:20:22.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe90062660 con 0x7efe90068410 2021-02-24T15:20:22.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 218657559 0 0) 0x7efe90062660 con 0x7efe90068410 2021-02-24T15:20:22.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 >> v1:172.21.15.152:6790/0 conn(0x7efe90095bb0 legacy=0x7efe90130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 >> v1:172.21.15.152:6789/0 conn(0x7efe900966a0 legacy=0x7efe90096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90064030 con 0x7efe90068410 2021-02-24T15:20:22.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe88001dc0 con 0x7efe90068410 2021-02-24T15:20:22.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efe880020a0 con 0x7efe90068410 2021-02-24T15:20:22.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.283+0000 7efe9553b700 1 -- 172.21.15.152:0/3241883514 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe880023e0 con 0x7efe90068410 2021-02-24T15:20:22.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.284+0000 7efe987a1700 1 -- 172.21.15.152:0/3241883514 >> v1:172.21.15.181:6789/0 conn(0x7efe90068410 legacy=0x7efe90133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.284+0000 7efe987a1700 1 -- 172.21.15.152:0/3241883514 shutdown_connections 2021-02-24T15:20:22.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.284+0000 7efe987a1700 1 -- 172.21.15.152:0/3241883514 >> 172.21.15.152:0/3241883514 conn(0x7efe9009ba40 msgr2=0x7efe9009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:22.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.284+0000 7efe987a1700 1 -- 172.21.15.152:0/3241883514 shutdown_connections 2021-02-24T15:20:22.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.284+0000 7efe987a1700 1 -- 172.21.15.152:0/3241883514 wait complete. 2021-02-24T15:20:22.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe987a1700 1 librados: starting msgr at 2021-02-24T15:20:22.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe987a1700 1 librados: starting objecter 2021-02-24T15:20:22.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe987a1700 1 Processor -- start 2021-02-24T15:20:22.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe987a1700 1 -- start start 2021-02-24T15:20:22.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe987a1700 1 librados: setting wanted keys 2021-02-24T15:20:22.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe987a1700 1 librados: calling monclient init 2021-02-24T15:20:22.298 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe987a1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe90063010 con 0x7efe900966a0 2021-02-24T15:20:22.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe987a1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900934c0 con 0x7efe90068410 2021-02-24T15:20:22.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe987a1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe90093760 con 0x7efe90095bb0 2021-02-24T15:20:22.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe96d3e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efe900966a0 0x7efe90147120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47268/0 (socket says 172.21.15.152:47268) 2021-02-24T15:20:22.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe96d3e700 1 -- 172.21.15.152:0/3872080458 learned_addr learned my addr 172.21.15.152:0/3872080458 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:22.299 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.285+0000 7efe95d3c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7efe90095bb0 0x7efe901439f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35742/0 (socket says 172.21.15.152:35742) 2021-02-24T15:20:22.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe95d3c700 1 -- 172.21.15.152:0/3872080458 >> v1:172.21.15.152:6790/0 conn(0x7efe90095bb0 legacy=0x7efe901439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.300 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe96d3e700 1 -- 172.21.15.152:0/3872080458 >> v1:172.21.15.152:6789/0 conn(0x7efe900966a0 legacy=0x7efe90147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 10 client.?.objecter ms_handle_connect 0x7efe90095bb0 2021-02-24T15:20:22.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:22.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 10 client.?.objecter ms_handle_connect 0x7efe900966a0 2021-02-24T15:20:22.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:22.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 10 client.?.objecter ms_handle_connect 0x7efe90068410 2021-02-24T15:20:22.302 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:22.302 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe9653d700 1 -- 172.21.15.152:0/3872080458 >> v1:172.21.15.181:6789/0 conn(0x7efe90068410 legacy=0x7efe9013eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.303 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826372741 0 0) 0x7efe90093760 con 0x7efe90095bb0 2021-02-24T15:20:22.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe70004bd0 con 0x7efe90095bb0 2021-02-24T15:20:22.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248495860 0 0) 0x7efe90063010 con 0x7efe900966a0 2021-02-24T15:20:22.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe90093760 con 0x7efe900966a0 2021-02-24T15:20:22.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767252489 0 0) 0x7efe900934c0 con 0x7efe90068410 2021-02-24T15:20:22.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe90063010 con 0x7efe90068410 2021-02-24T15:20:22.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1802478244 0 0) 0x7efe70004bd0 con 0x7efe90095bb0 2021-02-24T15:20:22.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe900934c0 con 0x7efe90095bb0 2021-02-24T15:20:22.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe80001be0 con 0x7efe90095bb0 2021-02-24T15:20:22.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2019391582 0 0) 0x7efe90093760 con 0x7efe900966a0 2021-02-24T15:20:22.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe70004bd0 con 0x7efe900966a0 2021-02-24T15:20:22.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe880023e0 con 0x7efe900966a0 2021-02-24T15:20:22.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 405426721 0 0) 0x7efe90063010 con 0x7efe90068410 2021-02-24T15:20:22.306 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe90093760 con 0x7efe90068410 2021-02-24T15:20:22.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe8c001ae0 con 0x7efe90068410 2021-02-24T15:20:22.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3744591367 0 0) 0x7efe900934c0 con 0x7efe90095bb0 2021-02-24T15:20:22.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 >> v1:172.21.15.181:6789/0 conn(0x7efe90068410 legacy=0x7efe9013eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.307 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 >> v1:172.21.15.152:6789/0 conn(0x7efe900966a0 legacy=0x7efe90147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900915f0 con 0x7efe90095bb0 2021-02-24T15:20:22.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe90092290 con 0x7efe90095bb0 2021-02-24T15:20:22.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe987a1700 10 client.64100.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:22.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9013f410 con 0x7efe90095bb0 2021-02-24T15:20:22.308 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe987a1700 1 librados: init done 2021-02-24T15:20:22.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efe800047a0 con 0x7efe90095bb0 2021-02-24T15:20:22.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.288+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe80004ab0 con 0x7efe90095bb0 2021-02-24T15:20:22.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.289+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7efe80004c90 con 0x7efe90095bb0 2021-02-24T15:20:22.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.289+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(162..162 src has 1..162) v4 ==== 5995+0+0 (unknown 3614054488 0 0) 0x7efe8003b1c0 con 0x7efe90095bb0 2021-02-24T15:20:22.309 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.289+0000 7efe7e7fc700 10 client.64100.objecter ms_dispatch 0x7efe90001510 osd_map(162..162 src has 1..162) v4 2021-02-24T15:20:22.310 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.289+0000 7efe7e7fc700 3 client.64100.objecter handle_osd_map got epochs [162,162] > 0 2021-02-24T15:20:22.310 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.289+0000 7efe7e7fc700 3 client.64100.objecter handle_osd_map decoding full epoch 162 2021-02-24T15:20:22.310 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.289+0000 7efe7e7fc700 20 client.64100.objecter dump_active .. 0 homeless 2021-02-24T15:20:22.310 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.289+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe74004d60 con 0x7efe90095bb0 2021-02-24T15:20:22.311 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.292+0000 7efe7e7fc700 10 client.64100.objecter ms_handle_connect 0x7efe700316a0 2021-02-24T15:20:22.311 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.293+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7efe80012610 con 0x7efe90095bb0 2021-02-24T15:20:22.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.532+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efe74005590 con 0x7efe90095bb0 2021-02-24T15:20:22.534 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.532+0000 7efe7e7fc700 1 -- 172.21.15.152:0/3872080458 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 3911523140) 0x7efe80012200 con 0x7efe90095bb0 2021-02-24T15:20:22.534 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:20:22.537 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 10 librados: watch_flush enter 2021-02-24T15:20:22.537 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 10 librados: watch_flush exit 2021-02-24T15:20:22.538 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 20 client.64100.objecter shutdown clearing up homeless session... 2021-02-24T15:20:22.538 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 10 client.64100.objecter successfully canceled tick 2021-02-24T15:20:22.539 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 >> v1:172.21.15.181:6812/33484 conn(0x7efe700316a0 legacy=0x7efe70033b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.539 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 >> v1:172.21.15.152:6790/0 conn(0x7efe90095bb0 legacy=0x7efe901439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.540 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 shutdown_connections 2021-02-24T15:20:22.540 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 >> 172.21.15.152:0/3872080458 conn(0x7efe9009ba40 msgr2=0x7efe9009a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:22.540 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 shutdown_connections 2021-02-24T15:20:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 1 -- 172.21.15.152:0/3872080458 wait complete. 2021-02-24T15:20:22.541 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.534+0000 7efe987a1700 1 librados: shutdown 2021-02-24T15:20:22.546 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:20:22.547 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:20:22.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.663+0000 7f46bb114700 1 Processor -- start 2021-02-24T15:20:22.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46bb114700 1 -- start start 2021-02-24T15:20:22.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46bb114700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b4066610 con 0x7f46b4095c90 2021-02-24T15:20:22.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46bb114700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b40668b0 con 0x7f46b4064040 2021-02-24T15:20:22.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46bb114700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b4066b50 con 0x7f46b4063550 2021-02-24T15:20:22.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46b9911700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f46b4095c90 0x7f46b412c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47274/0 (socket says 172.21.15.152:47274) 2021-02-24T15:20:22.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46b9911700 1 -- 172.21.15.152:0/3870659165 learned_addr learned my addr 172.21.15.152:0/3870659165 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:22.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46ba112700 1 --1- 172.21.15.152:0/3870659165 >> v1:172.21.15.152:6790/0 conn(0x7f46b4063550 0x7f46b4063930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35748/0 (socket says 172.21.15.152:35748) 2021-02-24T15:20:22.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46ba112700 1 -- 172.21.15.152:0/3870659165 >> v1:172.21.15.152:6790/0 conn(0x7f46b4063550 legacy=0x7f46b4063930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-24T15:20:22.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46ba112700 1 -- 172.21.15.152:0/3870659165 >> v1:172.21.15.152:6790/0 conn(0x7f46b4063550 legacy=0x7f46b4063930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-24T15:20:22.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.664+0000 7f46ba112700 1 --1- 172.21.15.152:0/3870659165 >> v1:172.21.15.152:6790/0 conn(0x7f46b4063550 0x7f46b4063930 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2021-02-24T15:20:22.680 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.666+0000 7f46b9911700 1 -- 172.21.15.152:0/3870659165 >> v1:172.21.15.152:6789/0 conn(0x7f46b4095c90 legacy=0x7f46b412c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46b9110700 1 -- 172.21.15.152:0/3870659165 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349108252 0 0) 0x7f46b4066610 con 0x7f46b4095c90 2021-02-24T15:20:22.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46b9110700 1 -- 172.21.15.152:0/3870659165 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f469c003230 con 0x7f46b4095c90 2021-02-24T15:20:22.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46ba913700 1 -- 172.21.15.152:0/3870659165 >> v1:172.21.15.181:6789/0 conn(0x7f46b4064040 legacy=0x7f46b412f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46b9110700 1 -- 172.21.15.152:0/3870659165 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 175807221 0 0) 0x7f469c003230 con 0x7f46b4095c90 2021-02-24T15:20:22.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46b9110700 1 -- 172.21.15.152:0/3870659165 >> v1:172.21.15.152:6790/0 conn(0x7f46b4063550 legacy=0x7f46b4063930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:20:22.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46b9110700 1 -- 172.21.15.152:0/3870659165 >> v1:172.21.15.181:6789/0 conn(0x7f46b4064040 legacy=0x7f46b412f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46b9110700 1 -- 172.21.15.152:0/3870659165 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4066df0 con 0x7f46b4095c90 2021-02-24T15:20:22.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46b9110700 1 -- 172.21.15.152:0/3870659165 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f46a4001930 con 0x7f46b4095c90 2021-02-24T15:20:22.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46b9110700 1 -- 172.21.15.152:0/3870659165 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f46a4001c40 con 0x7f46b4095c90 2021-02-24T15:20:22.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46b9110700 1 -- 172.21.15.152:0/3870659165 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f46a4004750 con 0x7f46b4095c90 2021-02-24T15:20:22.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.667+0000 7f46bb114700 1 -- 172.21.15.152:0/3870659165 >> v1:172.21.15.152:6789/0 conn(0x7f46b4095c90 legacy=0x7f46b412c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.684 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 -- 172.21.15.152:0/3870659165 shutdown_connections 2021-02-24T15:20:22.684 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 -- 172.21.15.152:0/3870659165 >> 172.21.15.152:0/3870659165 conn(0x7f46b4099650 msgr2=0x7f46b4099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:22.684 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 -- 172.21.15.152:0/3870659165 shutdown_connections 2021-02-24T15:20:22.684 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 -- 172.21.15.152:0/3870659165 wait complete. 2021-02-24T15:20:22.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 librados: starting msgr at 2021-02-24T15:20:22.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 librados: starting objecter 2021-02-24T15:20:22.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 Processor -- start 2021-02-24T15:20:22.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 -- start start 2021-02-24T15:20:22.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 librados: setting wanted keys 2021-02-24T15:20:22.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.668+0000 7f46bb114700 1 librados: calling monclient init 2021-02-24T15:20:22.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.669+0000 7f46bb114700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b4116dc0 con 0x7f46b4063550 2021-02-24T15:20:22.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.669+0000 7f46bb114700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b4095370 con 0x7f46b4095c90 2021-02-24T15:20:22.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.669+0000 7f46bb114700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b4133290 con 0x7f46b4064040 2021-02-24T15:20:22.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.669+0000 7f46b9911700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f46b4064040 0x7f46b4132b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35756/0 (socket says 172.21.15.152:35756) 2021-02-24T15:20:22.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.669+0000 7f46ba112700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f46b4063550 0x7f46b4132430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47278/0 (socket says 172.21.15.152:47278) 2021-02-24T15:20:22.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.669+0000 7f46b9911700 1 -- 172.21.15.152:0/2550665163 learned_addr learned my addr 172.21.15.152:0/2550665163 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:22.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46b9911700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6790/0 conn(0x7f46b4064040 legacy=0x7f46b4132b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 10 client.?.objecter ms_handle_connect 0x7f46b4064040 2021-02-24T15:20:22.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:22.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 10 client.?.objecter ms_handle_connect 0x7f46b4063550 2021-02-24T15:20:22.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:22.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46ba112700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6789/0 conn(0x7f46b4063550 legacy=0x7f46b4132430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896009530 0 0) 0x7f46b4133290 con 0x7f46b4064040 2021-02-24T15:20:22.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4694004bd0 con 0x7f46b4064040 2021-02-24T15:20:22.690 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46ba913700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.181:6789/0 conn(0x7f46b4095c90 legacy=0x7f46b413f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.690 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 10 client.?.objecter ms_handle_connect 0x7f46b4095c90 2021-02-24T15:20:22.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:22.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117017673 0 0) 0x7f46b4116dc0 con 0x7f46b4063550 2021-02-24T15:20:22.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b4133290 con 0x7f46b4063550 2021-02-24T15:20:22.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2477506253 0 0) 0x7f4694004bd0 con 0x7f46b4064040 2021-02-24T15:20:22.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f46b4116dc0 con 0x7f46b4064040 2021-02-24T15:20:22.692 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.671+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f46a40018f0 con 0x7f46b4064040 2021-02-24T15:20:22.692 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 855697728 0 0) 0x7f46b4133290 con 0x7f46b4063550 2021-02-24T15:20:22.692 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4694004bd0 con 0x7f46b4063550 2021-02-24T15:20:22.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f46b0001a20 con 0x7f46b4063550 2021-02-24T15:20:22.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1572172569 0 0) 0x7f46b4116dc0 con 0x7f46b4064040 2021-02-24T15:20:22.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.181:6789/0 conn(0x7f46b4095c90 legacy=0x7f46b413f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6789/0 conn(0x7f46b4063550 legacy=0x7f46b4132430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4117030 con 0x7f46b4064040 2021-02-24T15:20:22.694 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b4067df0 con 0x7f46b4064040 2021-02-24T15:20:22.694 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46bb114700 10 client.64103.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:22.694 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b4133cd0 con 0x7f46b4064040 2021-02-24T15:20:22.694 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46bb114700 1 librados: init done 2021-02-24T15:20:22.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f46a4001560 con 0x7f46b4064040 2021-02-24T15:20:22.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f46a4004f60 con 0x7f46b4064040 2021-02-24T15:20:22.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4698006550 con 0x7f46980027f0 2021-02-24T15:20:22.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.672+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f46a4005100 con 0x7f46b4064040 2021-02-24T15:20:22.696 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.673+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(162..162 src has 1..162) v4 ==== 5995+0+0 (unknown 3614054488 0 0) 0x7f46a403b690 con 0x7f46b4064040 2021-02-24T15:20:22.696 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.673+0000 7f46a27fc700 10 client.64103.objecter ms_dispatch 0x7f46b4001510 osd_map(162..162 src has 1..162) v4 2021-02-24T15:20:22.696 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.673+0000 7f46a27fc700 3 client.64103.objecter handle_osd_map got epochs [162,162] > 0 2021-02-24T15:20:22.696 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.673+0000 7f46a27fc700 3 client.64103.objecter handle_osd_map decoding full epoch 162 2021-02-24T15:20:22.697 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.673+0000 7f46a27fc700 20 client.64103.objecter dump_active .. 0 homeless 2021-02-24T15:20:22.697 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 10 client.64103.objecter ms_handle_connect 0x7f46980027f0 2021-02-24T15:20:22.697 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 10 client.64103.objecter resend_mon_ops 2021-02-24T15:20:22.697 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46ba112700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6789/0 conn(0x7f46980027f0 legacy=0x7f4698004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.698 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243547286 0 0) 0x7f4698006550 con 0x7f46980027f0 2021-02-24T15:20:22.698 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b4116dc0 con 0x7f46980027f0 2021-02-24T15:20:22.698 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 73918963 0 0) 0x7f46b4116dc0 con 0x7f46980027f0 2021-02-24T15:20:22.698 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4698006550 con 0x7f46980027f0 2021-02-24T15:20:22.699 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f46b0001d30 con 0x7f46980027f0 2021-02-24T15:20:22.699 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3784981207 0 0) 0x7f4698006550 con 0x7f46980027f0 2021-02-24T15:20:22.699 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4698009df0 con 0x7f46980027f0 2021-02-24T15:20:22.699 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 10 client.64103.objecter ms_handle_connect 0x7f4694031520 2021-02-24T15:20:22.700 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f46b0006ad0 con 0x7f46980027f0 2021-02-24T15:20:22.700 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6789/0 conn(0x7f46980027f0 legacy=0x7f4698004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.701 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.675+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6789/0 conn(0x7f46980027f0 legacy=0x7f4698004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:22.707 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.683+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4698009a80 con 0x7f4698008da0 2021-02-24T15:20:22.707 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.685+0000 7f46a27fc700 10 client.64103.objecter ms_handle_connect 0x7f4698008da0 2021-02-24T15:20:22.708 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.685+0000 7f46a27fc700 10 client.64103.objecter resend_mon_ops 2021-02-24T15:20:22.708 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.685+0000 7f46ba112700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6789/0 conn(0x7f4698008da0 legacy=0x7f4698009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.709 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353931010 0 0) 0x7f4698009a80 con 0x7f4698008da0 2021-02-24T15:20:22.709 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4698006550 con 0x7f4698008da0 2021-02-24T15:20:22.710 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 942989402 0 0) 0x7f4698006550 con 0x7f4698008da0 2021-02-24T15:20:22.710 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4698009a80 con 0x7f4698008da0 2021-02-24T15:20:22.711 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f46b0005090 con 0x7f4698008da0 2021-02-24T15:20:22.711 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 324249275 0 0) 0x7f4698009a80 con 0x7f4698008da0 2021-02-24T15:20:22.712 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f46980086f0 con 0x7f4698008da0 2021-02-24T15:20:22.712 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3942 (unknown 0 0 2778955094) 0x7f46b0006550 con 0x7f4698008da0 2021-02-24T15:20:22.713 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6789/0 conn(0x7f4698008da0 legacy=0x7f4698009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.713 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46a27fc700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6789/0 conn(0x7f4698008da0 legacy=0x7f4698009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:22.713 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46bb114700 10 librados: watch_flush enter 2021-02-24T15:20:22.714 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46bb114700 10 librados: watch_flush exit 2021-02-24T15:20:22.714 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46bb114700 20 client.64103.objecter shutdown clearing up homeless session... 2021-02-24T15:20:22.715 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46bb114700 10 client.64103.objecter successfully canceled tick 2021-02-24T15:20:22.715 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.181:6812/33484 conn(0x7f4694031520 legacy=0x7f46940339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.716 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 >> v1:172.21.15.152:6790/0 conn(0x7f46b4064040 legacy=0x7f46b4132b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.716 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.686+0000 7f46ba913700 1 -- 172.21.15.152:0/2550665163 reap_dead start 2021-02-24T15:20:22.716 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.687+0000 7f46ba913700 1 -- 172.21.15.152:0/2550665163 reap_dead start 2021-02-24T15:20:22.717 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.687+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 shutdown_connections 2021-02-24T15:20:22.717 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.687+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 >> 172.21.15.152:0/2550665163 conn(0x7f46b4099650 msgr2=0x7f46b4092700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:22.718 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.687+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 shutdown_connections 2021-02-24T15:20:22.718 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.687+0000 7f46bb114700 1 -- 172.21.15.152:0/2550665163 wait complete. 2021-02-24T15:20:22.718 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.687+0000 7f46bb114700 1 librados: shutdown 2021-02-24T15:20:22.719 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:20:22.719 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:22.720 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:22.720 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:20:22.720 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 20, 2021-02-24T15:20:22.721 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:20:22.721 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:20:22.721 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:20:22.721 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:20:22.722 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:22.722 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 2, 2021-02-24T15:20:22.722 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:22.723 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:20:22.723 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:20:22.723 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:22.723 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:22.724 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:22.724 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:22.725 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:22.725 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:22.725 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:22.726 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:22.726 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:22.727 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:22.727 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:20:22.727 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:20:22.728 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:22.728 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:22.729 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:22.729 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:22.730 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:22.730 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:22.730 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:22.731 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:22.732 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:22.732 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.733 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:20:22.733 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:20:22.733 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:20:22.733 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:20:22.734 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:20:22.734 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:20:22.735 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:22.735 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:22.736 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:20:22.736 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:20:22.736 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:20:22.737 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:20:22.737 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:20:22.738 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:22.738 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:20:22.739 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:22.739 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:22.740 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:22.740 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:22.740 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:22.741 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:22.742 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:22.742 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:22.743 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:22.743 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:22.744 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:20:22.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.744 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:20:22.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.745 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:22.746 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:22.746 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:22.747 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:22.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.748 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:22.748 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:20:22.748 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:22.749 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.749 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.750 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:20:22.751 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:20:22.751 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:22.752 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:22.752 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:22.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.753 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:22.753 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:22.754 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:22.754 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:22.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.754 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:22.755 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:20:22.755 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:22.755 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.755 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.756 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:20:22.756 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:20:22.756 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:22.756 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:22.757 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:22.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.758 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:22.759 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:22.759 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:22.759 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:22.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.760 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:22.760 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:20:22.761 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:22.761 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.762 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.763 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:20:22.763 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:20:22.764 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:22.764 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:22.764 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:22.765 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.765 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.766 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:20:22.766 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:20:22.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.767 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:22.767 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:22.767 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:22.767 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.768 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:22.768 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:20:22.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.768 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:22.768 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:22.769 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:20:22.769 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.769 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:22.769 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:20:22.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.770 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:22.770 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:22.770 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:20:22.770 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.770 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.771 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:20:22.771 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:20:22.772 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:20:22.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.889+0000 7f618e722700 1 Processor -- start 2021-02-24T15:20:22.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.889+0000 7f618e722700 1 -- start start 2021-02-24T15:20:22.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.890+0000 7f618e722700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6188097d40 con 0x7f6188063220 2021-02-24T15:20:22.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.890+0000 7f618e722700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6188063d00 con 0x7f6188099340 2021-02-24T15:20:22.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.890+0000 7f618e722700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6188097980 con 0x7f6188062da0 2021-02-24T15:20:22.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.890+0000 7f618ccbf700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6188063220 0x7f6188133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47290/0 (socket says 172.21.15.152:47290) 2021-02-24T15:20:22.892 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.890+0000 7f61877fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f6188062da0 0x7f618812fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35766/0 (socket says 172.21.15.152:35766) 2021-02-24T15:20:22.892 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.890+0000 7f618ccbf700 1 -- 172.21.15.152:0/3710859427 learned_addr learned my addr 172.21.15.152:0/3710859427 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:22.894 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f618ccbf700 1 -- 172.21.15.152:0/3710859427 >> v1:172.21.15.152:6789/0 conn(0x7f6188063220 legacy=0x7f6188133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.894 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f61877fe700 1 -- 172.21.15.152:0/3710859427 >> v1:172.21.15.152:6790/0 conn(0x7f6188062da0 legacy=0x7f618812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.894 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514936152 0 0) 0x7f6188097d40 con 0x7f6188063220 2021-02-24T15:20:22.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6174003230 con 0x7f6188063220 2021-02-24T15:20:22.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402390190 0 0) 0x7f6188097980 con 0x7f6188062da0 2021-02-24T15:20:22.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6187fff700 1 -- 172.21.15.152:0/3710859427 >> v1:172.21.15.181:6789/0 conn(0x7f6188099340 legacy=0x7f6188097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6188097d40 con 0x7f6188062da0 2021-02-24T15:20:22.895 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3357726325 0 0) 0x7f6174003230 con 0x7f6188063220 2021-02-24T15:20:22.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 >> v1:172.21.15.152:6790/0 conn(0x7f6188062da0 legacy=0x7f618812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 >> v1:172.21.15.181:6789/0 conn(0x7f6188099340 legacy=0x7f6188097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618808fac0 con 0x7f6188063220 2021-02-24T15:20:22.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.892+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6180001cb0 con 0x7f6188063220 2021-02-24T15:20:22.896 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.893+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6180001fc0 con 0x7f6188063220 2021-02-24T15:20:22.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.893+0000 7f6186ffd700 1 -- 172.21.15.152:0/3710859427 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6180004ad0 con 0x7f6188063220 2021-02-24T15:20:22.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.893+0000 7f618e722700 1 -- 172.21.15.152:0/3710859427 >> v1:172.21.15.152:6789/0 conn(0x7f6188063220 legacy=0x7f6188133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.893+0000 7f618e722700 1 -- 172.21.15.152:0/3710859427 shutdown_connections 2021-02-24T15:20:22.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.893+0000 7f618e722700 1 -- 172.21.15.152:0/3710859427 >> 172.21.15.152:0/3710859427 conn(0x7f618809dcc0 msgr2=0x7f618809e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:22.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.893+0000 7f618e722700 1 -- 172.21.15.152:0/3710859427 shutdown_connections 2021-02-24T15:20:22.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.893+0000 7f618e722700 1 -- 172.21.15.152:0/3710859427 wait complete. 2021-02-24T15:20:22.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.894+0000 7f618e722700 1 librados: starting msgr at 2021-02-24T15:20:22.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.894+0000 7f618e722700 1 librados: starting objecter 2021-02-24T15:20:22.902 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.894+0000 7f618e722700 1 Processor -- start 2021-02-24T15:20:22.902 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.894+0000 7f618e722700 1 -- start start 2021-02-24T15:20:22.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.894+0000 7f618e722700 1 librados: setting wanted keys 2021-02-24T15:20:22.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.894+0000 7f618e722700 1 librados: calling monclient init 2021-02-24T15:20:22.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.894+0000 7f618e722700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6188095250 con 0x7f6188099340 2021-02-24T15:20:22.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.894+0000 7f618e722700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61880954f0 con 0x7f6188062da0 2021-02-24T15:20:22.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.894+0000 7f618e722700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6188095790 con 0x7f6188063220 2021-02-24T15:20:22.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.895+0000 7f61877fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f6188063220 0x7f6188096c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35774/0 (socket says 172.21.15.152:35774) 2021-02-24T15:20:22.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.895+0000 7f61877fe700 1 -- 172.21.15.152:0/465201415 learned_addr learned my addr 172.21.15.152:0/465201415 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:22.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.895+0000 7f618ccbf700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6188099340 0x7f61881420c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47300/0 (socket says 172.21.15.152:47300) 2021-02-24T15:20:22.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f61877fe700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f6188063220 legacy=0x7f6188096c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 10 client.?.objecter ms_handle_connect 0x7f6188063220 2021-02-24T15:20:22.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f618ccbf700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6789/0 conn(0x7f6188099340 legacy=0x7f61881420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:22.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 10 client.?.objecter ms_handle_connect 0x7f6188099340 2021-02-24T15:20:22.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:22.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958036626 0 0) 0x7f6188095790 con 0x7f6188063220 2021-02-24T15:20:22.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6168004bd0 con 0x7f6188063220 2021-02-24T15:20:22.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957786038 0 0) 0x7f6188095250 con 0x7f6188099340 2021-02-24T15:20:22.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6188095790 con 0x7f6188099340 2021-02-24T15:20:22.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f6187fff700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.181:6789/0 conn(0x7f6188062da0 legacy=0x7f6188139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 10 client.?.objecter ms_handle_connect 0x7f6188062da0 2021-02-24T15:20:22.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:22.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1443812488 0 0) 0x7f6168004bd0 con 0x7f6188063220 2021-02-24T15:20:22.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6188095250 con 0x7f6188063220 2021-02-24T15:20:22.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f617c0044f0 con 0x7f6188063220 2021-02-24T15:20:22.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f61877fe700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f6188063220 legacy=0x7f6188096c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-24T15:20:22.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1388459303 0 0) 0x7f6188095790 con 0x7f6188099340 2021-02-24T15:20:22.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f61877fe700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f6188063220 legacy=0x7f6188096c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:20:22.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f61877fe700 1 --1- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f6188063220 0x7f6188096c40 :-1 s=OPENED pgs=8280 cs=1 l=1).handle_message read tag failed 2021-02-24T15:20:22.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f61877fe700 1 --1- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f6188063220 0x7f6188096c40 :-1 s=OPENED pgs=8280 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:20:22.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6168004bd0 con 0x7f6188099340 2021-02-24T15:20:22.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363172784 0 0) 0x7f61880954f0 con 0x7f6188062da0 2021-02-24T15:20:22.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6188095790 con 0x7f6188062da0 2021-02-24T15:20:22.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6180001c70 con 0x7f6188099340 2021-02-24T15:20:22.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4060232465 0 0) 0x7f6168004bd0 con 0x7f6188099340 2021-02-24T15:20:22.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f6188063220 legacy=0x7f6188096c40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:22.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.181:6789/0 conn(0x7f6188062da0 legacy=0x7f6188139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188093620 con 0x7f6188099340 2021-02-24T15:20:22.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618813a480 con 0x7f6188099340 2021-02-24T15:20:22.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f618e722700 10 client.27819.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:22.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6188097510 con 0x7f6188099340 2021-02-24T15:20:22.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.897+0000 7f618e722700 1 librados: init done 2021-02-24T15:20:22.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.898+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6180005080 con 0x7f6188099340 2021-02-24T15:20:22.911 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.898+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6180005390 con 0x7f6188099340 2021-02-24T15:20:22.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.898+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f618000de90 con 0x7f6188099340 2021-02-24T15:20:22.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.898+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f6160006550 con 0x7f61600027f0 2021-02-24T15:20:22.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.898+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(162..162 src has 1..162) v4 ==== 5995+0+0 (unknown 3614054488 0 0) 0x7f618003b630 con 0x7f6188099340 2021-02-24T15:20:22.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.898+0000 7f616ffff700 10 client.27819.objecter ms_dispatch 0x7f6188001510 osd_map(162..162 src has 1..162) v4 2021-02-24T15:20:22.912 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.898+0000 7f616ffff700 3 client.27819.objecter handle_osd_map got epochs [162,162] > 0 2021-02-24T15:20:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.898+0000 7f616ffff700 3 client.27819.objecter handle_osd_map decoding full epoch 162 2021-02-24T15:20:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.898+0000 7f616ffff700 20 client.27819.objecter dump_active .. 0 homeless 2021-02-24T15:20:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.900+0000 7f616ffff700 10 client.27819.objecter ms_handle_connect 0x7f61600027f0 2021-02-24T15:20:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.900+0000 7f616ffff700 10 client.27819.objecter resend_mon_ops 2021-02-24T15:20:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.900+0000 7f6187fff700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f61600027f0 legacy=0x7f6160004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.900+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753073734 0 0) 0x7f6160006550 con 0x7f61600027f0 2021-02-24T15:20:22.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6168004bd0 con 0x7f61600027f0 2021-02-24T15:20:22.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3834844588 0 0) 0x7f6168004bd0 con 0x7f61600027f0 2021-02-24T15:20:22.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6160006550 con 0x7f61600027f0 2021-02-24T15:20:22.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6178001ad0 con 0x7f61600027f0 2021-02-24T15:20:22.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3632232681 0 0) 0x7f6160006550 con 0x7f61600027f0 2021-02-24T15:20:22.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6160009df0 con 0x7f61600027f0 2021-02-24T15:20:22.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 10 client.27819.objecter ms_handle_connect 0x7f61680315a0 2021-02-24T15:20:22.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f61780054d0 con 0x7f61600027f0 2021-02-24T15:20:22.915 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f61600027f0 legacy=0x7f6160004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.901+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f61600027f0 legacy=0x7f6160004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:22.918 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.909+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f6160007500 con 0x7f61600068a0 2021-02-24T15:20:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.911+0000 7f616ffff700 10 client.27819.objecter ms_handle_connect 0x7f61600068a0 2021-02-24T15:20:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.911+0000 7f6187fff700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f61600068a0 legacy=0x7f6160006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.911+0000 7f616ffff700 10 client.27819.objecter resend_mon_ops 2021-02-24T15:20:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177381326 0 0) 0x7f6160007500 con 0x7f61600068a0 2021-02-24T15:20:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6160006550 con 0x7f61600068a0 2021-02-24T15:20:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3481727464 0 0) 0x7f6160006550 con 0x7f61600068a0 2021-02-24T15:20:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6160007500 con 0x7f61600068a0 2021-02-24T15:20:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f61780023c0 con 0x7f61600068a0 2021-02-24T15:20:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2175517700 0 0) 0x7f6160007500 con 0x7f61600068a0 2021-02-24T15:20:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6160008720 con 0x7f61600068a0 2021-02-24T15:20:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 1750319767) 0x7f6178002750 con 0x7f61600068a0 2021-02-24T15:20:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f61600068a0 legacy=0x7f6160006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f616ffff700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6790/0 conn(0x7f61600068a0 legacy=0x7f6160006d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f618e722700 10 librados: watch_flush enter 2021-02-24T15:20:22.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f618e722700 10 librados: watch_flush exit 2021-02-24T15:20:22.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f618e722700 20 client.27819.objecter shutdown clearing up homeless session... 2021-02-24T15:20:22.922 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.912+0000 7f618e722700 10 client.27819.objecter successfully canceled tick 2021-02-24T15:20:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.913+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.181:6812/33484 conn(0x7f61680315a0 legacy=0x7f6168033a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.913+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 >> v1:172.21.15.152:6789/0 conn(0x7f6188099340 legacy=0x7f61881420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.913+0000 7f618ccbf700 1 -- 172.21.15.152:0/465201415 reap_dead start 2021-02-24T15:20:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.913+0000 7f618ccbf700 1 -- 172.21.15.152:0/465201415 reap_dead start 2021-02-24T15:20:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.913+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 shutdown_connections 2021-02-24T15:20:22.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.913+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 >> 172.21.15.152:0/465201415 conn(0x7f618809dcc0 msgr2=0x7f618809c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:22.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.913+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 shutdown_connections 2021-02-24T15:20:22.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.913+0000 7f618e722700 1 -- 172.21.15.152:0/465201415 wait complete. 2021-02-24T15:20:22.924 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:22.913+0000 7f618e722700 1 librados: shutdown 2021-02-24T15:20:22.924 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:20:22.925 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:22.925 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:22.925 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:20:22.925 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 20, 2021-02-24T15:20:22.925 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:20:22.926 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:20:22.926 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:20:22.926 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:20:22.926 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:22.927 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:20:22.927 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:22.927 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:20:22.927 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:20:22.927 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:22.928 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:22.928 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:22.928 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:22.928 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:22.928 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:22.929 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:22.929 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:22.929 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:22.929 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:22.929 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:20:22.930 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:20:22.930 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:22.930 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:22.930 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:22.930 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:22.931 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:22.931 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:22.931 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:22.931 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:22.931 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:22.932 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.932 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:20:22.932 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:20:22.932 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:20:22.933 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:20:22.933 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:20:22.933 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:20:22.933 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:22.933 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:22.934 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:20:22.934 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:20:22.934 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:20:22.934 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:20:22.934 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:20:22.935 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:22.935 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:20:22.935 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:22.935 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:22.935 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:22.936 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:22.936 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:22.936 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:22.936 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:22.936 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:22.937 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:22.937 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:22.937 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:20:22.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.937 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:20:22.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.938 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:22.938 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:22.938 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:22.938 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:22.939 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.939 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:22.939 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:20:22.939 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:22.939 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.940 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.940 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:20:22.940 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:20:22.940 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:22.941 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:22.941 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:22.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.941 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.941 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:22.942 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:22.942 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:22.942 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:22.942 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.942 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:22.943 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:20:22.943 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:22.943 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.943 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.943 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.944 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:20:22.944 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:20:22.944 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:22.944 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:22.944 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:22.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.945 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.945 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:22.945 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:22.945 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:22.946 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:22.946 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.946 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:22.946 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:20:22.946 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:22.947 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.947 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.947 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:20:22.947 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:20:22.948 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:22.948 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:22.948 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:22.948 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.948 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.949 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.949 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:20:22.949 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:20:22.949 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.949 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:22.950 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:22.950 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:22.950 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.950 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:22.950 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:20:22.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:22.951 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:22.951 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:22.951 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:22.951 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:22.952 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:22.952 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:22.952 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:20:22.952 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:20:22.953 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:20:23.073 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.071+0000 7f18130fd700 1 Processor -- start 2021-02-24T15:20:23.073 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.071+0000 7f18130fd700 1 -- start start 2021-02-24T15:20:23.073 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.072+0000 7f18130fd700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c064120 con 0x7f180c062a90 2021-02-24T15:20:23.073 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.072+0000 7f18130fd700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c063300 con 0x7f180c131040 2021-02-24T15:20:23.074 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.072+0000 7f18130fd700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c098610 con 0x7f180c062e70 2021-02-24T15:20:23.074 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.072+0000 7f18118fa700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f180c062e70 0x7f180c097a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35784/0 (socket says 172.21.15.152:35784) 2021-02-24T15:20:23.074 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.072+0000 7f18118fa700 1 -- 172.21.15.152:0/3773623502 learned_addr learned my addr 172.21.15.152:0/3773623502 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:23.076 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.074+0000 7f18120fb700 1 -- 172.21.15.152:0/3773623502 >> v1:172.21.15.152:6789/0 conn(0x7f180c062a90 legacy=0x7f180c097320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.077 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.074+0000 7f18118fa700 1 -- 172.21.15.152:0/3773623502 >> v1:172.21.15.152:6790/0 conn(0x7f180c062e70 legacy=0x7f180c097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.077 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18128fc700 1 -- 172.21.15.152:0/3773623502 >> v1:172.21.15.181:6789/0 conn(0x7f180c131040 legacy=0x7f180c133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.077 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078068578 0 0) 0x7f180c064120 con 0x7f180c062a90 2021-02-24T15:20:23.077 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f4003230 con 0x7f180c062a90 2021-02-24T15:20:23.077 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637714807 0 0) 0x7f180c098610 con 0x7f180c062e70 2021-02-24T15:20:23.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f180c064120 con 0x7f180c062e70 2021-02-24T15:20:23.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983963925 0 0) 0x7f180c063300 con 0x7f180c131040 2021-02-24T15:20:23.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f180c098610 con 0x7f180c131040 2021-02-24T15:20:23.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3167140086 0 0) 0x7f17f4003230 con 0x7f180c062a90 2021-02-24T15:20:23.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 >> v1:172.21.15.152:6790/0 conn(0x7f180c062e70 legacy=0x7f180c097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.079 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 >> v1:172.21.15.181:6789/0 conn(0x7f180c131040 legacy=0x7f180c133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.079 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c098140 con 0x7f180c062a90 2021-02-24T15:20:23.079 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1808001980 con 0x7f180c062a90 2021-02-24T15:20:23.079 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1808001c90 con 0x7f180c062a90 2021-02-24T15:20:23.080 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18110f9700 1 -- 172.21.15.152:0/3773623502 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1808002060 con 0x7f180c062a90 2021-02-24T15:20:23.080 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.075+0000 7f18130fd700 1 -- 172.21.15.152:0/3773623502 >> v1:172.21.15.152:6789/0 conn(0x7f180c062a90 legacy=0x7f180c097320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.080 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 -- 172.21.15.152:0/3773623502 shutdown_connections 2021-02-24T15:20:23.080 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 -- 172.21.15.152:0/3773623502 >> 172.21.15.152:0/3773623502 conn(0x7f180c09b810 msgr2=0x7f180c09bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:23.080 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 -- 172.21.15.152:0/3773623502 shutdown_connections 2021-02-24T15:20:23.081 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 -- 172.21.15.152:0/3773623502 wait complete. 2021-02-24T15:20:23.086 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 librados: starting msgr at 2021-02-24T15:20:23.086 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 librados: starting objecter 2021-02-24T15:20:23.086 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 Processor -- start 2021-02-24T15:20:23.086 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 -- start start 2021-02-24T15:20:23.087 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 librados: setting wanted keys 2021-02-24T15:20:23.087 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.076+0000 7f18130fd700 1 librados: calling monclient init 2021-02-24T15:20:23.087 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.077+0000 7f18130fd700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c12d410 con 0x7f180c062e70 2021-02-24T15:20:23.087 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.077+0000 7f18130fd700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c129c00 con 0x7f180c131040 2021-02-24T15:20:23.087 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.077+0000 7f18130fd700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c113c60 con 0x7f180c062a90 2021-02-24T15:20:23.088 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.077+0000 7f18120fb700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f180c062a90 0x7f180c12f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35786/0 (socket says 172.21.15.152:35786) 2021-02-24T15:20:23.088 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.077+0000 7f18120fb700 1 -- 172.21.15.152:0/9010300 learned_addr learned my addr 172.21.15.152:0/9010300 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:23.088 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f18120fb700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.152:6790/0 conn(0x7f180c062a90 legacy=0x7f180c12f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.088 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f18118fa700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.152:6789/0 conn(0x7f180c062e70 legacy=0x7f180c1294f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.088 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 10 client.?.objecter ms_handle_connect 0x7f180c062a90 2021-02-24T15:20:23.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:23.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 10 client.?.objecter ms_handle_connect 0x7f180c062e70 2021-02-24T15:20:23.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:23.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652342926 0 0) 0x7f180c113c60 con 0x7f180c062a90 2021-02-24T15:20:23.090 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17ec004bd0 con 0x7f180c062a90 2021-02-24T15:20:23.090 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400216043 0 0) 0x7f180c12d410 con 0x7f180c062e70 2021-02-24T15:20:23.090 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f180c113c60 con 0x7f180c062e70 2021-02-24T15:20:23.090 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f18128fc700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.181:6789/0 conn(0x7f180c131040 legacy=0x7f180c141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.090 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 10 client.?.objecter ms_handle_connect 0x7f180c131040 2021-02-24T15:20:23.091 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:23.091 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 913099832 0 0) 0x7f17ec004bd0 con 0x7f180c062a90 2021-02-24T15:20:23.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f180c12d410 con 0x7f180c062a90 2021-02-24T15:20:23.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.079+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1808001940 con 0x7f180c062a90 2021-02-24T15:20:23.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1223764420 0 0) 0x7f180c113c60 con 0x7f180c062e70 2021-02-24T15:20:23.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f17ec004bd0 con 0x7f180c062e70 2021-02-24T15:20:23.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f17fc001d30 con 0x7f180c062e70 2021-02-24T15:20:23.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143701187 0 0) 0x7f180c129c00 con 0x7f180c131040 2021-02-24T15:20:23.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f180c113c60 con 0x7f180c131040 2021-02-24T15:20:23.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 188739591 0 0) 0x7f180c12d410 con 0x7f180c062a90 2021-02-24T15:20:23.094 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.181:6789/0 conn(0x7f180c131040 legacy=0x7f180c141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.094 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.152:6789/0 conn(0x7f180c062e70 legacy=0x7f180c1294f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.094 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c113f00 con 0x7f180c062a90 2021-02-24T15:20:23.094 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c112a30 con 0x7f180c062a90 2021-02-24T15:20:23.095 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f18130fd700 10 client.64121.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:23.095 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c130520 con 0x7f180c062a90 2021-02-24T15:20:23.095 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f18130fd700 1 librados: init done 2021-02-24T15:20:23.095 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f18080015b0 con 0x7f180c062a90 2021-02-24T15:20:23.096 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1808002940 con 0x7f180c062a90 2021-02-24T15:20:23.096 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.080+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f1808002aa0 con 0x7f180c062a90 2021-02-24T15:20:23.096 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.081+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(162..162 src has 1..162) v4 ==== 5995+0+0 (unknown 3614054488 0 0) 0x7f180803b4d0 con 0x7f180c062a90 2021-02-24T15:20:23.096 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.081+0000 7f17fa7fc700 10 client.64121.objecter ms_dispatch 0x7f180c001510 osd_map(162..162 src has 1..162) v4 2021-02-24T15:20:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.081+0000 7f17fa7fc700 3 client.64121.objecter handle_osd_map got epochs [162,162] > 0 2021-02-24T15:20:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.081+0000 7f17fa7fc700 3 client.64121.objecter handle_osd_map decoding full epoch 162 2021-02-24T15:20:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.081+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f17f0006550 con 0x7f17f00027f0 2021-02-24T15:20:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.081+0000 7f17fa7fc700 20 client.64121.objecter dump_active .. 0 homeless 2021-02-24T15:20:23.098 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.083+0000 7f17fa7fc700 10 client.64121.objecter ms_handle_connect 0x7f17f00027f0 2021-02-24T15:20:23.098 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.083+0000 7f18128fc700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.181:6789/0 conn(0x7f17f00027f0 legacy=0x7f17f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.098 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.083+0000 7f17fa7fc700 10 client.64121.objecter resend_mon_ops 2021-02-24T15:20:23.098 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.083+0000 7f17fa7fc700 10 client.64121.objecter ms_handle_connect 0x7f17ec031660 2021-02-24T15:20:23.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.083+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088517636 0 0) 0x7f17f0006550 con 0x7f17f00027f0 2021-02-24T15:20:23.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.083+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f180c12d410 con 0x7f17f00027f0 2021-02-24T15:20:23.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.083+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1411352634 0 0) 0x7f180c12d410 con 0x7f17f00027f0 2021-02-24T15:20:23.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.083+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f17f0006550 con 0x7f17f00027f0 2021-02-24T15:20:23.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.083+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1804001e30 con 0x7f17f00027f0 2021-02-24T15:20:23.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.084+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 610741967 0 0) 0x7f17f0006550 con 0x7f17f00027f0 2021-02-24T15:20:23.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.084+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17f0009df0 con 0x7f17f00027f0 2021-02-24T15:20:23.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.084+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f1804005850 con 0x7f17f00027f0 2021-02-24T15:20:23.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.084+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.181:6789/0 conn(0x7f17f00027f0 legacy=0x7f17f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.101 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.084+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.181:6789/0 conn(0x7f17f00027f0 legacy=0x7f17f0004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:23.101 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.092+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f17f0007520 con 0x7f17f00068c0 2021-02-24T15:20:23.102 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.095+0000 7f17fa7fc700 10 client.64121.objecter ms_handle_connect 0x7f17f00068c0 2021-02-24T15:20:23.102 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.095+0000 7f18128fc700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.181:6789/0 conn(0x7f17f00068c0 legacy=0x7f17f0006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.103 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.095+0000 7f17fa7fc700 10 client.64121.objecter resend_mon_ops 2021-02-24T15:20:23.105 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.102+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407288190 0 0) 0x7f17f0007520 con 0x7f17f00068c0 2021-02-24T15:20:23.105 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.102+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f0006550 con 0x7f17f00068c0 2021-02-24T15:20:23.106 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.103+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 188416386 0 0) 0x7f17f0006550 con 0x7f17f00068c0 2021-02-24T15:20:23.106 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.103+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f17f0007520 con 0x7f17f00068c0 2021-02-24T15:20:23.106 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.103+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f18040027c0 con 0x7f17f00068c0 2021-02-24T15:20:23.106 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.103+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1375963783 0 0) 0x7f17f0007520 con 0x7f17f00068c0 2021-02-24T15:20:23.107 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.103+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f17f0008720 con 0x7f17f00068c0 2021-02-24T15:20:23.107 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.103+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4110 (unknown 0 0 804062029) 0x7f1804005b00 con 0x7f17f00068c0 2021-02-24T15:20:23.107 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.103+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.181:6789/0 conn(0x7f17f00068c0 legacy=0x7f17f0006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.107 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.103+0000 7f17fa7fc700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.181:6789/0 conn(0x7f17f00068c0 legacy=0x7f17f0006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:23.108 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 10 librados: watch_flush enter 2021-02-24T15:20:23.108 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 10 librados: watch_flush exit 2021-02-24T15:20:23.108 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 20 client.64121.objecter shutdown clearing up homeless session... 2021-02-24T15:20:23.108 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 10 client.64121.objecter successfully canceled tick 2021-02-24T15:20:23.109 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.181:6812/33484 conn(0x7f17ec031660 legacy=0x7f17ec033b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.109 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 >> v1:172.21.15.152:6790/0 conn(0x7f180c062a90 legacy=0x7f180c12f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.109 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18128fc700 1 -- 172.21.15.152:0/9010300 reap_dead start 2021-02-24T15:20:23.109 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 shutdown_connections 2021-02-24T15:20:23.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 >> 172.21.15.152:0/9010300 conn(0x7f180c09b810 msgr2=0x7f180c09af90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:23.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 shutdown_connections 2021-02-24T15:20:23.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 1 -- 172.21.15.152:0/9010300 wait complete. 2021-02-24T15:20:23.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.104+0000 7f18130fd700 1 librados: shutdown 2021-02-24T15:20:23.111 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:20:23.111 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:23.111 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:23.111 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:20:23.112 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 20, 2021-02-24T15:20:23.112 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:20:23.113 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:20:23.113 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:20:23.113 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:20:23.113 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:23.114 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:20:23.114 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:23.114 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:20:23.114 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:20:23.114 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:23.115 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:23.115 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:23.115 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:23.115 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:23.115 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:23.116 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:23.116 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:23.116 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:23.116 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:23.116 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:20:23.117 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:20:23.117 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:23.117 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:23.117 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:23.117 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:23.118 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:23.118 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:23.118 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:23.118 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:23.119 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:23.119 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:23.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:23.119 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:20:23.119 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:20:23.120 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:20:23.120 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:20:23.120 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:20:23.120 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:20:23.120 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:23.121 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:23.121 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:20:23.121 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:20:23.121 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:20:23.122 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:20:23.122 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:20:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:20:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:23.125 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:23.125 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:23.125 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:23.125 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:20:23.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:23.126 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:20:23.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.126 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:23.126 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:23.127 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:23.127 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:23.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.127 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:23.127 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:20:23.128 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:23.128 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:23.128 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:23.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:23.128 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:20:23.129 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:20:23.129 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:23.129 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:23.129 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:23.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:23.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.130 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:23.130 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:23.130 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:23.131 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:23.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.131 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:23.131 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:20:23.131 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:23.132 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:23.132 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:23.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:23.132 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:20:23.133 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:20:23.133 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:23.133 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:23.133 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:23.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:23.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.134 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:23.134 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:23.134 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:23.135 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:23.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.135 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:23.135 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:20:23.135 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:23.136 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:23.136 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:23.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:23.136 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:20:23.136 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:20:23.137 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:23.137 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:23.137 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:23.137 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:23.137 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:23.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:23.138 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:20:23.138 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:20:23.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.139 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:23.139 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:23.139 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:23.139 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:23.140 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:23.140 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:20:23.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.140 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:23.140 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:23.141 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:20:23.141 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:23.141 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:23.141 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:20:23.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.142 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:23.142 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:23.142 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:20:23.142 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:23.143 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:23.143 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:20:23.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:23.143 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:23.144 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:23.144 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:23.144 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:23.144 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:23.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:23.145 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:20:23.145 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:20:23.146 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2021-02-24T15:20:23.146 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2021-02-24T15:20:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.262+0000 7fa9fb767700 1 Processor -- start 2021-02-24T15:20:23.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.262+0000 7fa9fb767700 1 -- start start 2021-02-24T15:20:23.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.263+0000 7fa9fb767700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f4097d40 con 0x7fa9f4063220 2021-02-24T15:20:23.264 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.263+0000 7fa9fb767700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f4063d00 con 0x7fa9f4062da0 2021-02-24T15:20:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.263+0000 7fa9fb767700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f4097980 con 0x7fa9f4099340 2021-02-24T15:20:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.263+0000 7fa9f9503700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fa9f4099340 0x7fa9f4097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35798/0 (socket says 172.21.15.152:35798) 2021-02-24T15:20:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.263+0000 7fa9f9d04700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa9f4063220 0x7fa9f4133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47326/0 (socket says 172.21.15.152:47326) 2021-02-24T15:20:23.265 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.263+0000 7fa9f9503700 1 -- 172.21.15.152:0/4158061481 learned_addr learned my addr 172.21.15.152:0/4158061481 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.265+0000 7fa9f9503700 1 -- 172.21.15.152:0/4158061481 >> v1:172.21.15.152:6790/0 conn(0x7fa9f4099340 legacy=0x7fa9f4097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.265+0000 7fa9f9d04700 1 -- 172.21.15.152:0/4158061481 >> v1:172.21.15.152:6789/0 conn(0x7fa9f4063220 legacy=0x7fa9f4133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.265+0000 7fa9f8d02700 1 -- 172.21.15.152:0/4158061481 >> v1:172.21.15.181:6789/0 conn(0x7fa9f4062da0 legacy=0x7fa9f412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918772935 0 0) 0x7fa9f4097980 con 0x7fa9f4099340 2021-02-24T15:20:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9dc003230 con 0x7fa9f4099340 2021-02-24T15:20:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776054167 0 0) 0x7fa9f4097d40 con 0x7fa9f4063220 2021-02-24T15:20:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f4097980 con 0x7fa9f4063220 2021-02-24T15:20:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322709297 0 0) 0x7fa9f4063d00 con 0x7fa9f4062da0 2021-02-24T15:20:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f4097d40 con 0x7fa9f4062da0 2021-02-24T15:20:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 440977202 0 0) 0x7fa9dc003230 con 0x7fa9f4099340 2021-02-24T15:20:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 >> v1:172.21.15.181:6789/0 conn(0x7fa9f4062da0 legacy=0x7fa9f412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 >> v1:172.21.15.152:6789/0 conn(0x7fa9f4063220 legacy=0x7fa9f4133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f408fac0 con 0x7fa9f4099340 2021-02-24T15:20:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa9f0001930 con 0x7fa9f4099340 2021-02-24T15:20:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa9f0001c40 con 0x7fa9f4099340 2021-02-24T15:20:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9e3fff700 1 -- 172.21.15.152:0/4158061481 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa9f0004750 con 0x7fa9f4099340 2021-02-24T15:20:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9fb767700 1 -- 172.21.15.152:0/4158061481 >> v1:172.21.15.152:6790/0 conn(0x7fa9f4099340 legacy=0x7fa9f4097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9fb767700 1 -- 172.21.15.152:0/4158061481 shutdown_connections 2021-02-24T15:20:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.266+0000 7fa9fb767700 1 -- 172.21.15.152:0/4158061481 >> 172.21.15.152:0/4158061481 conn(0x7fa9f409dcc0 msgr2=0x7fa9f409e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.267+0000 7fa9fb767700 1 -- 172.21.15.152:0/4158061481 shutdown_connections 2021-02-24T15:20:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.267+0000 7fa9fb767700 1 -- 172.21.15.152:0/4158061481 wait complete. 2021-02-24T15:20:23.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.267+0000 7fa9fb767700 1 librados: starting msgr at 2021-02-24T15:20:23.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.267+0000 7fa9fb767700 1 librados: starting objecter 2021-02-24T15:20:23.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.267+0000 7fa9fb767700 1 Processor -- start 2021-02-24T15:20:23.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.267+0000 7fa9fb767700 1 -- start start 2021-02-24T15:20:23.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.267+0000 7fa9fb767700 1 librados: setting wanted keys 2021-02-24T15:20:23.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.267+0000 7fa9fb767700 1 librados: calling monclient init 2021-02-24T15:20:23.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.268+0000 7fa9fb767700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f40998b0 con 0x7fa9f4062da0 2021-02-24T15:20:23.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.268+0000 7fa9fb767700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f4097050 con 0x7fa9f4063220 2021-02-24T15:20:23.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.268+0000 7fa9fb767700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f40921c0 con 0x7fa9f4099340 2021-02-24T15:20:23.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.268+0000 7fa9f9503700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa9f4062da0 0x7fa9f4096940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47328/0 (socket says 172.21.15.152:47328) 2021-02-24T15:20:23.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.268+0000 7fa9f9503700 1 -- 172.21.15.152:0/3749728696 learned_addr learned my addr 172.21.15.152:0/3749728696 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:23.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9f9503700 1 -- 172.21.15.152:0/3749728696 >> v1:172.21.15.152:6789/0 conn(0x7fa9f4062da0 legacy=0x7fa9f4096940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 10 client.?.objecter ms_handle_connect 0x7fa9f4062da0 2021-02-24T15:20:23.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9f9d04700 1 -- 172.21.15.152:0/3749728696 >> v1:172.21.15.152:6790/0 conn(0x7fa9f4099340 legacy=0x7fa9f4142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:23.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 10 client.?.objecter ms_handle_connect 0x7fa9f4099340 2021-02-24T15:20:23.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:23.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9f8d02700 1 -- 172.21.15.152:0/3749728696 >> v1:172.21.15.181:6789/0 conn(0x7fa9f4063220 legacy=0x7fa9f413f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:23.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251969663 0 0) 0x7fa9f40998b0 con 0x7fa9f4062da0 2021-02-24T15:20:23.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d4004bd0 con 0x7fa9f4062da0 2021-02-24T15:20:23.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 10 client.?.objecter ms_handle_connect 0x7fa9f4063220 2021-02-24T15:20:23.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:23.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610442925 0 0) 0x7fa9f40921c0 con 0x7fa9f4099340 2021-02-24T15:20:23.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f40998b0 con 0x7fa9f4099340 2021-02-24T15:20:23.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927869306 0 0) 0x7fa9f4097050 con 0x7fa9f4063220 2021-02-24T15:20:23.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.270+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f40921c0 con 0x7fa9f4063220 2021-02-24T15:20:23.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 521127129 0 0) 0x7fa9d4004bd0 con 0x7fa9f4062da0 2021-02-24T15:20:23.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa9f4097050 con 0x7fa9f4062da0 2021-02-24T15:20:23.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa9f00018f0 con 0x7fa9f4062da0 2021-02-24T15:20:23.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1742752898 0 0) 0x7fa9f40998b0 con 0x7fa9f4099340 2021-02-24T15:20:23.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa9d4004bd0 con 0x7fa9f4099340 2021-02-24T15:20:23.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa9ec001ef0 con 0x7fa9f4099340 2021-02-24T15:20:23.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4182671165 0 0) 0x7fa9f4097050 con 0x7fa9f4062da0 2021-02-24T15:20:23.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 >> v1:172.21.15.152:6790/0 conn(0x7fa9f4099340 legacy=0x7fa9f4142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 >> v1:172.21.15.181:6789/0 conn(0x7fa9f4063220 legacy=0x7fa9f413f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4092460 con 0x7fa9f4062da0 2021-02-24T15:20:23.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f4090dd0 con 0x7fa9f4062da0 2021-02-24T15:20:23.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9fb767700 10 client.27831.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:23.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f413ac50 con 0x7fa9f4062da0 2021-02-24T15:20:23.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9fb767700 1 librados: init done 2021-02-24T15:20:23.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa9f0004d00 con 0x7fa9f4062da0 2021-02-24T15:20:23.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.271+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa9f0005010 con 0x7fa9f4062da0 2021-02-24T15:20:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.272+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fa9f000db10 con 0x7fa9f4062da0 2021-02-24T15:20:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.272+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(163..163 src has 1..163) v4 ==== 5407+0+0 (unknown 2204372072 0 0) 0x7fa9f003b240 con 0x7fa9f4062da0 2021-02-24T15:20:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.272+0000 7fa9e17fa700 10 client.27831.objecter ms_dispatch 0x7fa9f4001510 osd_map(163..163 src has 1..163) v4 2021-02-24T15:20:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.272+0000 7fa9e17fa700 3 client.27831.objecter handle_osd_map got epochs [163,163] > 0 2021-02-24T15:20:23.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.272+0000 7fa9e17fa700 3 client.27831.objecter handle_osd_map decoding full epoch 163 2021-02-24T15:20:23.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.272+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc004d60 con 0x7fa9f4062da0 2021-02-24T15:20:23.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.272+0000 7fa9e17fa700 20 client.27831.objecter dump_active .. 0 homeless 2021-02-24T15:20:23.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.274+0000 7fa9e17fa700 10 client.27831.objecter ms_handle_connect 0x7fa9d40315f0 2021-02-24T15:20:23.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.276+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fa9f00129b0 con 0x7fa9f4062da0 2021-02-24T15:20:23.515 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.515+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fa9cc005820 con 0x7fa9f4062da0 2021-02-24T15:20:23.516 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.516+0000 7fa9e17fa700 1 -- 172.21.15.152:0/3749728696 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (unknown 246732539 0 0) 0x7fa9f00125a0 con 0x7fa9f4062da0 2021-02-24T15:20:23.517 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.516+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.517 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.516+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=13,config=1,health=10,kv=6,logm=70} crc {auth=980014014,config=1228700967,health=1590926895,kv=2558848642,logm=1015313463}) 2021-02-24T15:20:23.517 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.516+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=12,kv=6,logm=68} crc {auth=3249605931,config=3140514009,health=2754971242,kv=2558848642,logm=1433127872}) 2021-02-24T15:20:23.517 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.516+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.518 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.516+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=13,config=1,health=10,kv=6,logm=70} crc {auth=980014014,config=1228700967,health=1590926895,kv=2558848642,logm=1015313463}) 2021-02-24T15:20:23.518 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.516+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=2,health=12,kv=6,logm=68} crc {auth=1169760617,config=3140514009,health=2754971242,kv=2558848642,logm=1373664818}) 2021-02-24T15:20:23.520 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.517+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.520 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.517+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596149293}) 2021-02-24T15:20:23.520 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.517+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3334451193}) 2021-02-24T15:20:23.521 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.517+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.521 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.517+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596149293}) 2021-02-24T15:20:23.521 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.517+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1925343770}) 2021-02-24T15:20:23.521 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.519+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.521 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.519+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168996546}) 2021-02-24T15:20:23.522 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.519+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2950004603}) 2021-02-24T15:20:23.522 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.519+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.523 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.519+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168996546}) 2021-02-24T15:20:23.523 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.519+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3975734351}) 2021-02-24T15:20:23.523 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.518+0000 7fa9fb767700 10 librados: watch_flush enter 2021-02-24T15:20:23.523 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.518+0000 7fa9fb767700 10 librados: watch_flush exit 2021-02-24T15:20:23.523 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.518+0000 7fa9fb767700 20 client.27831.objecter shutdown clearing up homeless session... 2021-02-24T15:20:23.524 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.518+0000 7fa9fb767700 10 client.27831.objecter successfully canceled tick 2021-02-24T15:20:23.524 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.519+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 >> v1:172.21.15.181:6812/33484 conn(0x7fa9d40315f0 legacy=0x7fa9d4033ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.524 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.519+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 >> v1:172.21.15.152:6789/0 conn(0x7fa9f4062da0 legacy=0x7fa9f4096940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:23.524 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.519+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 shutdown_connections 2021-02-24T15:20:23.525 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.519+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 >> 172.21.15.152:0/3749728696 conn(0x7fa9f409dcc0 msgr2=0x7fa9f409c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:23.525 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.519+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 shutdown_connections 2021-02-24T15:20:23.525 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.519+0000 7fa9fb767700 1 -- 172.21.15.152:0/3749728696 wait complete. 2021-02-24T15:20:23.525 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:23.519+0000 7fa9fb767700 1 librados: shutdown 2021-02-24T15:20:23.526 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.521+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.526 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.521+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=2} crc {logm=4253905499,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=1860264947,mon_config_key=494186913}) 2021-02-24T15:20:23.527 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.521+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=78,mdsmap=2,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=1} crc {logm=767274031,mdsmap=3585761405,mgr=3065097882,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=2954704988,mon_config_key=1459387395}) 2021-02-24T15:20:23.527 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.521+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.527 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.521+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=2} crc {logm=4253905499,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=1860264947,mon_config_key=494186913}) 2021-02-24T15:20:23.527 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.521+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=78,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10} crc {logm=2922254100,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=3797962296}) 2021-02-24T15:20:23.532 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.531+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.533 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.531+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=2,monmap=1,osd_metadata=5,osd_pg_creating=1,osd_snap=29,osdmap=62} crc {mon_config_key=3252665088,monmap=1228700967,osd_metadata=1255284737,osd_pg_creating=1149948489,osd_snap=942436904,osdmap=1230860925}) 2021-02-24T15:20:23.533 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.531+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=2,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=27,osdmap=61} crc {mon_config_key=3252665088,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=1149948489,osd_snap=1883817473,osdmap=2960668178}) 2021-02-24T15:20:23.533 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.531+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.533 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.531+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=2,monmap=1,osd_metadata=5,osd_pg_creating=1,osd_snap=29,osdmap=62} crc {mon_config_key=3252665088,monmap=1228700967,osd_metadata=1255284737,osd_pg_creating=1149948489,osd_snap=942436904,osdmap=1230860925}) 2021-02-24T15:20:23.534 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.531+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=2,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=28,osdmap=60} crc {mon_config_key=3252665088,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=1149948489,osd_snap=417366350,osdmap=386472651}) 2021-02-24T15:20:23.534 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2021-02-24T15:20:23.535 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.532+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.535 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.532+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4023469810}) 2021-02-24T15:20:23.536 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.532+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1543782751}) 2021-02-24T15:20:23.536 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.532+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.536 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.532+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4023469810}) 2021-02-24T15:20:23.536 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.532+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=826049336}) 2021-02-24T15:20:23.536 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.533+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.537 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.533+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=81} crc {osdmap=958216860}) 2021-02-24T15:20:23.537 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.533+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=84} crc {osdmap=1881085750}) 2021-02-24T15:20:23.537 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.533+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:20:23.537 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.534+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=81} crc {osdmap=958216860}) 2021-02-24T15:20:23.538 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:20:23.534+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=86} crc {osdmap=3981314704}) 2021-02-24T15:20:24.535 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:20:24.536 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:20:24.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.654+0000 7f1d32ac0700 1 Processor -- start 2021-02-24T15:20:24.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.654+0000 7f1d32ac0700 1 -- start start 2021-02-24T15:20:24.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.655+0000 7f1d32ac0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c097d40 con 0x7f1d2c063220 2021-02-24T15:20:24.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.655+0000 7f1d32ac0700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c063d00 con 0x7f1d2c099340 2021-02-24T15:20:24.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.655+0000 7f1d32ac0700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c097980 con 0x7f1d2c062da0 2021-02-24T15:20:24.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.655+0000 7f1d3105d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1d2c063220 0x7f1d2c133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47338/0 (socket says 172.21.15.152:47338) 2021-02-24T15:20:24.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.655+0000 7f1d2bfff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f1d2c062da0 0x7f1d2c12fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35814/0 (socket says 172.21.15.152:35814) 2021-02-24T15:20:24.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.655+0000 7f1d3105d700 1 -- 172.21.15.152:0/2268146521 learned_addr learned my addr 172.21.15.152:0/2268146521 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:24.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2bfff700 1 -- 172.21.15.152:0/2268146521 >> v1:172.21.15.152:6790/0 conn(0x7f1d2c062da0 legacy=0x7f1d2c12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:24.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d3105d700 1 -- 172.21.15.152:0/2268146521 >> v1:172.21.15.152:6789/0 conn(0x7f1d2c063220 legacy=0x7f1d2c133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:24.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696547740 0 0) 0x7f1d2c097980 con 0x7f1d2c062da0 2021-02-24T15:20:24.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d10003230 con 0x7f1d2c062da0 2021-02-24T15:20:24.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011451157 0 0) 0x7f1d2c097d40 con 0x7f1d2c063220 2021-02-24T15:20:24.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d2c097980 con 0x7f1d2c063220 2021-02-24T15:20:24.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4119245637 0 0) 0x7f1d10003230 con 0x7f1d2c062da0 2021-02-24T15:20:24.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 >> v1:172.21.15.181:6789/0 conn(0x7f1d2c099340 legacy=0x7f1d2c097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:24.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d3085c700 1 -- 172.21.15.152:0/2268146521 >> v1:172.21.15.181:6789/0 conn(0x7f1d2c099340 legacy=0x7f1d2c097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:24.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 >> v1:172.21.15.152:6789/0 conn(0x7f1d2c063220 legacy=0x7f1d2c133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:24.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c08fac0 con 0x7f1d2c062da0 2021-02-24T15:20:24.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.657+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d18001930 con 0x7f1d2c062da0 2021-02-24T15:20:24.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.658+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1d18001c00 con 0x7f1d2c062da0 2021-02-24T15:20:24.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.658+0000 7f1d2b7fe700 1 -- 172.21.15.152:0/2268146521 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d18004690 con 0x7f1d2c062da0 2021-02-24T15:20:24.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.658+0000 7f1d32ac0700 1 -- 172.21.15.152:0/2268146521 >> v1:172.21.15.152:6790/0 conn(0x7f1d2c062da0 legacy=0x7f1d2c12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:24.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.658+0000 7f1d32ac0700 1 -- 172.21.15.152:0/2268146521 shutdown_connections 2021-02-24T15:20:24.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.658+0000 7f1d32ac0700 1 -- 172.21.15.152:0/2268146521 >> 172.21.15.152:0/2268146521 conn(0x7f1d2c09dcc0 msgr2=0x7f1d2c09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:24.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.658+0000 7f1d32ac0700 1 -- 172.21.15.152:0/2268146521 shutdown_connections 2021-02-24T15:20:24.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.658+0000 7f1d32ac0700 1 -- 172.21.15.152:0/2268146521 wait complete. 2021-02-24T15:20:24.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.659+0000 7f1d32ac0700 1 librados: starting msgr at 2021-02-24T15:20:24.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.659+0000 7f1d32ac0700 1 librados: starting objecter 2021-02-24T15:20:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.659+0000 7f1d32ac0700 1 Processor -- start 2021-02-24T15:20:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.659+0000 7f1d32ac0700 1 -- start start 2021-02-24T15:20:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.659+0000 7f1d32ac0700 1 librados: setting wanted keys 2021-02-24T15:20:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.659+0000 7f1d32ac0700 1 librados: calling monclient init 2021-02-24T15:20:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.660+0000 7f1d32ac0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c126820 con 0x7f1d2c062da0 2021-02-24T15:20:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.660+0000 7f1d32ac0700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c11d8a0 con 0x7f1d2c099340 2021-02-24T15:20:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.660+0000 7f1d32ac0700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c065440 con 0x7f1d2c063220 2021-02-24T15:20:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.660+0000 7f1d2bfff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f1d2c063220 0x7f1d2c11d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35822/0 (socket says 172.21.15.152:35822) 2021-02-24T15:20:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.660+0000 7f1d2bfff700 1 -- 172.21.15.152:0/969951503 learned_addr learned my addr 172.21.15.152:0/969951503 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.660+0000 7f1d3085c700 1 --1- 172.21.15.152:0/969951503 >> v1:172.21.15.152:6789/0 conn(0x7f1d2c062da0 0x7f1d2c11ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47344/0 (socket says 172.21.15.152:47344) 2021-02-24T15:20:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d2bfff700 1 -- 172.21.15.152:0/969951503 >> v1:172.21.15.152:6790/0 conn(0x7f1d2c063220 legacy=0x7f1d2c11d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 10 client.?.objecter ms_handle_connect 0x7f1d2c063220 2021-02-24T15:20:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d3085c700 1 -- 172.21.15.152:0/969951503 >> v1:172.21.15.152:6789/0 conn(0x7f1d2c062da0 legacy=0x7f1d2c11ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 10 client.?.objecter ms_handle_connect 0x7f1d2c062da0 2021-02-24T15:20:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436209744 0 0) 0x7f1d2c065440 con 0x7f1d2c063220 2021-02-24T15:20:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d0c004bd0 con 0x7f1d2c063220 2021-02-24T15:20:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056559473 0 0) 0x7f1d2c126820 con 0x7f1d2c062da0 2021-02-24T15:20:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d2c065440 con 0x7f1d2c062da0 2021-02-24T15:20:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 10 client.?.objecter ms_handle_connect 0x7f1d2c099340 2021-02-24T15:20:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d3105d700 1 -- 172.21.15.152:0/969951503 >> v1:172.21.15.181:6789/0 conn(0x7f1d2c099340 legacy=0x7f1d2c146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:24.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3484683374 0 0) 0x7f1d2c065440 con 0x7f1d2c062da0 2021-02-24T15:20:24.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d2c126820 con 0x7f1d2c062da0 2021-02-24T15:20:24.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d20001a80 con 0x7f1d2c062da0 2021-02-24T15:20:24.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 52281084 0 0) 0x7f1d0c004bd0 con 0x7f1d2c063220 2021-02-24T15:20:24.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d2c065440 con 0x7f1d2c063220 2021-02-24T15:20:24.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d180018f0 con 0x7f1d2c063220 2021-02-24T15:20:24.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403954002 0 0) 0x7f1d2c11d8a0 con 0x7f1d2c099340 2021-02-24T15:20:24.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d0c004bd0 con 0x7f1d2c099340 2021-02-24T15:20:24.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1670418992 0 0) 0x7f1d2c126820 con 0x7f1d2c062da0 2021-02-24T15:20:24.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 >> v1:172.21.15.152:6790/0 conn(0x7f1d2c063220 legacy=0x7f1d2c11d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:24.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 >> v1:172.21.15.181:6789/0 conn(0x7f1d2c099340 legacy=0x7f1d2c146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:24.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c0656e0 con 0x7f1d2c062da0 2021-02-24T15:20:24.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c065980 con 0x7f1d2c062da0 2021-02-24T15:20:24.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d32ac0700 10 client.27840.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:24.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c0976d0 con 0x7f1d2c062da0 2021-02-24T15:20:24.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.662+0000 7f1d32ac0700 1 librados: init done 2021-02-24T15:20:24.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.663+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1d200021f0 con 0x7f1d2c062da0 2021-02-24T15:20:24.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.663+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d20002500 con 0x7f1d2c062da0 2021-02-24T15:20:24.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.663+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f1d20002660 con 0x7f1d2c062da0 2021-02-24T15:20:24.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.663+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(164..164 src has 1..164) v4 ==== 4804+0+0 (unknown 2145111691 0 0) 0x7f1d2003acd0 con 0x7f1d2c062da0 2021-02-24T15:20:24.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.663+0000 7f1d28ff9700 10 client.27840.objecter ms_dispatch 0x7f1d2c001510 osd_map(164..164 src has 1..164) v4 2021-02-24T15:20:24.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.663+0000 7f1d28ff9700 3 client.27840.objecter handle_osd_map got epochs [164,164] > 0 2021-02-24T15:20:24.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.663+0000 7f1d28ff9700 3 client.27840.objecter handle_osd_map decoding full epoch 164 2021-02-24T15:20:24.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.663+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d04004d60 con 0x7f1d2c062da0 2021-02-24T15:20:24.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.663+0000 7f1d28ff9700 20 client.27840.objecter dump_active .. 0 homeless 2021-02-24T15:20:24.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.666+0000 7f1d28ff9700 10 client.27840.objecter ms_handle_connect 0x7f1d0c0316d0 2021-02-24T15:20:24.678 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.668+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f1d200125e0 con 0x7f1d2c062da0 2021-02-24T15:20:24.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.909+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1d04005590 con 0x7f1d2c062da0 2021-02-24T15:20:24.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.909+0000 7f1d28ff9700 1 -- 172.21.15.152:0/969951503 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 1798533733) 0x7f1d200121d0 con 0x7f1d2c062da0 2021-02-24T15:20:24.911 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:20:24.913 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 10 librados: watch_flush enter 2021-02-24T15:20:24.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 10 librados: watch_flush exit 2021-02-24T15:20:24.914 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 20 client.27840.objecter shutdown clearing up homeless session... 2021-02-24T15:20:24.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 10 client.27840.objecter successfully canceled tick 2021-02-24T15:20:24.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 >> v1:172.21.15.181:6812/33484 conn(0x7f1d0c0316d0 legacy=0x7f1d0c033b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:24.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 >> v1:172.21.15.152:6789/0 conn(0x7f1d2c062da0 legacy=0x7f1d2c11ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:24.916 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 shutdown_connections 2021-02-24T15:20:24.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 >> 172.21.15.152:0/969951503 conn(0x7f1d2c09dcc0 msgr2=0x7f1d2c09c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:24.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 shutdown_connections 2021-02-24T15:20:24.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 1 -- 172.21.15.152:0/969951503 wait complete. 2021-02-24T15:20:24.917 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:24.911+0000 7f1d32ac0700 1 librados: shutdown 2021-02-24T15:20:24.925 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:20:24.925 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-02-24T15:20:24.926 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:20:25.046 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.045+0000 7f79e0989700 1 Processor -- start 2021-02-24T15:20:25.047 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.045+0000 7f79e0989700 1 -- start start 2021-02-24T15:20:25.047 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.045+0000 7f79e0989700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc065f40 con 0x7f79dc125010 2021-02-24T15:20:25.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.045+0000 7f79e0989700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc066170 con 0x7f79dc125b30 2021-02-24T15:20:25.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.045+0000 7f79e0989700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc066410 con 0x7f79dc12efa0 2021-02-24T15:20:25.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.046+0000 7f79dbfff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f79dc12efa0 0x7f79dc131390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35828/0 (socket says 172.21.15.152:35828) 2021-02-24T15:20:25.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.046+0000 7f79dbfff700 1 -- 172.21.15.152:0/2365860990 learned_addr learned my addr 172.21.15.152:0/2365860990 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:25.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.046+0000 7f79db7fe700 1 --1- 172.21.15.152:0/2365860990 >> v1:172.21.15.152:6789/0 conn(0x7f79dc125010 0x7f79dc067b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47352/0 (socket says 172.21.15.152:47352) 2021-02-24T15:20:25.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79dbfff700 1 -- 172.21.15.152:0/2365860990 >> v1:172.21.15.152:6790/0 conn(0x7f79dc12efa0 legacy=0x7f79dc131390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79db7fe700 1 -- 172.21.15.152:0/2365860990 >> v1:172.21.15.152:6789/0 conn(0x7f79dc125010 legacy=0x7f79dc067b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716225134 0 0) 0x7f79dc065f40 con 0x7f79dc125010 2021-02-24T15:20:25.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79daffd700 1 -- 172.21.15.152:0/2365860990 >> v1:172.21.15.181:6789/0 conn(0x7f79dc125b30 legacy=0x7f79dc12d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79bc003230 con 0x7f79dc125010 2021-02-24T15:20:25.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713946032 0 0) 0x7f79dc066410 con 0x7f79dc12efa0 2021-02-24T15:20:25.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc065f40 con 0x7f79dc12efa0 2021-02-24T15:20:25.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2254093200 0 0) 0x7f79dc065f40 con 0x7f79dc12efa0 2021-02-24T15:20:25.068 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 >> v1:172.21.15.181:6789/0 conn(0x7f79dc125b30 legacy=0x7f79dc12d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.068 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 >> v1:172.21.15.152:6789/0 conn(0x7f79dc125010 legacy=0x7f79dc067b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.069 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0666b0 con 0x7f79dc12efa0 2021-02-24T15:20:25.069 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f79d4001cb0 con 0x7f79dc12efa0 2021-02-24T15:20:25.069 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f79d4001fc0 con 0x7f79dc12efa0 2021-02-24T15:20:25.070 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.048+0000 7f79da7fc700 1 -- 172.21.15.152:0/2365860990 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f79d4004ad0 con 0x7f79dc12efa0 2021-02-24T15:20:25.070 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.049+0000 7f79e0989700 1 -- 172.21.15.152:0/2365860990 >> v1:172.21.15.152:6790/0 conn(0x7f79dc12efa0 legacy=0x7f79dc131390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.049+0000 7f79e0989700 1 -- 172.21.15.152:0/2365860990 shutdown_connections 2021-02-24T15:20:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.049+0000 7f79e0989700 1 -- 172.21.15.152:0/2365860990 >> 172.21.15.152:0/2365860990 conn(0x7f79dc09b810 msgr2=0x7f79dc09bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.049+0000 7f79e0989700 1 -- 172.21.15.152:0/2365860990 shutdown_connections 2021-02-24T15:20:25.072 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.049+0000 7f79e0989700 1 -- 172.21.15.152:0/2365860990 wait complete. 2021-02-24T15:20:25.072 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.049+0000 7f79e0989700 1 librados: starting msgr at 2021-02-24T15:20:25.073 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.049+0000 7f79e0989700 1 librados: starting objecter 2021-02-24T15:20:25.073 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79e0989700 1 Processor -- start 2021-02-24T15:20:25.073 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79e0989700 1 -- start start 2021-02-24T15:20:25.074 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79e0989700 1 librados: setting wanted keys 2021-02-24T15:20:25.074 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79e0989700 1 librados: calling monclient init 2021-02-24T15:20:25.075 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79e0989700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc12b510 con 0x7f79dc12efa0 2021-02-24T15:20:25.075 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79e0989700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc12b7b0 con 0x7f79dc125010 2021-02-24T15:20:25.076 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79e0989700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc12ba50 con 0x7f79dc125b30 2021-02-24T15:20:25.076 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79daffd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f79dc125b30 0x7f79dc128560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35834/0 (socket says 172.21.15.152:35834) 2021-02-24T15:20:25.076 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79dbfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f79dc12efa0 0x7f79dc140460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47360/0 (socket says 172.21.15.152:47360) 2021-02-24T15:20:25.077 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.050+0000 7f79daffd700 1 -- 172.21.15.152:0/30384860 learned_addr learned my addr 172.21.15.152:0/30384860 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:25.077 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.052+0000 7f79dbfff700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79dc12efa0 legacy=0x7f79dc140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.052+0000 7f79daffd700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6790/0 conn(0x7f79dc125b30 legacy=0x7f79dc128560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.078 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.052+0000 7f79d37fe700 10 client.?.objecter ms_handle_connect 0x7f79dc12efa0 2021-02-24T15:20:25.079 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.052+0000 7f79d37fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:25.079 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.052+0000 7f79d37fe700 10 client.?.objecter ms_handle_connect 0x7f79dc125b30 2021-02-24T15:20:25.079 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.052+0000 7f79d37fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:25.080 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 10 client.?.objecter ms_handle_connect 0x7f79dc125010 2021-02-24T15:20:25.081 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79db7fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.181:6789/0 conn(0x7f79dc125010 legacy=0x7f79dc127e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.081 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:25.081 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243216450 0 0) 0x7f79dc12b510 con 0x7f79dc12efa0 2021-02-24T15:20:25.082 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c0004bd0 con 0x7f79dc12efa0 2021-02-24T15:20:25.082 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340574486 0 0) 0x7f79dc12ba50 con 0x7f79dc125b30 2021-02-24T15:20:25.083 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc12b510 con 0x7f79dc125b30 2021-02-24T15:20:25.083 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360713335 0 0) 0x7f79dc12b7b0 con 0x7f79dc125010 2021-02-24T15:20:25.083 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc12ba50 con 0x7f79dc125010 2021-02-24T15:20:25.084 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3611344453 0 0) 0x7f79c0004bd0 con 0x7f79dc12efa0 2021-02-24T15:20:25.084 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79dc12b7b0 con 0x7f79dc12efa0 2021-02-24T15:20:25.085 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f79d4001c70 con 0x7f79dc12efa0 2021-02-24T15:20:25.086 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3295836681 0 0) 0x7f79dc12b510 con 0x7f79dc125b30 2021-02-24T15:20:25.086 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79c0004bd0 con 0x7f79dc125b30 2021-02-24T15:20:25.087 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f79cc001c00 con 0x7f79dc125b30 2021-02-24T15:20:25.088 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 977548718 0 0) 0x7f79dc12b7b0 con 0x7f79dc12efa0 2021-02-24T15:20:25.088 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6790/0 conn(0x7f79dc125b30 legacy=0x7f79dc128560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.088 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.181:6789/0 conn(0x7f79dc125010 legacy=0x7f79dc127e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc12a630 con 0x7f79dc12efa0 2021-02-24T15:20:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc1298e0 con 0x7f79dc12efa0 2021-02-24T15:20:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79e0989700 10 client.27846.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc12e310 con 0x7f79dc12efa0 2021-02-24T15:20:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79e0989700 1 librados: init done 2021-02-24T15:20:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f79d4001660 con 0x7f79dc12efa0 2021-02-24T15:20:25.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.053+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f79d40018e0 con 0x7f79dc12efa0 2021-02-24T15:20:25.092 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.054+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f79b4006550 con 0x7f79b40027f0 2021-02-24T15:20:25.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.054+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f79d400dbc0 con 0x7f79dc12efa0 2021-02-24T15:20:25.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.054+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(164..164 src has 1..164) v4 ==== 4804+0+0 (unknown 2145111691 0 0) 0x7f79d403b220 con 0x7f79dc12efa0 2021-02-24T15:20:25.093 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.054+0000 7f79d37fe700 10 client.27846.objecter ms_dispatch 0x7f79dc001510 osd_map(164..164 src has 1..164) v4 2021-02-24T15:20:25.094 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.054+0000 7f79d37fe700 3 client.27846.objecter handle_osd_map got epochs [164,164] > 0 2021-02-24T15:20:25.094 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.054+0000 7f79d37fe700 3 client.27846.objecter handle_osd_map decoding full epoch 164 2021-02-24T15:20:25.095 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.054+0000 7f79d37fe700 20 client.27846.objecter dump_active .. 0 homeless 2021-02-24T15:20:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79d37fe700 10 client.27846.objecter ms_handle_connect 0x7f79b40027f0 2021-02-24T15:20:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79db7fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b40027f0 legacy=0x7f79b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79d37fe700 10 client.27846.objecter resend_mon_ops 2021-02-24T15:20:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79db7fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b40027f0 legacy=0x7f79b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-24T15:20:25.098 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79db7fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b40027f0 legacy=0x7f79b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:20:25.098 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79db7fe700 1 --1- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b40027f0 0x7f79b4004c90 :-1 s=OPENED pgs=8864 cs=1 l=1).handle_message read tag failed 2021-02-24T15:20:25.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79db7fe700 1 --1- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b40027f0 0x7f79b4004c90 :-1 s=OPENED pgs=8864 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:20:25.099 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b40027f0 legacy=0x7f79b4004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:25.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b40027f0 legacy=0x7f79b4004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:25.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.056+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f79dc12b7b0 con 0x7f79c003a010 2021-02-24T15:20:25.100 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.057+0000 7f79d37fe700 10 client.27846.objecter ms_handle_connect 0x7f79c0031750 2021-02-24T15:20:25.101 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 10 client.27846.objecter ms_handle_connect 0x7f79c003a010 2021-02-24T15:20:25.101 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 10 client.27846.objecter resend_mon_ops 2021-02-24T15:20:25.102 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79db7fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79c003a010 legacy=0x7f79c003c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.102 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037452096 0 0) 0x7f79dc12b7b0 con 0x7f79c003a010 2021-02-24T15:20:25.103 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc12b510 con 0x7f79c003a010 2021-02-24T15:20:25.103 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3145967342 0 0) 0x7f79dc12b510 con 0x7f79c003a010 2021-02-24T15:20:25.103 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79dc12b7b0 con 0x7f79c003a010 2021-02-24T15:20:25.104 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f79c4001d30 con 0x7f79c003a010 2021-02-24T15:20:25.104 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1833374836 0 0) 0x7f79dc12b7b0 con 0x7f79c003a010 2021-02-24T15:20:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79c003ed30 con 0x7f79c003a010 2021-02-24T15:20:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f79c40066c0 con 0x7f79c003a010 2021-02-24T15:20:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79c003a010 legacy=0x7f79c003c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.106 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.059+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79c003a010 legacy=0x7f79c003c470 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:25.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.068+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f79b4008890 con 0x7f79b4008c90 2021-02-24T15:20:25.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79d37fe700 10 client.27846.objecter ms_handle_connect 0x7f79b4008c90 2021-02-24T15:20:25.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79d37fe700 10 client.27846.objecter resend_mon_ops 2021-02-24T15:20:25.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79db7fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b4008c90 legacy=0x7f79b4009100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465669822 0 0) 0x7f79b4008890 con 0x7f79b4008c90 2021-02-24T15:20:25.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc12b7b0 con 0x7f79b4008c90 2021-02-24T15:20:25.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2476689051 0 0) 0x7f79dc12b7b0 con 0x7f79b4008c90 2021-02-24T15:20:25.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79b4008890 con 0x7f79b4008c90 2021-02-24T15:20:25.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f79c4004b30 con 0x7f79b4008c90 2021-02-24T15:20:25.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1942780591 0 0) 0x7f79b4008890 con 0x7f79b4008c90 2021-02-24T15:20:25.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.070+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f79b4009810 con 0x7f79b4008c90 2021-02-24T15:20:25.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3942 (unknown 0 0 3058858466) 0x7f79c4006970 con 0x7f79b4008c90 2021-02-24T15:20:25.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b4008c90 legacy=0x7f79b4009100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.112 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79d37fe700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79b4008c90 legacy=0x7f79b4009100 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:25.113 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79dbfff700 1 -- 172.21.15.152:0/30384860 reap_dead start 2021-02-24T15:20:25.113 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 10 librados: watch_flush enter 2021-02-24T15:20:25.113 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 10 librados: watch_flush exit 2021-02-24T15:20:25.113 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 20 client.27846.objecter shutdown clearing up homeless session... 2021-02-24T15:20:25.114 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 10 client.27846.objecter successfully canceled tick 2021-02-24T15:20:25.114 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.181:6812/33484 conn(0x7f79c0031750 legacy=0x7f79c0033c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.114 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 >> v1:172.21.15.152:6789/0 conn(0x7f79dc12efa0 legacy=0x7f79dc140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.114 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 shutdown_connections 2021-02-24T15:20:25.114 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 >> 172.21.15.152:0/30384860 conn(0x7f79dc09b810 msgr2=0x7f79dc121290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:25.115 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 shutdown_connections 2021-02-24T15:20:25.115 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 1 -- 172.21.15.152:0/30384860 wait complete. 2021-02-24T15:20:25.115 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.071+0000 7f79e0989700 1 librados: shutdown 2021-02-24T15:20:25.115 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:20:25.115 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:20:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 20, 2021-02-24T15:20:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:20:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:20:25.117 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:20:25.117 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:20:25.118 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:25.118 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 5, 2021-02-24T15:20:25.118 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:25.118 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:20:25.119 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:20:25.119 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:25.119 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:25.119 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:25.121 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:25.121 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:25.122 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:20:25.122 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:20:25.122 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:25.124 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:25.124 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:25.124 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:25.124 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.125 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:20:25.125 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:20:25.125 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:20:25.126 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:20:25.126 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:20:25.126 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:20:25.126 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:25.127 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:25.127 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:20:25.128 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:20:25.128 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:20:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:20:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:20:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:20:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:25.130 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:25.130 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:25.130 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:20:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:20:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.134 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:25.134 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:20:25.134 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:25.134 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.134 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:20:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:20:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:25.136 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:25.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.136 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:25.136 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:20:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:20:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:20:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:25.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.140 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:25.140 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:25.140 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:25.141 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:25.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.141 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:25.141 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:20:25.141 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:25.142 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.142 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.142 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:20:25.142 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:20:25.143 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:25.143 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:25.143 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:25.143 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.144 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.144 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:20:25.144 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:20:25.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.145 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:25.145 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:25.145 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:25.145 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.145 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:25.146 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:20:25.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.146 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:25.146 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:25.146 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:20:25.147 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.147 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:25.147 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:20:25.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.147 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:25.148 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:25.148 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6 2021-02-24T15:20:25.148 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.148 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.149 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:20:25.149 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:20:25.149 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:20:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.266+0000 7fb6867b7700 1 Processor -- start 2021-02-24T15:20:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.266+0000 7fb6867b7700 1 -- start start 2021-02-24T15:20:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.267+0000 7fb6867b7700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68012b0d0 con 0x7fb6800613c0 2021-02-24T15:20:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.267+0000 7fb6867b7700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb680098a60 con 0x7fb6800679c0 2021-02-24T15:20:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.267+0000 7fb6867b7700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68009a0b0 con 0x7fb680067e70 2021-02-24T15:20:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.267+0000 7fb67ffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb6800613c0 0x7fb68012a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47372/0 (socket says 172.21.15.152:47372) 2021-02-24T15:20:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.267+0000 7fb684d54700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fb680067e70 0x7fb680133410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35848/0 (socket says 172.21.15.152:35848) 2021-02-24T15:20:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.267+0000 7fb67ffff700 1 -- 172.21.15.152:0/3292923765 learned_addr learned my addr 172.21.15.152:0/3292923765 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:25.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.269+0000 7fb67ffff700 1 -- 172.21.15.152:0/3292923765 >> v1:172.21.15.152:6789/0 conn(0x7fb6800613c0 legacy=0x7fb68012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.269+0000 7fb684d54700 1 -- 172.21.15.152:0/3292923765 >> v1:172.21.15.152:6790/0 conn(0x7fb680067e70 legacy=0x7fb680133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.269+0000 7fb67f7fe700 1 -- 172.21.15.152:0/3292923765 >> v1:172.21.15.181:6789/0 conn(0x7fb6800679c0 legacy=0x7fb68012fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.269+0000 7fb67effd700 1 -- 172.21.15.152:0/3292923765 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961576310 0 0) 0x7fb68012b0d0 con 0x7fb6800613c0 2021-02-24T15:20:25.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.269+0000 7fb67effd700 1 -- 172.21.15.152:0/3292923765 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb66c003230 con 0x7fb6800613c0 2021-02-24T15:20:25.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb67effd700 1 -- 172.21.15.152:0/3292923765 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3073092116 0 0) 0x7fb66c003230 con 0x7fb6800613c0 2021-02-24T15:20:25.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb67effd700 1 -- 172.21.15.152:0/3292923765 >> v1:172.21.15.152:6790/0 conn(0x7fb680067e70 legacy=0x7fb680133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb67effd700 1 -- 172.21.15.152:0/3292923765 >> v1:172.21.15.181:6789/0 conn(0x7fb6800679c0 legacy=0x7fb68012fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb67effd700 1 -- 172.21.15.152:0/3292923765 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68009a350 con 0x7fb6800613c0 2021-02-24T15:20:25.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb67effd700 1 -- 172.21.15.152:0/3292923765 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb670001930 con 0x7fb6800613c0 2021-02-24T15:20:25.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb67effd700 1 -- 172.21.15.152:0/3292923765 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb670001c40 con 0x7fb6800613c0 2021-02-24T15:20:25.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb67effd700 1 -- 172.21.15.152:0/3292923765 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb670004750 con 0x7fb6800613c0 2021-02-24T15:20:25.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb6867b7700 1 -- 172.21.15.152:0/3292923765 >> v1:172.21.15.152:6789/0 conn(0x7fb6800613c0 legacy=0x7fb68012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb6867b7700 1 -- 172.21.15.152:0/3292923765 shutdown_connections 2021-02-24T15:20:25.274 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb6867b7700 1 -- 172.21.15.152:0/3292923765 >> 172.21.15.152:0/3292923765 conn(0x7fb68009a940 msgr2=0x7fb68009ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:25.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb6867b7700 1 -- 172.21.15.152:0/3292923765 shutdown_connections 2021-02-24T15:20:25.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.270+0000 7fb6867b7700 1 -- 172.21.15.152:0/3292923765 wait complete. 2021-02-24T15:20:25.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.271+0000 7fb6867b7700 1 librados: starting msgr at 2021-02-24T15:20:25.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.271+0000 7fb6867b7700 1 librados: starting objecter 2021-02-24T15:20:25.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.271+0000 7fb6867b7700 1 Processor -- start 2021-02-24T15:20:25.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.271+0000 7fb6867b7700 1 -- start start 2021-02-24T15:20:25.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.271+0000 7fb6867b7700 1 librados: setting wanted keys 2021-02-24T15:20:25.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.271+0000 7fb6867b7700 1 librados: calling monclient init 2021-02-24T15:20:25.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.272+0000 7fb6867b7700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb680099480 con 0x7fb6800679c0 2021-02-24T15:20:25.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.272+0000 7fb6867b7700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6801212b0 con 0x7fb680067e70 2021-02-24T15:20:25.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.272+0000 7fb6867b7700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb680121550 con 0x7fb6800613c0 2021-02-24T15:20:25.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.272+0000 7fb67ffff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fb6800613c0 0x7fb680123a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35854/0 (socket says 172.21.15.152:35854) 2021-02-24T15:20:25.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.272+0000 7fb67ffff700 1 -- 172.21.15.152:0/846292374 learned_addr learned my addr 172.21.15.152:0/846292374 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:25.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.272+0000 7fb67f7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb6800679c0 0x7fb680139390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47380/0 (socket says 172.21.15.152:47380) 2021-02-24T15:20:25.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb67ffff700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6790/0 conn(0x7fb6800613c0 legacy=0x7fb680123a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 10 client.?.objecter ms_handle_connect 0x7fb6800613c0 2021-02-24T15:20:25.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb67f7fe700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6789/0 conn(0x7fb6800679c0 legacy=0x7fb680139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:25.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 10 client.?.objecter ms_handle_connect 0x7fb6800679c0 2021-02-24T15:20:25.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:25.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078902560 0 0) 0x7fb680099480 con 0x7fb6800679c0 2021-02-24T15:20:25.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb660004bd0 con 0x7fb6800679c0 2021-02-24T15:20:25.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 10 client.?.objecter ms_handle_connect 0x7fb680067e70 2021-02-24T15:20:25.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:25.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb684d54700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.181:6789/0 conn(0x7fb680067e70 legacy=0x7fb6801425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1231012495 0 0) 0x7fb660004bd0 con 0x7fb6800679c0 2021-02-24T15:20:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb680099480 con 0x7fb6800679c0 2021-02-24T15:20:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb674001c20 con 0x7fb6800679c0 2021-02-24T15:20:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2191451941 0 0) 0x7fb680099480 con 0x7fb6800679c0 2021-02-24T15:20:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6790/0 conn(0x7fb6800613c0 legacy=0x7fb680123a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.181:6789/0 conn(0x7fb680067e70 legacy=0x7fb6801425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.274+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68011f470 con 0x7fb6800679c0 2021-02-24T15:20:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.275+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb680124180 con 0x7fb6800679c0 2021-02-24T15:20:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.275+0000 7fb6867b7700 10 client.27858.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.275+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb680066fc0 con 0x7fb6800679c0 2021-02-24T15:20:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.275+0000 7fb6867b7700 1 librados: init done 2021-02-24T15:20:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.275+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb674002300 con 0x7fb6800679c0 2021-02-24T15:20:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.275+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb674002610 con 0x7fb6800679c0 2021-02-24T15:20:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.275+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fb658006550 con 0x7fb6580027f0 2021-02-24T15:20:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.275+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fb674002860 con 0x7fb6800679c0 2021-02-24T15:20:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.276+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(165..165 src has 1..165) v4 ==== 5756+0+0 (unknown 2139890808 0 0) 0x7fb67403b200 con 0x7fb6800679c0 2021-02-24T15:20:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.276+0000 7fb667fff700 10 client.27858.objecter ms_dispatch 0x7fb680001510 osd_map(165..165 src has 1..165) v4 2021-02-24T15:20:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.276+0000 7fb667fff700 3 client.27858.objecter handle_osd_map got epochs [165,165] > 0 2021-02-24T15:20:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.276+0000 7fb667fff700 3 client.27858.objecter handle_osd_map decoding full epoch 165 2021-02-24T15:20:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.276+0000 7fb667fff700 20 client.27858.objecter dump_active .. 0 homeless 2021-02-24T15:20:25.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.278+0000 7fb667fff700 10 client.27858.objecter ms_handle_connect 0x7fb6580027f0 2021-02-24T15:20:25.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.278+0000 7fb667fff700 10 client.27858.objecter resend_mon_ops 2021-02-24T15:20:25.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.278+0000 7fb67ffff700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6790/0 conn(0x7fb6580027f0 legacy=0x7fb658004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.278+0000 7fb667fff700 10 client.27858.objecter ms_handle_connect 0x7fb6600313e0 2021-02-24T15:20:25.856 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.854+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406160213 0 0) 0x7fb658006550 con 0x7fb6580027f0 2021-02-24T15:20:25.856 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.854+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb680099480 con 0x7fb6580027f0 2021-02-24T15:20:25.856 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.855+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1763165547 0 0) 0x7fb680099480 con 0x7fb6580027f0 2021-02-24T15:20:25.857 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.855+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb658006550 con 0x7fb6580027f0 2021-02-24T15:20:25.857 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.855+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb6700012e0 con 0x7fb6580027f0 2021-02-24T15:20:25.857 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.855+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3562534660 0 0) 0x7fb658006550 con 0x7fb6580027f0 2021-02-24T15:20:25.857 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.855+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb658009df0 con 0x7fb6580027f0 2021-02-24T15:20:25.857 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.855+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fb670001690 con 0x7fb6580027f0 2021-02-24T15:20:25.858 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.855+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6790/0 conn(0x7fb6580027f0 legacy=0x7fb658004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.858 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.855+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6790/0 conn(0x7fb6580027f0 legacy=0x7fb658004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:25.864 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.863+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fb658009a80 con 0x7fb658008da0 2021-02-24T15:20:25.868 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb67ffff700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6790/0 conn(0x7fb658008da0 legacy=0x7fb658009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:25.869 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 10 client.27858.objecter ms_handle_connect 0x7fb658008da0 2021-02-24T15:20:25.869 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 10 client.27858.objecter resend_mon_ops 2021-02-24T15:20:25.869 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202133940 0 0) 0x7fb658009a80 con 0x7fb658008da0 2021-02-24T15:20:25.869 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb658006550 con 0x7fb658008da0 2021-02-24T15:20:25.869 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2232446089 0 0) 0x7fb658006550 con 0x7fb658008da0 2021-02-24T15:20:25.870 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb658009a80 con 0x7fb658008da0 2021-02-24T15:20:25.870 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb670004cf0 con 0x7fb658008da0 2021-02-24T15:20:25.870 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2725327144 0 0) 0x7fb658009a80 con 0x7fb658008da0 2021-02-24T15:20:25.870 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb6580086f0 con 0x7fb658008da0 2021-02-24T15:20:25.871 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 3443318831) 0x7fb670005290 con 0x7fb658008da0 2021-02-24T15:20:25.871 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6790/0 conn(0x7fb658008da0 legacy=0x7fb658009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.871 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.866+0000 7fb667fff700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6790/0 conn(0x7fb658008da0 legacy=0x7fb658009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:25.871 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 10 librados: watch_flush enter 2021-02-24T15:20:25.872 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 10 librados: watch_flush exit 2021-02-24T15:20:25.872 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 20 client.27858.objecter shutdown clearing up homeless session... 2021-02-24T15:20:25.872 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 10 client.27858.objecter successfully canceled tick 2021-02-24T15:20:25.872 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.181:6812/33484 conn(0x7fb6600313e0 legacy=0x7fb6600338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.872 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 >> v1:172.21.15.152:6789/0 conn(0x7fb6800679c0 legacy=0x7fb680139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:25.873 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb684d54700 1 -- 172.21.15.152:0/846292374 reap_dead start 2021-02-24T15:20:25.873 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb684d54700 1 -- 172.21.15.152:0/846292374 reap_dead start 2021-02-24T15:20:25.873 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 shutdown_connections 2021-02-24T15:20:25.873 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 >> 172.21.15.152:0/846292374 conn(0x7fb68009a940 msgr2=0x7fb680124590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:25.873 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 shutdown_connections 2021-02-24T15:20:25.874 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 1 -- 172.21.15.152:0/846292374 wait complete. 2021-02-24T15:20:25.874 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:25.867+0000 7fb6867b7700 1 librados: shutdown 2021-02-24T15:20:25.874 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:20:25.875 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:25.875 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:25.875 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:20:25.875 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 20, 2021-02-24T15:20:25.875 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:20:25.876 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:20:25.876 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:20:25.876 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:20:25.876 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:25.877 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 6, 2021-02-24T15:20:25.877 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:25.877 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:20:25.877 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:20:25.878 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:25.878 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:25.878 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:25.878 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:25.879 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:25.879 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:25.879 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:25.880 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:25.880 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:25.880 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:25.880 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:20:25.881 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:20:25.881 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:25.881 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:25.881 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:25.882 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:25.882 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:25.882 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:25.882 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:25.883 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:25.883 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:25.884 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.884 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:20:25.884 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:20:25.885 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:20:25.885 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:20:25.885 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:20:25.886 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:20:25.886 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:25.886 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:25.886 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:20:25.887 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:20:25.887 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:20:25.887 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:20:25.887 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:20:25.888 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:25.888 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:20:25.888 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:25.889 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:25.889 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:25.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:25.889 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:25.890 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:25.890 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:25.890 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:25.890 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:25.891 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:25.891 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:20:25.891 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.891 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:20:25.892 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.892 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:25.892 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:25.892 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:25.893 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:25.893 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.893 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:25.893 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:20:25.894 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:25.894 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.894 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.894 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.895 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:20:25.895 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:20:25.895 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:25.895 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:25.896 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:25.896 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.896 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.896 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:25.897 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:25.897 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:25.897 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:25.897 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.898 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:25.898 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:20:25.898 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:25.898 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.898 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.899 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:20:25.899 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:20:25.900 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:25.900 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:25.900 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:25.900 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.901 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.901 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:25.901 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:25.902 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:25.902 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:25.902 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.902 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:25.903 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:20:25.903 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:25.903 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.903 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.904 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:20:25.904 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:20:25.904 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:25.905 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:25.905 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:25.905 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.905 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.906 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:20:25.906 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:20:25.906 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.906 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:25.907 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:25.907 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:25.907 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.907 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:25.908 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:20:25.908 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:25.908 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:25.908 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:25.909 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:20:25.909 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:25.909 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:25.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:25.910 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:20:25.910 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:20:25.912 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:20:26.034 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.033+0000 7f8ffcdcf700 1 Processor -- start 2021-02-24T15:20:26.034 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.033+0000 7f8ffcdcf700 1 -- start start 2021-02-24T15:20:26.035 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.034+0000 7f8ffcdcf700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff8062660 con 0x7f8ff8095bb0 2021-02-24T15:20:26.035 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.034+0000 7f8ffcdcf700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff8063af0 con 0x7f8ff8068410 2021-02-24T15:20:26.035 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.034+0000 7f8ffcdcf700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff8063d90 con 0x7f8ff80966a0 2021-02-24T15:20:26.036 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.034+0000 7f8ff5d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8ff8095bb0 0x7f8ff8130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47390/0 (socket says 172.21.15.152:47390) 2021-02-24T15:20:26.036 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.034+0000 7f8ff659c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f8ff80966a0 0x7f8ff8096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35866/0 (socket says 172.21.15.152:35866) 2021-02-24T15:20:26.036 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.034+0000 7f8ff5d9b700 1 -- 172.21.15.152:0/1642421596 learned_addr learned my addr 172.21.15.152:0/1642421596 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:26.038 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.036+0000 7f8ff5d9b700 1 -- 172.21.15.152:0/1642421596 >> v1:172.21.15.152:6789/0 conn(0x7f8ff8095bb0 legacy=0x7f8ff8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.036+0000 7f8ff659c700 1 -- 172.21.15.152:0/1642421596 >> v1:172.21.15.152:6790/0 conn(0x7f8ff80966a0 legacy=0x7f8ff8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.036+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484402822 0 0) 0x7f8ff8063d90 con 0x7f8ff80966a0 2021-02-24T15:20:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.036+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fdc003230 con 0x7f8ff80966a0 2021-02-24T15:20:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.036+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061447076 0 0) 0x7f8ff8062660 con 0x7f8ff8095bb0 2021-02-24T15:20:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.036+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff8063d90 con 0x7f8ff8095bb0 2021-02-24T15:20:26.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.036+0000 7f8ff6d9d700 1 -- 172.21.15.152:0/1642421596 >> v1:172.21.15.181:6789/0 conn(0x7f8ff8068410 legacy=0x7f8ff8133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.036+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1809884844 0 0) 0x7f8fdc003230 con 0x7f8ff80966a0 2021-02-24T15:20:26.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.036+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 >> v1:172.21.15.181:6789/0 conn(0x7f8ff8068410 legacy=0x7f8ff8133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 >> v1:172.21.15.152:6789/0 conn(0x7f8ff8095bb0 legacy=0x7f8ff8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8064030 con 0x7f8ff80966a0 2021-02-24T15:20:26.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8fe80019f0 con 0x7f8ff80966a0 2021-02-24T15:20:26.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8fe8001c50 con 0x7f8ff80966a0 2021-02-24T15:20:26.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ff559a700 1 -- 172.21.15.152:0/1642421596 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8fe8004690 con 0x7f8ff80966a0 2021-02-24T15:20:26.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/1642421596 >> v1:172.21.15.152:6790/0 conn(0x7f8ff80966a0 legacy=0x7f8ff8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/1642421596 shutdown_connections 2021-02-24T15:20:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/1642421596 >> 172.21.15.152:0/1642421596 conn(0x7f8ff809ba40 msgr2=0x7f8ff809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/1642421596 shutdown_connections 2021-02-24T15:20:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.037+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/1642421596 wait complete. 2021-02-24T15:20:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ffcdcf700 1 librados: starting msgr at 2021-02-24T15:20:26.043 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ffcdcf700 1 librados: starting objecter 2021-02-24T15:20:26.043 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ffcdcf700 1 Processor -- start 2021-02-24T15:20:26.043 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ffcdcf700 1 -- start start 2021-02-24T15:20:26.043 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ffcdcf700 1 librados: setting wanted keys 2021-02-24T15:20:26.043 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ffcdcf700 1 librados: calling monclient init 2021-02-24T15:20:26.047 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ffcdcf700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff8063010 con 0x7f8ff80966a0 2021-02-24T15:20:26.047 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ffcdcf700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff811ad20 con 0x7f8ff8068410 2021-02-24T15:20:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ffcdcf700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff8067470 con 0x7f8ff8095bb0 2021-02-24T15:20:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.038+0000 7f8ff5d9b700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f8ff8095bb0 0x7f8ff8133e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:35872/0 (socket says 172.21.15.152:35872) 2021-02-24T15:20:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.039+0000 7f8ff5d9b700 1 -- 172.21.15.152:0/3585454752 learned_addr learned my addr 172.21.15.152:0/3585454752 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8ff5d9b700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.152:6790/0 conn(0x7f8ff8095bb0 legacy=0x7f8ff8133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 10 client.?.objecter ms_handle_connect 0x7f8ff8095bb0 2021-02-24T15:20:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 10 client.?.objecter ms_handle_connect 0x7f8ff80966a0 2021-02-24T15:20:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8ff6d9d700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.152:6789/0 conn(0x7f8ff80966a0 legacy=0x7f8ff8142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576863942 0 0) 0x7f8ff8067470 con 0x7f8ff8095bb0 2021-02-24T15:20:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd4004bd0 con 0x7f8ff8095bb0 2021-02-24T15:20:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275356690 0 0) 0x7f8ff8063010 con 0x7f8ff80966a0 2021-02-24T15:20:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff8067470 con 0x7f8ff80966a0 2021-02-24T15:20:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 10 client.?.objecter ms_handle_connect 0x7f8ff8068410 2021-02-24T15:20:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8ff659c700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.181:6789/0 conn(0x7f8ff8068410 legacy=0x7f8ff813a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3335716019 0 0) 0x7f8fd4004bd0 con 0x7f8ff8095bb0 2021-02-24T15:20:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ff8063010 con 0x7f8ff8095bb0 2021-02-24T15:20:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8fec001bf0 con 0x7f8ff8095bb0 2021-02-24T15:20:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006456777 0 0) 0x7f8ff811ad20 con 0x7f8ff8068410 2021-02-24T15:20:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd4004bd0 con 0x7f8ff8068410 2021-02-24T15:20:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 255542086 0 0) 0x7f8ff8067470 con 0x7f8ff80966a0 2021-02-24T15:20:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ff811ad20 con 0x7f8ff80966a0 2021-02-24T15:20:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8ff0001f20 con 0x7f8ff80966a0 2021-02-24T15:20:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4023087813 0 0) 0x7f8ff8063010 con 0x7f8ff8095bb0 2021-02-24T15:20:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.181:6789/0 conn(0x7f8ff8068410 legacy=0x7f8ff813a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.152:6789/0 conn(0x7f8ff80966a0 legacy=0x7f8ff8142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8134520 con 0x7f8ff8095bb0 2021-02-24T15:20:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff811a320 con 0x7f8ff8095bb0 2021-02-24T15:20:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8ffcdcf700 10 client.64163.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff8118ce0 con 0x7f8ff8095bb0 2021-02-24T15:20:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8ffcdcf700 1 librados: init done 2021-02-24T15:20:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8fec0048a0 con 0x7f8ff8095bb0 2021-02-24T15:20:26.055 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.041+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8fec004bb0 con 0x7f8ff8095bb0 2021-02-24T15:20:26.055 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.042+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f8fec005dc0 con 0x7f8ff8095bb0 2021-02-24T15:20:26.055 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.042+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8fd8006550 con 0x7f8fd80027f0 2021-02-24T15:20:26.055 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.042+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(165..165 src has 1..165) v4 ==== 5756+0+0 (unknown 2139890808 0 0) 0x7f8fec03b1f0 con 0x7f8ff8095bb0 2021-02-24T15:20:26.055 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.042+0000 7f8fe67fc700 10 client.64163.objecter ms_dispatch 0x7f8ff8001510 osd_map(165..165 src has 1..165) v4 2021-02-24T15:20:26.056 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.042+0000 7f8fe67fc700 3 client.64163.objecter handle_osd_map got epochs [165,165] > 0 2021-02-24T15:20:26.056 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.042+0000 7f8fe67fc700 3 client.64163.objecter handle_osd_map decoding full epoch 165 2021-02-24T15:20:26.056 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.042+0000 7f8fe67fc700 20 client.64163.objecter dump_active .. 0 homeless 2021-02-24T15:20:26.056 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.044+0000 7f8ff659c700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.181:6789/0 conn(0x7f8fd80027f0 legacy=0x7f8fd8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.057 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.044+0000 7f8fe67fc700 10 client.64163.objecter ms_handle_connect 0x7f8fd80027f0 2021-02-24T15:20:26.057 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.044+0000 7f8fe67fc700 10 client.64163.objecter resend_mon_ops 2021-02-24T15:20:26.057 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119486488 0 0) 0x7f8fd8006550 con 0x7f8fd80027f0 2021-02-24T15:20:26.057 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff8063010 con 0x7f8fd80027f0 2021-02-24T15:20:26.057 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 10 client.64163.objecter ms_handle_connect 0x7f8fd4031680 2021-02-24T15:20:26.058 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2880520569 0 0) 0x7f8ff8063010 con 0x7f8fd80027f0 2021-02-24T15:20:26.058 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8fd8006550 con 0x7f8fd80027f0 2021-02-24T15:20:26.058 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8fe8001700 con 0x7f8fd80027f0 2021-02-24T15:20:26.058 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2031881434 0 0) 0x7f8fd8006550 con 0x7f8fd80027f0 2021-02-24T15:20:26.058 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fd8009df0 con 0x7f8fd80027f0 2021-02-24T15:20:26.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f8fe80019b0 con 0x7f8fd80027f0 2021-02-24T15:20:26.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.181:6789/0 conn(0x7f8fd80027f0 legacy=0x7f8fd8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.045+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.181:6789/0 conn(0x7f8fd80027f0 legacy=0x7f8fd8004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:26.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.053+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8fd8009a80 con 0x7f8fd8008da0 2021-02-24T15:20:26.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8ff659c700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.181:6789/0 conn(0x7f8fd8008da0 legacy=0x7f8fd8009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8fe67fc700 10 client.64163.objecter ms_handle_connect 0x7f8fd8008da0 2021-02-24T15:20:26.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8fe67fc700 10 client.64163.objecter resend_mon_ops 2021-02-24T15:20:26.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727261958 0 0) 0x7f8fd8009a80 con 0x7f8fd8008da0 2021-02-24T15:20:26.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd8006550 con 0x7f8fd8008da0 2021-02-24T15:20:26.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3792380491 0 0) 0x7f8fd8006550 con 0x7f8fd8008da0 2021-02-24T15:20:26.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8fd8009a80 con 0x7f8fd8008da0 2021-02-24T15:20:26.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8fe8004f60 con 0x7f8fd8008da0 2021-02-24T15:20:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3214015207 0 0) 0x7f8fd8009a80 con 0x7f8fd8008da0 2021-02-24T15:20:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.056+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8fd80086f0 con 0x7f8fd8008da0 2021-02-24T15:20:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4110 (unknown 0 0 4151322854) 0x7f8fe8007200 con 0x7f8fd8008da0 2021-02-24T15:20:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.181:6789/0 conn(0x7f8fd8008da0 legacy=0x7f8fd8009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8fe67fc700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.181:6789/0 conn(0x7f8fd8008da0 legacy=0x7f8fd8009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 10 librados: watch_flush enter 2021-02-24T15:20:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 10 librados: watch_flush exit 2021-02-24T15:20:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 20 client.64163.objecter shutdown clearing up homeless session... 2021-02-24T15:20:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 10 client.64163.objecter successfully canceled tick 2021-02-24T15:20:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.181:6812/33484 conn(0x7f8fd4031680 legacy=0x7f8fd4033b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 >> v1:172.21.15.152:6790/0 conn(0x7f8ff8095bb0 legacy=0x7f8ff8133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ff6d9d700 1 -- 172.21.15.152:0/3585454752 reap_dead start 2021-02-24T15:20:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ff6d9d700 1 -- 172.21.15.152:0/3585454752 reap_dead start 2021-02-24T15:20:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 shutdown_connections 2021-02-24T15:20:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 >> 172.21.15.152:0/3585454752 conn(0x7f8ff809ba40 msgr2=0x7f8ff81120a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 shutdown_connections 2021-02-24T15:20:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 1 -- 172.21.15.152:0/3585454752 wait complete. 2021-02-24T15:20:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.057+0000 7f8ffcdcf700 1 librados: shutdown 2021-02-24T15:20:26.068 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:20:26.068 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:26.068 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:26.068 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:20:26.068 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 20, 2021-02-24T15:20:26.069 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:20:26.069 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:20:26.069 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:20:26.069 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:20:26.070 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:26.070 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 6, 2021-02-24T15:20:26.070 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:26.070 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:20:26.070 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:20:26.071 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:26.071 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:26.071 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:26.071 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:26.071 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:26.072 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:26.072 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:26.072 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:26.072 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:26.072 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:26.073 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:20:26.073 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:20:26.073 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:26.073 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:26.074 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:26.074 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:26.074 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:26.074 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:26.075 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:26.075 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:26.075 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:26.075 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:26.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:26.076 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:20:26.076 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:20:26.076 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:20:26.076 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:20:26.076 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:20:26.077 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:20:26.077 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:26.077 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:26.077 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:20:26.077 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:20:26.078 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:20:26.078 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:20:26.078 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:20:26.078 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:26.079 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:20:26.079 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:26.079 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:26.079 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:26.079 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:26.080 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:26.080 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:26.080 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:26.080 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:26.080 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:26.081 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:26.081 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:20:26.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:26.081 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:20:26.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.082 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:26.082 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:26.082 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:26.082 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:26.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.083 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:26.083 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:20:26.083 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:26.083 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:26.084 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:26.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:26.084 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:20:26.084 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:20:26.084 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:26.085 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:26.085 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:26.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:26.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.086 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:26.086 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:26.086 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:26.086 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:26.086 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.087 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:26.087 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:20:26.087 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:26.087 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:26.087 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:26.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:26.088 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:20:26.088 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:20:26.088 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:26.088 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:26.089 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:26.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:26.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.089 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:26.090 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:26.090 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:26.090 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:26.090 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.090 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:26.091 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:20:26.091 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:26.091 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:26.091 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:26.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:26.092 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:20:26.092 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:20:26.092 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:26.092 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:26.093 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:26.093 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:26.093 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:26.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:26.093 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:20:26.094 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:20:26.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.094 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:26.094 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:26.094 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:26.095 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:26.095 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:26.095 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:20:26.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.095 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:26.096 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:26.096 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:20:26.096 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:26.096 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:26.097 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:20:26.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.097 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:26.097 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:26.097 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:26.098 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:26.098 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:26.098 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:20:26.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:26.099 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:26.099 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:26.099 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:26.099 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:26.099 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:26.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:26.100 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:20:26.100 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:20:26.101 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2021-02-24T15:20:26.102 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2021-02-24T15:20:26.102 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2021-02-24T15:20:26.102 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2021-02-24T15:20:26.103 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-02-24T15:20:26.103 INFO:teuthology.orchestra.run:waiting for 300 2021-02-24T15:20:26.112 INFO:tasks.ceph.mon.c:Stopped 2021-02-24T15:20:26.113 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2021-02-24T15:20:26.113 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:20:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.270+0000 7fd237878700 1 Processor -- start 2021-02-24T15:20:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.271+0000 7fd237878700 1 -- start start 2021-02-24T15:20:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.271+0000 7fd237878700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23012b0d0 con 0x7fd2300679c0 2021-02-24T15:20:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.271+0000 7fd237878700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd230098a60 con 0x7fd230067e70 2021-02-24T15:20:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.271+0000 7fd237878700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23009a0b0 con 0x7fd2300613c0 2021-02-24T15:20:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.271+0000 7fd235614700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fd2300613c0 legacy=0x7fd23012a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.271+0000 7fd234e13700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd2300679c0 0x7fd23012fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47412/0 (socket says 172.21.15.152:47412) 2021-02-24T15:20:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.271+0000 7fd234e13700 1 -- 172.21.15.152:0/1101797377 learned_addr learned my addr 172.21.15.152:0/1101797377 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.273+0000 7fd234e13700 1 -- 172.21.15.152:0/1101797377 >> v1:172.21.15.152:6789/0 conn(0x7fd2300679c0 legacy=0x7fd23012fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd223fff700 1 -- 172.21.15.152:0/1101797377 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084649727 0 0) 0x7fd23012b0d0 con 0x7fd2300679c0 2021-02-24T15:20:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd235e15700 1 -- 172.21.15.152:0/1101797377 >> v1:172.21.15.181:6789/0 conn(0x7fd230067e70 legacy=0x7fd230133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd223fff700 1 -- 172.21.15.152:0/1101797377 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd218003230 con 0x7fd2300679c0 2021-02-24T15:20:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd223fff700 1 -- 172.21.15.152:0/1101797377 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 866003230 0 0) 0x7fd218003230 con 0x7fd2300679c0 2021-02-24T15:20:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd223fff700 1 -- 172.21.15.152:0/1101797377 >> v1:172.21.15.152:6790/0 conn(0x7fd2300613c0 legacy=0x7fd23012a9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:20:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd223fff700 1 -- 172.21.15.152:0/1101797377 >> v1:172.21.15.181:6789/0 conn(0x7fd230067e70 legacy=0x7fd230133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd223fff700 1 -- 172.21.15.152:0/1101797377 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23009a350 con 0x7fd2300679c0 2021-02-24T15:20:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd223fff700 1 -- 172.21.15.152:0/1101797377 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd224001930 con 0x7fd2300679c0 2021-02-24T15:20:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd223fff700 1 -- 172.21.15.152:0/1101797377 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd224001c40 con 0x7fd2300679c0 2021-02-24T15:20:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd223fff700 1 -- 172.21.15.152:0/1101797377 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd224004750 con 0x7fd2300679c0 2021-02-24T15:20:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd237878700 1 -- 172.21.15.152:0/1101797377 >> v1:172.21.15.152:6789/0 conn(0x7fd2300679c0 legacy=0x7fd23012fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd237878700 1 -- 172.21.15.152:0/1101797377 shutdown_connections 2021-02-24T15:20:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.274+0000 7fd237878700 1 -- 172.21.15.152:0/1101797377 >> 172.21.15.152:0/1101797377 conn(0x7fd23009a940 msgr2=0x7fd23009ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.275+0000 7fd237878700 1 -- 172.21.15.152:0/1101797377 shutdown_connections 2021-02-24T15:20:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.275+0000 7fd237878700 1 -- 172.21.15.152:0/1101797377 wait complete. 2021-02-24T15:20:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.275+0000 7fd237878700 1 librados: starting msgr at 2021-02-24T15:20:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.275+0000 7fd237878700 1 librados: starting objecter 2021-02-24T15:20:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.275+0000 7fd237878700 1 Processor -- start 2021-02-24T15:20:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.275+0000 7fd237878700 1 -- start start 2021-02-24T15:20:26.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.275+0000 7fd237878700 1 librados: setting wanted keys 2021-02-24T15:20:26.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.275+0000 7fd237878700 1 librados: calling monclient init 2021-02-24T15:20:26.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.276+0000 7fd237878700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23012f0a0 con 0x7fd2300679c0 2021-02-24T15:20:26.283 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.276+0000 7fd237878700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23012f340 con 0x7fd2300613c0 2021-02-24T15:20:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.276+0000 7fd237878700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23012f5e0 con 0x7fd230067e70 2021-02-24T15:20:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.276+0000 7fd235e15700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fd230067e70 legacy=0x7fd230142190 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.276+0000 7fd234e13700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd2300679c0 0x7fd2301249a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47420/0 (socket says 172.21.15.152:47420) 2021-02-24T15:20:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.276+0000 7fd234e13700 1 -- 172.21.15.152:0/994828216 learned_addr learned my addr 172.21.15.152:0/994828216 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd234e13700 1 -- 172.21.15.152:0/994828216 >> v1:172.21.15.152:6789/0 conn(0x7fd2300679c0 legacy=0x7fd2301249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd2217fa700 10 client.?.objecter ms_handle_connect 0x7fd2300679c0 2021-02-24T15:20:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd2217fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538875359 0 0) 0x7fd23012f0a0 con 0x7fd2300679c0 2021-02-24T15:20:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd210004bd0 con 0x7fd2300679c0 2021-02-24T15:20:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd2217fa700 10 client.?.objecter ms_handle_connect 0x7fd2300613c0 2021-02-24T15:20:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd2217fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd235614700 1 -- 172.21.15.152:0/994828216 >> v1:172.21.15.181:6789/0 conn(0x7fd2300613c0 legacy=0x7fd230124290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198475305 0 0) 0x7fd23012f340 con 0x7fd2300613c0 2021-02-24T15:20:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.278+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23012f0a0 con 0x7fd2300613c0 2021-02-24T15:20:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2361041193 0 0) 0x7fd210004bd0 con 0x7fd2300679c0 2021-02-24T15:20:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd23012f340 con 0x7fd2300679c0 2021-02-24T15:20:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd2240018f0 con 0x7fd2300679c0 2021-02-24T15:20:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 38036257 0 0) 0x7fd23012f340 con 0x7fd2300679c0 2021-02-24T15:20:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 >> v1:172.21.15.152:6790/0 conn(0x7fd230067e70 legacy=0x7fd230142190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:20:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 >> v1:172.21.15.181:6789/0 conn(0x7fd2300613c0 legacy=0x7fd230124290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23012d470 con 0x7fd2300679c0 2021-02-24T15:20:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 868055498 0 0) 0x7fd23012f0a0 con 0x7fd2300613c0 2021-02-24T15:20:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd22c004180 con 0x7fd2300613c0 2021-02-24T15:20:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23012c9d0 con 0x7fd2300679c0 2021-02-24T15:20:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd237878700 10 client.27870.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23012fde0 con 0x7fd2300679c0 2021-02-24T15:20:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd237878700 1 librados: init done 2021-02-24T15:20:26.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd224001560 con 0x7fd2300679c0 2021-02-24T15:20:26.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd224004ea0 con 0x7fd2300679c0 2021-02-24T15:20:26.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.279+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fd22400d9a0 con 0x7fd2300679c0 2021-02-24T15:20:26.290 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.280+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(166..166 src has 1..166) v4 ==== 5987+0+0 (unknown 3044547422 0 0) 0x7fd22403b4b0 con 0x7fd2300679c0 2021-02-24T15:20:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.280+0000 7fd2217fa700 10 client.27870.objecter ms_dispatch 0x7fd230001510 osd_map(166..166 src has 1..166) v4 2021-02-24T15:20:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.280+0000 7fd2217fa700 3 client.27870.objecter handle_osd_map got epochs [166,166] > 0 2021-02-24T15:20:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.280+0000 7fd2217fa700 3 client.27870.objecter handle_osd_map decoding full epoch 166 2021-02-24T15:20:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.280+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208004d60 con 0x7fd2300679c0 2021-02-24T15:20:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.280+0000 7fd2217fa700 20 client.27870.objecter dump_active .. 0 homeless 2021-02-24T15:20:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.283+0000 7fd2217fa700 10 client.27870.objecter ms_handle_connect 0x7fd2100310f0 2021-02-24T15:20:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.284+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fd2240129d0 con 0x7fd2300679c0 2021-02-24T15:20:26.523 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.522+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd208005010 con 0x7fd2300679c0 2021-02-24T15:20:26.523 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.523+0000 7fd2217fa700 1 -- 172.21.15.152:0/994828216 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 2246709877) 0x7fd2240125c0 con 0x7fd2300679c0 2021-02-24T15:20:26.524 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:20:26.525 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.524+0000 7fd237878700 10 librados: watch_flush enter 2021-02-24T15:20:26.525 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.524+0000 7fd237878700 10 librados: watch_flush exit 2021-02-24T15:20:26.526 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.524+0000 7fd237878700 20 client.27870.objecter shutdown clearing up homeless session... 2021-02-24T15:20:26.526 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.524+0000 7fd237878700 10 client.27870.objecter successfully canceled tick 2021-02-24T15:20:26.526 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.524+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 >> v1:172.21.15.181:6812/33484 conn(0x7fd2100310f0 legacy=0x7fd2100335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.524+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 >> v1:172.21.15.152:6789/0 conn(0x7fd2300679c0 legacy=0x7fd2301249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.524+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 shutdown_connections 2021-02-24T15:20:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.524+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 >> 172.21.15.152:0/994828216 conn(0x7fd23009a940 msgr2=0x7fd230127000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.524+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 shutdown_connections 2021-02-24T15:20:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.525+0000 7fd237878700 1 -- 172.21.15.152:0/994828216 wait complete. 2021-02-24T15:20:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:26.525+0000 7fd237878700 1 librados: shutdown 2021-02-24T15:20:29.538 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:20:29.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.665+0000 7fd4869ae700 1 Processor -- start 2021-02-24T15:20:29.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.665+0000 7fd4869ae700 1 -- start start 2021-02-24T15:20:29.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.665+0000 7fd4869ae700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48012b0d0 con 0x7fd4800613c0 2021-02-24T15:20:29.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.665+0000 7fd4869ae700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd480098a60 con 0x7fd480067e70 2021-02-24T15:20:29.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.665+0000 7fd4869ae700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48009a0b0 con 0x7fd4800679c0 2021-02-24T15:20:29.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.665+0000 7fd47f7fe700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fd4800679c0 legacy=0x7fd48012fce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:29.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.665+0000 7fd47ffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd4800613c0 0x7fd48012a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47438/0 (socket says 172.21.15.152:47438) 2021-02-24T15:20:29.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.665+0000 7fd47ffff700 1 -- 172.21.15.152:0/41091136 learned_addr learned my addr 172.21.15.152:0/41091136 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:29.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47ffff700 1 -- 172.21.15.152:0/41091136 >> v1:172.21.15.152:6789/0 conn(0x7fd4800613c0 legacy=0x7fd48012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:29.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd484f4b700 1 -- 172.21.15.152:0/41091136 >> v1:172.21.15.181:6789/0 conn(0x7fd480067e70 legacy=0x7fd480133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:29.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47effd700 1 -- 172.21.15.152:0/41091136 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429853749 0 0) 0x7fd48012b0d0 con 0x7fd4800613c0 2021-02-24T15:20:29.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47effd700 1 -- 172.21.15.152:0/41091136 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd46c003230 con 0x7fd4800613c0 2021-02-24T15:20:29.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47effd700 1 -- 172.21.15.152:0/41091136 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2809995257 0 0) 0x7fd46c003230 con 0x7fd4800613c0 2021-02-24T15:20:29.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47effd700 1 -- 172.21.15.152:0/41091136 >> v1:172.21.15.152:6790/0 conn(0x7fd4800679c0 legacy=0x7fd48012fce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:20:29.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47effd700 1 -- 172.21.15.152:0/41091136 >> v1:172.21.15.181:6789/0 conn(0x7fd480067e70 legacy=0x7fd480133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:29.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47effd700 1 -- 172.21.15.152:0/41091136 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48009a350 con 0x7fd4800613c0 2021-02-24T15:20:29.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47effd700 1 -- 172.21.15.152:0/41091136 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd470001930 con 0x7fd4800613c0 2021-02-24T15:20:29.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47effd700 1 -- 172.21.15.152:0/41091136 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd470001c40 con 0x7fd4800613c0 2021-02-24T15:20:29.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.668+0000 7fd47effd700 1 -- 172.21.15.152:0/41091136 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd470004750 con 0x7fd4800613c0 2021-02-24T15:20:29.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.669+0000 7fd4869ae700 1 -- 172.21.15.152:0/41091136 >> v1:172.21.15.152:6789/0 conn(0x7fd4800613c0 legacy=0x7fd48012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.669+0000 7fd4869ae700 1 -- 172.21.15.152:0/41091136 shutdown_connections 2021-02-24T15:20:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.669+0000 7fd4869ae700 1 -- 172.21.15.152:0/41091136 >> 172.21.15.152:0/41091136 conn(0x7fd48009a940 msgr2=0x7fd48009ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:29.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.669+0000 7fd4869ae700 1 -- 172.21.15.152:0/41091136 shutdown_connections 2021-02-24T15:20:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.669+0000 7fd4869ae700 1 -- 172.21.15.152:0/41091136 wait complete. 2021-02-24T15:20:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.669+0000 7fd4869ae700 1 librados: starting msgr at 2021-02-24T15:20:29.675 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd4869ae700 1 librados: starting objecter 2021-02-24T15:20:29.680 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd4869ae700 1 Processor -- start 2021-02-24T15:20:29.680 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd4869ae700 1 -- start start 2021-02-24T15:20:29.680 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd4869ae700 1 librados: setting wanted keys 2021-02-24T15:20:29.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd4869ae700 1 librados: calling monclient init 2021-02-24T15:20:29.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd4869ae700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48011fe30 con 0x7fd4800613c0 2021-02-24T15:20:29.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd4869ae700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48011f850 con 0x7fd480067e70 2021-02-24T15:20:29.681 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd4869ae700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd480122400 con 0x7fd4800679c0 2021-02-24T15:20:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd47f7fe700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fd4800679c0 legacy=0x7fd48011f140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd47ffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd4800613c0 0x7fd48011ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47440/0 (socket says 172.21.15.152:47440) 2021-02-24T15:20:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.670+0000 7fd47ffff700 1 -- 172.21.15.152:0/3318784120 learned_addr learned my addr 172.21.15.152:0/3318784120 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:29.682 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd47ffff700 1 -- 172.21.15.152:0/3318784120 >> v1:172.21.15.152:6789/0 conn(0x7fd4800613c0 legacy=0x7fd48011ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 10 client.?.objecter ms_handle_connect 0x7fd4800613c0 2021-02-24T15:20:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461938039 0 0) 0x7fd48011fe30 con 0x7fd4800613c0 2021-02-24T15:20:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd460004bd0 con 0x7fd4800613c0 2021-02-24T15:20:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 10 client.?.objecter ms_handle_connect 0x7fd480067e70 2021-02-24T15:20:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd484f4b700 1 -- 172.21.15.152:0/3318784120 >> v1:172.21.15.181:6789/0 conn(0x7fd480067e70 legacy=0x7fd480142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:29.684 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1520016539 0 0) 0x7fd460004bd0 con 0x7fd4800613c0 2021-02-24T15:20:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd48011fe30 con 0x7fd4800613c0 2021-02-24T15:20:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd4700018f0 con 0x7fd4800613c0 2021-02-24T15:20:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2420491046 0 0) 0x7fd48011fe30 con 0x7fd4800613c0 2021-02-24T15:20:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 >> v1:172.21.15.152:6790/0 conn(0x7fd4800679c0 legacy=0x7fd48011f140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:20:29.685 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 >> v1:172.21.15.181:6789/0 conn(0x7fd480067e70 legacy=0x7fd480142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4801226a0 con 0x7fd4800613c0 2021-02-24T15:20:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd480121c50 con 0x7fd4800613c0 2021-02-24T15:20:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd4869ae700 10 client.27876.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd480124e90 con 0x7fd4800613c0 2021-02-24T15:20:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd4869ae700 1 librados: init done 2021-02-24T15:20:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd470004dc0 con 0x7fd4800613c0 2021-02-24T15:20:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.673+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd470004f30 con 0x7fd4800613c0 2021-02-24T15:20:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.674+0000 7fd47ffff700 1 --1- 172.21.15.152:0/3318784120 >> v1:172.21.15.152:6789/0 conn(0x7fd4800613c0 0x7fd48011ea30 :-1 s=OPENED pgs=8882 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7fd47003b5a0 osd_map(166..166 src has 1..166) v4 2021-02-24T15:20:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.674+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fd470005090 con 0x7fd4800613c0 2021-02-24T15:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.674+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd458004d60 con 0x7fd4800613c0 2021-02-24T15:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.677+0000 7fd467fff700 10 client.27876.objecter ms_handle_connect 0x7fd460031260 2021-02-24T15:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.678+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(166..166 src has 1..166) v4 ==== 5987+0+0 (unknown 3044547422 0 0) 0x7fd47003b5a0 con 0x7fd4800613c0 2021-02-24T15:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.678+0000 7fd467fff700 10 client.27876.objecter ms_dispatch 0x7fd480001510 osd_map(166..166 src has 1..166) v4 2021-02-24T15:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.678+0000 7fd467fff700 3 client.27876.objecter handle_osd_map got epochs [166,166] > 0 2021-02-24T15:20:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.678+0000 7fd467fff700 3 client.27876.objecter handle_osd_map decoding full epoch 166 2021-02-24T15:20:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:29.679+0000 7fd467fff700 20 client.27876.objecter dump_active .. 0 homeless 2021-02-24T15:20:30.503 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.502+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fd470012830 con 0x7fd4800613c0 2021-02-24T15:20:30.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.740+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd458005590 con 0x7fd4800613c0 2021-02-24T15:20:30.742 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.741+0000 7fd467fff700 1 -- 172.21.15.152:0/3318784120 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1343 (unknown 254746657 0 3258976962) 0x7fd470012650 con 0x7fd4800613c0 2021-02-24T15:20:30.742 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:20:30.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 10 librados: watch_flush enter 2021-02-24T15:20:30.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 10 librados: watch_flush exit 2021-02-24T15:20:30.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 20 client.27876.objecter shutdown clearing up homeless session... 2021-02-24T15:20:30.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 10 client.27876.objecter successfully canceled tick 2021-02-24T15:20:30.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 >> v1:172.21.15.181:6812/33484 conn(0x7fd460031260 legacy=0x7fd460033720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:30.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 >> v1:172.21.15.152:6789/0 conn(0x7fd4800613c0 legacy=0x7fd48011ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:30.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 shutdown_connections 2021-02-24T15:20:30.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 >> 172.21.15.152:0/3318784120 conn(0x7fd48009a940 msgr2=0x7fd480127070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:30.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 shutdown_connections 2021-02-24T15:20:30.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 1 -- 172.21.15.152:0/3318784120 wait complete. 2021-02-24T15:20:30.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:30.742+0000 7fd4869ae700 1 librados: shutdown 2021-02-24T15:20:33.755 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:20:33.883 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.883+0000 7f87c6756700 1 Processor -- start 2021-02-24T15:20:33.884 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.883+0000 7f87c6756700 1 -- start start 2021-02-24T15:20:33.884 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.883+0000 7f87c6756700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0092e60 con 0x7f87c0094e40 2021-02-24T15:20:33.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.883+0000 7f87c6756700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0091f30 con 0x7f87c0095930 2021-02-24T15:20:33.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.883+0000 7f87c6756700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00921d0 con 0x7f87c0091110 2021-02-24T15:20:33.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.883+0000 7f87bf7fe700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87c0095220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:33.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.883+0000 7f87bffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f87c0094e40 0x7f87c0092750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47456/0 (socket says 172.21.15.152:47456) 2021-02-24T15:20:33.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.883+0000 7f87bffff700 1 -- 172.21.15.152:0/1353336235 learned_addr learned my addr 172.21.15.152:0/1353336235 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:33.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.886+0000 7f87bffff700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6789/0 conn(0x7f87c0094e40 legacy=0x7f87c0092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:33.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:33.886+0000 7f87c4cf3700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.181:6789/0 conn(0x7f87c0095930 legacy=0x7f87c012f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:34.084 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:34.084+0000 7f87bf7fe700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87c0095220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:34.485 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:34.485+0000 7f87bf7fe700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87c0095220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:35.286 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:35.286+0000 7f87bf7fe700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87c0095220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:36.884 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:36.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87c0095220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:20:37.108 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:36.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.181:6789/0 conn(0x7f87c0095930 legacy=0x7f87c012f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:37.109 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:36.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6789/0 conn(0x7f87c0094e40 legacy=0x7f87c0092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:37.109 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:36.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0091590 con 0x7f87a0007130 2021-02-24T15:20:37.109 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:36.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00921d0 con 0x7f87a00034a0 2021-02-24T15:20:37.109 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:36.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0010680 con 0x7f87c0091110 2021-02-24T15:20:37.110 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:36.884+0000 7f87c4cf3700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87a000ceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:37.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:36.886+0000 7f87bf7fe700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6789/0 conn(0x7f87a0007130 legacy=0x7f87a00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:37.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:36.886+0000 7f87bffff700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.181:6789/0 conn(0x7f87a00034a0 legacy=0x7f87a00058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:37.111 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:37.085+0000 7f87c4cf3700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87a000ceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:37.486 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:37.486+0000 7f87c4cf3700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87a000ceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:38.287 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:38.287+0000 7f87c4cf3700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87a000ceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:39.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:39.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87a000ceb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:20:39.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:39.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.181:6789/0 conn(0x7f87a00034a0 legacy=0x7f87a00058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:39.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:39.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6789/0 conn(0x7f87a0007130 legacy=0x7f87a00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:39.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:39.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0011890 con 0x7f87a0007130 2021-02-24T15:20:39.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:39.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0010680 con 0x7f87a00109c0 2021-02-24T15:20:39.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:39.884+0000 7f87bf7fe700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87a000ceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:39.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:39.884+0000 7f87bdffb700 1 -- 172.21.15.152:0/1353336235 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0011650 con 0x7f87c0091110 2021-02-24T15:20:39.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:39.886+0000 7f87c4cf3700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6789/0 conn(0x7f87a0007130 legacy=0x7f87a00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:39.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:39.886+0000 7f87bffff700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.181:6789/0 conn(0x7f87a00109c0 legacy=0x7f87a0010da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:40.086 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:40.085+0000 7f87bf7fe700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87a000ceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:40.486 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:40.486+0000 7f87bf7fe700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87a000ceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:41.119 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.118+0000 7f87beffd700 1 -- 172.21.15.152:0/1353336235 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641842624 0 0) 0x7f87a0010680 con 0x7f87a00109c0 2021-02-24T15:20:41.120 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.118+0000 7f87beffd700 1 -- 172.21.15.152:0/1353336235 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ac003230 con 0x7f87a00109c0 2021-02-24T15:20:41.120 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.118+0000 7f87beffd700 1 -- 172.21.15.152:0/1353336235 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3816707509 0 0) 0x7f87ac003230 con 0x7f87a00109c0 2021-02-24T15:20:41.120 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.118+0000 7f87beffd700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6790/0 conn(0x7f87c0091110 legacy=0x7f87a000ceb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:20:41.120 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.118+0000 7f87beffd700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.152:6789/0 conn(0x7f87a0007130 legacy=0x7f87a00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.121 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.118+0000 7f87beffd700 1 -- 172.21.15.152:0/1353336235 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a0005950 con 0x7f87a00109c0 2021-02-24T15:20:41.121 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.119+0000 7f87beffd700 1 -- 172.21.15.152:0/1353336235 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f87b4001880 con 0x7f87a00109c0 2021-02-24T15:20:41.121 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.119+0000 7f87beffd700 1 -- 172.21.15.152:0/1353336235 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f87b4001ae0 con 0x7f87a00109c0 2021-02-24T15:20:41.121 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.119+0000 7f87beffd700 1 -- 172.21.15.152:0/1353336235 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f87b4004750 con 0x7f87a00109c0 2021-02-24T15:20:41.123 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.120+0000 7f87c6756700 1 -- 172.21.15.152:0/1353336235 >> v1:172.21.15.181:6789/0 conn(0x7f87a00109c0 legacy=0x7f87a0010da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.123 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.120+0000 7f87c6756700 1 -- 172.21.15.152:0/1353336235 shutdown_connections 2021-02-24T15:20:41.124 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.120+0000 7f87c6756700 1 -- 172.21.15.152:0/1353336235 >> 172.21.15.152:0/1353336235 conn(0x7f87c00999a0 msgr2=0x7f87c0099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:41.124 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.120+0000 7f87c6756700 1 -- 172.21.15.152:0/1353336235 shutdown_connections 2021-02-24T15:20:41.124 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.120+0000 7f87c6756700 1 -- 172.21.15.152:0/1353336235 wait complete. 2021-02-24T15:20:41.124 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.121+0000 7f87c6756700 1 librados: starting msgr at 2021-02-24T15:20:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.121+0000 7f87c6756700 1 librados: starting objecter 2021-02-24T15:20:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.121+0000 7f87c6756700 1 Processor -- start 2021-02-24T15:20:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.121+0000 7f87c6756700 1 -- start start 2021-02-24T15:20:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.121+0000 7f87c6756700 1 librados: setting wanted keys 2021-02-24T15:20:41.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.121+0000 7f87c6756700 1 librados: calling monclient init 2021-02-24T15:20:41.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.122+0000 7f87c6756700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0134860 con 0x7f87a00109c0 2021-02-24T15:20:41.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.122+0000 7f87c6756700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c011bb30 con 0x7f87c0091110 2021-02-24T15:20:41.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.122+0000 7f87c6756700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0115560 con 0x7f87a0007130 2021-02-24T15:20:41.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.122+0000 7f87bffff700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f87a0007130 legacy=0x7f87c0134150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:41.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.122+0000 7f87bf7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f87a00109c0 0x7f87c013f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47496/0 (socket says 172.21.15.152:47496) 2021-02-24T15:20:41.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.122+0000 7f87bf7fe700 1 -- 172.21.15.152:0/2329891566 learned_addr learned my addr 172.21.15.152:0/2329891566 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:41.128 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.124+0000 7f87bf7fe700 1 -- 172.21.15.152:0/2329891566 >> v1:172.21.15.152:6789/0 conn(0x7f87a00109c0 legacy=0x7f87c013f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.129 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.124+0000 7f87c4cf3700 1 -- 172.21.15.152:0/2329891566 >> v1:172.21.15.181:6789/0 conn(0x7f87c0091110 legacy=0x7f87c0142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.129 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.124+0000 7f87a7fff700 10 client.?.objecter ms_handle_connect 0x7f87a00109c0 2021-02-24T15:20:41.129 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.124+0000 7f87a7fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:41.129 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.124+0000 7f87a7fff700 10 client.?.objecter ms_handle_connect 0x7f87c0091110 2021-02-24T15:20:41.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.124+0000 7f87a7fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:41.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.124+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388570338 0 0) 0x7f87c011bb30 con 0x7f87c0091110 2021-02-24T15:20:41.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.124+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a0009af0 con 0x7f87c0091110 2021-02-24T15:20:41.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 438805334 0 0) 0x7f87a0009af0 con 0x7f87c0091110 2021-02-24T15:20:41.130 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f87c011bb30 con 0x7f87c0091110 2021-02-24T15:20:41.131 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f87b8001eb0 con 0x7f87c0091110 2021-02-24T15:20:41.131 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2653166897 0 0) 0x7f87c011bb30 con 0x7f87c0091110 2021-02-24T15:20:41.131 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 >> v1:172.21.15.152:6790/0 conn(0x7f87a0007130 legacy=0x7f87c0134150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:20:41.131 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 >> v1:172.21.15.152:6789/0 conn(0x7f87a00109c0 legacy=0x7f87c013f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.131 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c011a4a0 con 0x7f87c0091110 2021-02-24T15:20:41.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c011a6f0 con 0x7f87c0091110 2021-02-24T15:20:41.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87c6756700 10 client.55516.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:41.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c013ae00 con 0x7f87c0091110 2021-02-24T15:20:41.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87c6756700 1 librados: init done 2021-02-24T15:20:41.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f87b80025b0 con 0x7f87c0091110 2021-02-24T15:20:41.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.125+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f87b80028c0 con 0x7f87c0091110 2021-02-24T15:20:41.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.126+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f87b8002a20 con 0x7f87c0091110 2021-02-24T15:20:41.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.126+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(166..166 src has 1..166) v4 ==== 5987+0+0 (unknown 3044547422 0 0) 0x7f87b803b430 con 0x7f87c0091110 2021-02-24T15:20:41.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.126+0000 7f87a7fff700 10 client.55516.objecter ms_dispatch 0x7f87c0001510 osd_map(166..166 src has 1..166) v4 2021-02-24T15:20:41.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.126+0000 7f87a7fff700 3 client.55516.objecter handle_osd_map got epochs [166,166] > 0 2021-02-24T15:20:41.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.126+0000 7f87a7fff700 3 client.55516.objecter handle_osd_map decoding full epoch 166 2021-02-24T15:20:41.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.126+0000 7f87a7fff700 20 client.55516.objecter dump_active .. 0 homeless 2021-02-24T15:20:41.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.126+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c004d60 con 0x7f87c0091110 2021-02-24T15:20:41.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.129+0000 7f87a7fff700 10 client.55516.objecter ms_handle_connect 0x7f87a0032790 2021-02-24T15:20:41.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.131+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f87b8002f40 con 0x7f87c0091110 2021-02-24T15:20:41.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.373+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f879c005590 con 0x7f87c0091110 2021-02-24T15:20:41.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.374+0000 7f87a7fff700 1 -- 172.21.15.152:0/2329891566 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1336 (unknown 254746657 0 50677004) 0x7f87b80124e0 con 0x7f87c0091110 2021-02-24T15:20:41.375 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":24,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:20:41.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.375+0000 7f87c6756700 10 librados: watch_flush enter 2021-02-24T15:20:41.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 10 librados: watch_flush exit 2021-02-24T15:20:41.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 20 client.55516.objecter shutdown clearing up homeless session... 2021-02-24T15:20:41.377 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 10 client.55516.objecter successfully canceled tick 2021-02-24T15:20:41.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 >> v1:172.21.15.181:6812/33484 conn(0x7f87a0032790 legacy=0x7f87a0034c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 >> v1:172.21.15.181:6789/0 conn(0x7f87c0091110 legacy=0x7f87c0142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 shutdown_connections 2021-02-24T15:20:41.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 >> 172.21.15.152:0/2329891566 conn(0x7f87c00999a0 msgr2=0x7f87c0096410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:41.378 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 shutdown_connections 2021-02-24T15:20:41.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 1 -- 172.21.15.152:0/2329891566 wait complete. 2021-02-24T15:20:41.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.376+0000 7f87c6756700 1 librados: shutdown 2021-02-24T15:20:41.388 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2021-02-24T15:20:41.389 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:20:41.536 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.513+0000 7ff6c30d9700 1 Processor -- start 2021-02-24T15:20:41.536 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.514+0000 7ff6c30d9700 1 -- start start 2021-02-24T15:20:41.537 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.514+0000 7ff6c30d9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc092e60 con 0x7ff6bc091110 2021-02-24T15:20:41.538 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.514+0000 7ff6c30d9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc091f30 con 0x7ff6bc095930 2021-02-24T15:20:41.539 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.514+0000 7ff6c30d9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc0921d0 con 0x7ff6bc094e40 2021-02-24T15:20:41.539 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.514+0000 7ff6c0e75700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7ff6bc094e40 legacy=0x7ff6bc092750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:41.539 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.514+0000 7ff6bbfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff6bc091110 0x7ff6bc095220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47502/0 (socket says 172.21.15.152:47502) 2021-02-24T15:20:41.540 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.514+0000 7ff6bbfff700 1 -- 172.21.15.152:0/3946771208 learned_addr learned my addr 172.21.15.152:0/3946771208 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:41.540 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.516+0000 7ff6bbfff700 1 -- 172.21.15.152:0/3946771208 >> v1:172.21.15.152:6789/0 conn(0x7ff6bc091110 legacy=0x7ff6bc095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.541 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6c1676700 1 -- 172.21.15.152:0/3946771208 >> v1:172.21.15.181:6789/0 conn(0x7ff6bc095930 legacy=0x7ff6bc12f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.542 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261761971 0 0) 0x7ff6bc092e60 con 0x7ff6bc091110 2021-02-24T15:20:41.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a0003230 con 0x7ff6bc091110 2021-02-24T15:20:41.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105266240 0 0) 0x7ff6bc091f30 con 0x7ff6bc095930 2021-02-24T15:20:41.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc092e60 con 0x7ff6bc095930 2021-02-24T15:20:41.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2878549602 0 0) 0x7ff6a0003230 con 0x7ff6bc091110 2021-02-24T15:20:41.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 >> v1:172.21.15.152:6790/0 conn(0x7ff6bc094e40 legacy=0x7ff6bc092750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:20:41.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 >> v1:172.21.15.181:6789/0 conn(0x7ff6bc095930 legacy=0x7ff6bc12f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc091590 con 0x7ff6bc091110 2021-02-24T15:20:41.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6a80019f0 con 0x7ff6bc091110 2021-02-24T15:20:41.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6a8001d10 con 0x7ff6bc091110 2021-02-24T15:20:41.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.517+0000 7ff6bb7fe700 1 -- 172.21.15.152:0/3946771208 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6a8004750 con 0x7ff6bc091110 2021-02-24T15:20:41.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.518+0000 7ff6c30d9700 1 -- 172.21.15.152:0/3946771208 >> v1:172.21.15.152:6789/0 conn(0x7ff6bc091110 legacy=0x7ff6bc095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.518+0000 7ff6c30d9700 1 -- 172.21.15.152:0/3946771208 shutdown_connections 2021-02-24T15:20:41.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.518+0000 7ff6c30d9700 1 -- 172.21.15.152:0/3946771208 >> 172.21.15.152:0/3946771208 conn(0x7ff6bc0999a0 msgr2=0x7ff6bc099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:41.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.518+0000 7ff6c30d9700 1 -- 172.21.15.152:0/3946771208 shutdown_connections 2021-02-24T15:20:41.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.518+0000 7ff6c30d9700 1 -- 172.21.15.152:0/3946771208 wait complete. 2021-02-24T15:20:41.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.518+0000 7ff6c30d9700 1 librados: starting msgr at 2021-02-24T15:20:41.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.518+0000 7ff6c30d9700 1 librados: starting objecter 2021-02-24T15:20:41.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.518+0000 7ff6c30d9700 1 Processor -- start 2021-02-24T15:20:41.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.519+0000 7ff6c30d9700 1 -- start start 2021-02-24T15:20:41.552 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.519+0000 7ff6c30d9700 1 librados: setting wanted keys 2021-02-24T15:20:41.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.519+0000 7ff6c30d9700 1 librados: calling monclient init 2021-02-24T15:20:41.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.519+0000 7ff6c30d9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc139a70 con 0x7ff6bc091110 2021-02-24T15:20:41.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.519+0000 7ff6c30d9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc134570 con 0x7ff6bc095930 2021-02-24T15:20:41.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.519+0000 7ff6c30d9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc098110 con 0x7ff6bc094e40 2021-02-24T15:20:41.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.519+0000 7ff6bbfff700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7ff6bc094e40 legacy=0x7ff6bc133e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:41.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.519+0000 7ff6c0e75700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff6bc091110 0x7ff6bc139360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47508/0 (socket says 172.21.15.152:47508) 2021-02-24T15:20:41.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.519+0000 7ff6c0e75700 1 -- 172.21.15.152:0/2638181981 learned_addr learned my addr 172.21.15.152:0/2638181981 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:41.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.521+0000 7ff6c0e75700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.152:6789/0 conn(0x7ff6bc091110 legacy=0x7ff6bc139360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.521+0000 7ff6b8ff9700 10 client.?.objecter ms_handle_connect 0x7ff6bc091110 2021-02-24T15:20:41.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.521+0000 7ff6b8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:41.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998300561 0 0) 0x7ff6bc139a70 con 0x7ff6bc091110 2021-02-24T15:20:41.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff69c004bd0 con 0x7ff6bc091110 2021-02-24T15:20:41.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 10 client.?.objecter ms_handle_connect 0x7ff6bc095930 2021-02-24T15:20:41.561 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:41.561 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6c1676700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.181:6789/0 conn(0x7ff6bc095930 legacy=0x7ff6bc142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.563 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 263793452 0 0) 0x7ff69c004bd0 con 0x7ff6bc091110 2021-02-24T15:20:41.564 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6bc139a70 con 0x7ff6bc091110 2021-02-24T15:20:41.564 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6b00041c0 con 0x7ff6bc091110 2021-02-24T15:20:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898030451 0 0) 0x7ff6bc134570 con 0x7ff6bc095930 2021-02-24T15:20:41.566 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff69c004bd0 con 0x7ff6bc095930 2021-02-24T15:20:41.566 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3393757443 0 0) 0x7ff6bc139a70 con 0x7ff6bc091110 2021-02-24T15:20:41.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.152:6790/0 conn(0x7ff6bc094e40 legacy=0x7ff6bc133e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:20:41.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.181:6789/0 conn(0x7ff6bc095930 legacy=0x7ff6bc142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.567 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc067a90 con 0x7ff6bc091110 2021-02-24T15:20:41.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc063bf0 con 0x7ff6bc091110 2021-02-24T15:20:41.568 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6c30d9700 10 client.27882.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:41.570 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc11a430 con 0x7ff6bc091110 2021-02-24T15:20:41.570 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6c30d9700 1 librados: init done 2021-02-24T15:20:41.573 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6b00044d0 con 0x7ff6bc091110 2021-02-24T15:20:41.573 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.522+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6b00047e0 con 0x7ff6bc091110 2021-02-24T15:20:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.523+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff6b00049c0 con 0x7ff6bc091110 2021-02-24T15:20:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.523+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff694006550 con 0x7ff6940027f0 2021-02-24T15:20:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.523+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(166..166 src has 1..166) v4 ==== 5987+0+0 (unknown 3044547422 0 0) 0x7ff6b003b340 con 0x7ff6bc091110 2021-02-24T15:20:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.523+0000 7ff6b8ff9700 10 client.27882.objecter ms_dispatch 0x7ff6bc001510 osd_map(166..166 src has 1..166) v4 2021-02-24T15:20:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.523+0000 7ff6b8ff9700 3 client.27882.objecter handle_osd_map got epochs [166,166] > 0 2021-02-24T15:20:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.523+0000 7ff6b8ff9700 3 client.27882.objecter handle_osd_map decoding full epoch 166 2021-02-24T15:20:41.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.523+0000 7ff6b8ff9700 20 client.27882.objecter dump_active .. 0 homeless 2021-02-24T15:20:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.525+0000 7ff6bbfff700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.152:6789/0 conn(0x7ff6940027f0 legacy=0x7ff694004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.525+0000 7ff6b8ff9700 10 client.27882.objecter ms_handle_connect 0x7ff6940027f0 2021-02-24T15:20:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.525+0000 7ff6b8ff9700 10 client.27882.objecter resend_mon_ops 2021-02-24T15:20:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.525+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239879341 0 0) 0x7ff694006550 con 0x7ff6940027f0 2021-02-24T15:20:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.525+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc139a70 con 0x7ff6940027f0 2021-02-24T15:20:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.525+0000 7ff6b8ff9700 10 client.27882.objecter ms_handle_connect 0x7ff69c031450 2021-02-24T15:20:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.525+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2532660677 0 0) 0x7ff6bc139a70 con 0x7ff6940027f0 2021-02-24T15:20:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.525+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff694006550 con 0x7ff6940027f0 2021-02-24T15:20:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.525+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6a80044f0 con 0x7ff6940027f0 2021-02-24T15:20:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.526+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3421811862 0 0) 0x7ff694006550 con 0x7ff6940027f0 2021-02-24T15:20:41.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.526+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff694009df0 con 0x7ff6940027f0 2021-02-24T15:20:41.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.526+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7ff6a80046a0 con 0x7ff6940027f0 2021-02-24T15:20:41.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.526+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.152:6789/0 conn(0x7ff6940027f0 legacy=0x7ff694004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.526+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.152:6789/0 conn(0x7ff6940027f0 legacy=0x7ff694004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:41.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.534+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff694007520 con 0x7ff6940068c0 2021-02-24T15:20:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.536+0000 7ff6b8ff9700 10 client.27882.objecter ms_handle_connect 0x7ff6940068c0 2021-02-24T15:20:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.536+0000 7ff6b8ff9700 10 client.27882.objecter resend_mon_ops 2021-02-24T15:20:41.587 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.536+0000 7ff6bbfff700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.152:6789/0 conn(0x7ff6940068c0 legacy=0x7ff694006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.587 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.536+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830066151 0 0) 0x7ff694007520 con 0x7ff6940068c0 2021-02-24T15:20:41.587 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.536+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff694006550 con 0x7ff6940068c0 2021-02-24T15:20:41.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.536+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1987180195 0 0) 0x7ff694006550 con 0x7ff6940068c0 2021-02-24T15:20:41.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.536+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff694007520 con 0x7ff6940068c0 2021-02-24T15:20:41.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.536+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6a8004f00 con 0x7ff6940068c0 2021-02-24T15:20:41.588 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 153089244 0 0) 0x7ff694007520 con 0x7ff6940068c0 2021-02-24T15:20:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff694008720 con 0x7ff6940068c0 2021-02-24T15:20:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3931 (unknown 0 0 632059156) 0x7ff6a80051f0 con 0x7ff6940068c0 2021-02-24T15:20:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.152:6789/0 conn(0x7ff6940068c0 legacy=0x7ff694006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6b8ff9700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.152:6789/0 conn(0x7ff6940068c0 legacy=0x7ff694006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 10 librados: watch_flush enter 2021-02-24T15:20:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 10 librados: watch_flush exit 2021-02-24T15:20:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 20 client.27882.objecter shutdown clearing up homeless session... 2021-02-24T15:20:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 10 client.27882.objecter successfully canceled tick 2021-02-24T15:20:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.181:6812/33484 conn(0x7ff69c031450 legacy=0x7ff69c033910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 >> v1:172.21.15.152:6789/0 conn(0x7ff6bc091110 legacy=0x7ff6bc139360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c1676700 1 -- 172.21.15.152:0/2638181981 reap_dead start 2021-02-24T15:20:41.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c1676700 1 -- 172.21.15.152:0/2638181981 reap_dead start 2021-02-24T15:20:41.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 shutdown_connections 2021-02-24T15:20:41.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 >> 172.21.15.152:0/2638181981 conn(0x7ff6bc0999a0 msgr2=0x7ff6bc0963e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:41.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 shutdown_connections 2021-02-24T15:20:41.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 1 -- 172.21.15.152:0/2638181981 wait complete. 2021-02-24T15:20:41.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.537+0000 7ff6c30d9700 1 librados: shutdown 2021-02-24T15:20:41.593 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:20:41.593 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:41.593 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:41.594 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:20:41.594 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 24, 2021-02-24T15:20:41.594 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:20:41.594 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:20:41.595 INFO:teuthology.orchestra.run.smithi152.stdout: 1 2021-02-24T15:20:41.595 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.595 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:20:41.595 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:41.596 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:20:41.596 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:20:41.596 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:41.597 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:41.597 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:41.597 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:41.598 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:41.598 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:41.598 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:41.598 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:41.599 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:41.599 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.599 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:20:41.599 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:20:41.600 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:41.600 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:41.600 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:41.600 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:41.601 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:41.601 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:41.601 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:41.601 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:41.602 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:41.602 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.603 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:20:41.604 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:20:41.604 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:20:41.604 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:20:41.604 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:20:41.605 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:20:41.605 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:41.605 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:41.605 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:20:41.606 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:20:41.606 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:20:41.606 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:20:41.607 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:20:41.607 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:41.607 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:20:41.607 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:41.608 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:41.608 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:41.608 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:41.608 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:41.609 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:41.609 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:41.609 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:41.609 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:41.609 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.610 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:20:41.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.610 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:20:41.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.611 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:41.611 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:41.611 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:41.611 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:41.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.612 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:41.612 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:20:41.612 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:41.613 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.613 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.613 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:20:41.614 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:20:41.614 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:41.614 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:41.614 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:41.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.615 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:41.616 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:41.616 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:41.616 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:41.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.617 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:41.617 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:20:41.617 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:41.618 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.618 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.618 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:20:41.619 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:20:41.619 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:41.619 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:41.619 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:41.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.620 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:41.620 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:41.620 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:41.621 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:41.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.621 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:41.621 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:20:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.623 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:20:41.623 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:20:41.623 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:41.624 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:41.624 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:41.624 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.624 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.625 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:20:41.625 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:20:41.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.626 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:41.626 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:41.626 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:41.627 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.627 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.627 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:20:41.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.628 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:41.628 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:41.628 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:20:41.629 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.629 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.629 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:20:41.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.629 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:41.630 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:41.630 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6 2021-02-24T15:20:41.630 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.630 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.631 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:20:41.631 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:20:41.632 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:20:41.757 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.756+0000 7f5bb5826700 1 Processor -- start 2021-02-24T15:20:41.757 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.756+0000 7f5bb5826700 1 -- start start 2021-02-24T15:20:41.758 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.756+0000 7f5bb5826700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0068930 con 0x7f5bb0090ba0 2021-02-24T15:20:41.758 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.756+0000 7f5bb5826700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0068bd0 con 0x7f5bb0097550 2021-02-24T15:20:41.758 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.756+0000 7f5bb5826700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb008e260 con 0x7f5bb0090720 2021-02-24T15:20:41.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.757+0000 7f5bae7fc700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f5bb0090720 legacy=0x7f5bb012fda0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:41.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.757+0000 7f5baf7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5bb0090ba0 0x7f5bb01334d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47522/0 (socket says 172.21.15.152:47522) 2021-02-24T15:20:41.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.757+0000 7f5baf7fe700 1 -- 172.21.15.152:0/1375121555 learned_addr learned my addr 172.21.15.152:0/1375121555 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:41.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5baf7fe700 1 -- 172.21.15.152:0/1375121555 >> v1:172.21.15.152:6789/0 conn(0x7f5bb0090ba0 legacy=0x7f5bb01334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5badffb700 1 -- 172.21.15.152:0/1375121555 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283787033 0 0) 0x7f5bb0068930 con 0x7f5bb0090ba0 2021-02-24T15:20:41.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5badffb700 1 -- 172.21.15.152:0/1375121555 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b9c003230 con 0x7f5bb0090ba0 2021-02-24T15:20:41.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5baeffd700 1 -- 172.21.15.152:0/1375121555 >> v1:172.21.15.181:6789/0 conn(0x7f5bb0097550 legacy=0x7f5bb0127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5baeffd700 1 -- 172.21.15.152:0/1375121555 >> v1:172.21.15.181:6789/0 conn(0x7f5bb0097550 legacy=0x7f5bb0127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2021-02-24T15:20:41.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5baeffd700 1 -- 172.21.15.152:0/1375121555 >> v1:172.21.15.181:6789/0 conn(0x7f5bb0097550 legacy=0x7f5bb0127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:20:41.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5baeffd700 1 --1- 172.21.15.152:0/1375121555 >> v1:172.21.15.181:6789/0 conn(0x7f5bb0097550 0x7f5bb0127a20 :-1 s=OPENED pgs=650 cs=1 l=1).handle_message read tag failed 2021-02-24T15:20:41.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5baeffd700 1 --1- 172.21.15.152:0/1375121555 >> v1:172.21.15.181:6789/0 conn(0x7f5bb0097550 0x7f5bb0127a20 :-1 s=OPENED pgs=650 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:20:41.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5badffb700 1 -- 172.21.15.152:0/1375121555 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2662915292 0 0) 0x7f5b9c003230 con 0x7f5bb0090ba0 2021-02-24T15:20:41.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5badffb700 1 -- 172.21.15.152:0/1375121555 >> v1:172.21.15.152:6790/0 conn(0x7f5bb0090720 legacy=0x7f5bb012fda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:20:41.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5badffb700 1 -- 172.21.15.152:0/1375121555 >> v1:172.21.15.181:6789/0 conn(0x7f5bb0097550 legacy=0x7f5bb0127a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:41.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5badffb700 1 -- 172.21.15.152:0/1375121555 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0067fd0 con 0x7f5bb0090ba0 2021-02-24T15:20:41.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5badffb700 1 -- 172.21.15.152:0/1375121555 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5ba8001cb0 con 0x7f5bb0090ba0 2021-02-24T15:20:41.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5badffb700 1 -- 172.21.15.152:0/1375121555 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5ba8001fc0 con 0x7f5bb0090ba0 2021-02-24T15:20:41.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.759+0000 7f5badffb700 1 -- 172.21.15.152:0/1375121555 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5ba8004ad0 con 0x7f5bb0090ba0 2021-02-24T15:20:41.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.760+0000 7f5bb5826700 1 -- 172.21.15.152:0/1375121555 >> v1:172.21.15.152:6789/0 conn(0x7f5bb0090ba0 legacy=0x7f5bb01334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.760+0000 7f5bb5826700 1 -- 172.21.15.152:0/1375121555 shutdown_connections 2021-02-24T15:20:41.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.760+0000 7f5bb5826700 1 -- 172.21.15.152:0/1375121555 >> 172.21.15.152:0/1375121555 conn(0x7f5bb009ab10 msgr2=0x7f5bb0096ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:41.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.760+0000 7f5bb5826700 1 -- 172.21.15.152:0/1375121555 shutdown_connections 2021-02-24T15:20:41.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.760+0000 7f5bb5826700 1 -- 172.21.15.152:0/1375121555 wait complete. 2021-02-24T15:20:41.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bb5826700 1 librados: starting msgr at 2021-02-24T15:20:41.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bb5826700 1 librados: starting objecter 2021-02-24T15:20:41.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bb5826700 1 Processor -- start 2021-02-24T15:20:41.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bb5826700 1 -- start start 2021-02-24T15:20:41.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bb5826700 1 librados: setting wanted keys 2021-02-24T15:20:41.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bb5826700 1 librados: calling monclient init 2021-02-24T15:20:41.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bb5826700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0129ed0 con 0x7f5bb0097550 2021-02-24T15:20:41.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bb5826700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb012a700 con 0x7f5bb0090720 2021-02-24T15:20:41.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bb5826700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb00892f0 con 0x7f5bb0090ba0 2021-02-24T15:20:41.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5bae7fc700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f5bb0090ba0 legacy=0x7f5bb0139fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:20:41.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5baf7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5bb0097550 0x7f5bb0142300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47526/0 (socket says 172.21.15.152:47526) 2021-02-24T15:20:41.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.761+0000 7f5baf7fe700 1 -- 172.21.15.152:0/3865987943 learned_addr learned my addr 172.21.15.152:0/3865987943 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:20:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.763+0000 7f5baf7fe700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.152:6789/0 conn(0x7f5bb0097550 legacy=0x7f5bb0142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.763+0000 7f5b96ffd700 10 client.?.objecter ms_handle_connect 0x7f5bb0097550 2021-02-24T15:20:41.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.763+0000 7f5b96ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:41.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641401606 0 0) 0x7f5bb0129ed0 con 0x7f5bb0097550 2021-02-24T15:20:41.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b90004bd0 con 0x7f5bb0097550 2021-02-24T15:20:41.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 10 client.?.objecter ms_handle_connect 0x7f5bb0090720 2021-02-24T15:20:41.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:20:41.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5baeffd700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.181:6789/0 conn(0x7f5bb0090720 legacy=0x7f5bb008d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1611680558 0 0) 0x7f5b90004bd0 con 0x7f5bb0097550 2021-02-24T15:20:41.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5bb0129ed0 con 0x7f5bb0097550 2021-02-24T15:20:41.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5ba8001c70 con 0x7f5bb0097550 2021-02-24T15:20:41.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3002663045 0 0) 0x7f5bb0129ed0 con 0x7f5bb0097550 2021-02-24T15:20:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.152:6790/0 conn(0x7f5bb0090ba0 legacy=0x7f5bb0139fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:20:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.181:6789/0 conn(0x7f5bb0090720 legacy=0x7f5bb008d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0068230 con 0x7f5bb0097550 2021-02-24T15:20:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb0133c90 con 0x7f5bb0097550 2021-02-24T15:20:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5bb5826700 10 client.27894.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:20:41.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb013a740 con 0x7f5bb0097550 2021-02-24T15:20:41.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5bb5826700 1 librados: init done 2021-02-24T15:20:41.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5ba8005100 con 0x7f5bb0097550 2021-02-24T15:20:41.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.764+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5ba8005410 con 0x7f5bb0097550 2021-02-24T15:20:41.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.765+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f5ba800df10 con 0x7f5bb0097550 2021-02-24T15:20:41.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.765+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5b88006550 con 0x7f5b880027f0 2021-02-24T15:20:41.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.765+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(166..166 src has 1..166) v4 ==== 5987+0+0 (unknown 3044547422 0 0) 0x7f5ba803b6e0 con 0x7f5bb0097550 2021-02-24T15:20:41.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.765+0000 7f5b96ffd700 10 client.27894.objecter ms_dispatch 0x7f5bb0001510 osd_map(166..166 src has 1..166) v4 2021-02-24T15:20:41.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.765+0000 7f5b96ffd700 3 client.27894.objecter handle_osd_map got epochs [166,166] > 0 2021-02-24T15:20:41.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.765+0000 7f5b96ffd700 3 client.27894.objecter handle_osd_map decoding full epoch 166 2021-02-24T15:20:41.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.765+0000 7f5b96ffd700 20 client.27894.objecter dump_active .. 0 homeless 2021-02-24T15:20:41.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.767+0000 7f5baeffd700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.181:6789/0 conn(0x7f5b880027f0 legacy=0x7f5b88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.767+0000 7f5b96ffd700 10 client.27894.objecter ms_handle_connect 0x7f5b880027f0 2021-02-24T15:20:41.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.767+0000 7f5b96ffd700 10 client.27894.objecter resend_mon_ops 2021-02-24T15:20:41.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414817794 0 0) 0x7f5b88006550 con 0x7f5b880027f0 2021-02-24T15:20:41.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb0129ed0 con 0x7f5b880027f0 2021-02-24T15:20:41.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 10 client.27894.objecter ms_handle_connect 0x7f5b90031370 2021-02-24T15:20:41.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1904371984 0 0) 0x7f5bb0129ed0 con 0x7f5b880027f0 2021-02-24T15:20:41.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b88006550 con 0x7f5b880027f0 2021-02-24T15:20:41.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5ba0001af0 con 0x7f5b880027f0 2021-02-24T15:20:41.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1516431315 0 0) 0x7f5b88006550 con 0x7f5b880027f0 2021-02-24T15:20:41.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b88009df0 con 0x7f5b880027f0 2021-02-24T15:20:41.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f5ba00054d0 con 0x7f5b880027f0 2021-02-24T15:20:41.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.181:6789/0 conn(0x7f5b880027f0 legacy=0x7f5b88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.768+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.181:6789/0 conn(0x7f5b880027f0 legacy=0x7f5b88004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:41.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.776+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f5b88007520 con 0x7f5b880068c0 2021-02-24T15:20:41.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.779+0000 7f5baeffd700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.181:6789/0 conn(0x7f5b880068c0 legacy=0x7f5b88006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:20:41.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.779+0000 7f5b96ffd700 10 client.27894.objecter ms_handle_connect 0x7f5b880068c0 2021-02-24T15:20:41.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.779+0000 7f5b96ffd700 10 client.27894.objecter resend_mon_ops 2021-02-24T15:20:41.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.779+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848067534 0 0) 0x7f5b88007520 con 0x7f5b880068c0 2021-02-24T15:20:41.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.779+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b88006550 con 0x7f5b880068c0 2021-02-24T15:20:41.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.779+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1673606258 0 0) 0x7f5b88006550 con 0x7f5b880068c0 2021-02-24T15:20:41.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.779+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b88007520 con 0x7f5b880068c0 2021-02-24T15:20:41.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.779+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5ba0002440 con 0x7f5b880068c0 2021-02-24T15:20:41.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.779+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3081889972 0 0) 0x7f5b88007520 con 0x7f5b880068c0 2021-02-24T15:20:41.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5b88008720 con 0x7f5b880068c0 2021-02-24T15:20:41.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4099 (unknown 0 0 1116347859) 0x7f5ba0002730 con 0x7f5b880068c0 2021-02-24T15:20:41.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.181:6789/0 conn(0x7f5b880068c0 legacy=0x7f5b88006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5b96ffd700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.181:6789/0 conn(0x7f5b880068c0 legacy=0x7f5b88006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:20:41.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 10 librados: watch_flush enter 2021-02-24T15:20:41.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 10 librados: watch_flush exit 2021-02-24T15:20:41.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 20 client.27894.objecter shutdown clearing up homeless session... 2021-02-24T15:20:41.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 10 client.27894.objecter successfully canceled tick 2021-02-24T15:20:41.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.181:6812/33484 conn(0x7f5b90031370 legacy=0x7f5b90033830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 >> v1:172.21.15.152:6789/0 conn(0x7f5bb0097550 legacy=0x7f5bb0142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:20:41.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5baf7fe700 1 -- 172.21.15.152:0/3865987943 reap_dead start 2021-02-24T15:20:41.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5baf7fe700 1 -- 172.21.15.152:0/3865987943 reap_dead start 2021-02-24T15:20:41.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 shutdown_connections 2021-02-24T15:20:41.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 >> 172.21.15.152:0/3865987943 conn(0x7f5bb009ab10 msgr2=0x7f5bb0087080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:20:41.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 shutdown_connections 2021-02-24T15:20:41.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 1 -- 172.21.15.152:0/3865987943 wait complete. 2021-02-24T15:20:41.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:20:41.780+0000 7f5bb5826700 1 librados: shutdown 2021-02-24T15:20:41.832 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:20:41.832 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:41.833 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:41.833 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:20:41.833 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 24, 2021-02-24T15:20:41.833 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:20:41.834 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:20:41.834 INFO:teuthology.orchestra.run.smithi152.stdout: 1 2021-02-24T15:20:41.834 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.834 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:20:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:20:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:20:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:41.836 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:41.836 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:41.836 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:41.836 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:41.836 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:41.837 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:41.837 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:41.838 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.838 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:20:41.838 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:20:41.838 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:41.838 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:41.839 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:41.839 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:41.839 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:41.839 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:41.839 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:41.840 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:41.840 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:41.840 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.841 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:20:41.841 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:20:41.841 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:20:41.841 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:20:41.842 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:20:41.842 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:20:41.842 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:41.842 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:20:41.842 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:20:41.843 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:20:41.843 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:20:41.843 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:20:41.843 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:20:41.843 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:20:41.844 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:20:41.844 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:20:41.844 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:20:41.844 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:20:41.844 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:20:41.845 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:20:41.845 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:20:41.845 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:20:41.845 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:20:41.845 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:20:41.846 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.846 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:20:41.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.846 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:20:41.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.847 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:20:41.847 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:20:41.847 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:41.848 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:41.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.848 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:41.848 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:20:41.849 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:41.849 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.849 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.849 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:20:41.850 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:20:41.850 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:41.850 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:41.850 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:41.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.851 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:20:41.851 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:20:41.851 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:41.852 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:41.852 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.852 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:41.852 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:20:41.852 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:41.853 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.853 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.853 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:20:41.853 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:20:41.854 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:41.854 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:41.854 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:41.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.855 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:20:41.855 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:20:41.855 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:20:41.855 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:20:41.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.856 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:20:41.856 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:20:41.856 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:20:41.856 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.856 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.857 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:20:41.857 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:20:41.857 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:20:41.857 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:20:41.858 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:20:41.858 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.859 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.859 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:20:41.859 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:20:41.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.860 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:41.860 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:41.860 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:41.860 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.860 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.861 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:20:41.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.861 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:41.861 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:41.862 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:20:41.862 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.862 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.862 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:20:41.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.863 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:41.863 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:41.863 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:20:41.863 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.864 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:20:41.864 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:20:41.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:20:41.864 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:20:41.864 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:20:41.865 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:20:41.865 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:20:41.865 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:20:41.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:20:41.866 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:20:41.866 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:20:41.866 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-02-24T15:20:46.485 INFO:tasks.ceph.osd.4.smithi181.stderr:2021-02-24T15:20:46.484+0000 7f1c26327700 -1 osd.4 pg_epoch: 171 pg[57.16( v 167'37 (0'0,167'37] local-lis/les=30/31 n=4 ec=30/30 lis/c=30/30 les/c/f=31/31/0 sis=30) [4,0] r=0 lpr=30 crt=167'37 lcod 166'35 mlcod 166'35 active+clean+snaptrim trimq=[12~1]] removing snap head 2021-02-24T15:21:28.888 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OKoundTrip 2021-02-24T15:21:28.889 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7007 ms) 2021-02-24T15:21:28.889 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2021-02-24T15:21:28.889 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6996 ms) 2021-02-24T15:21:28.889 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2021-02-24T15:21:28.889 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7306 ms) 2021-02-24T15:21:28.890 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2021-02-24T15:21:28.890 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7272 ms) 2021-02-24T15:21:28.890 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2021-02-24T15:21:28.890 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6434 ms) 2021-02-24T15:21:28.891 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2021-02-24T15:21:28.891 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6997 ms) 2021-02-24T15:21:28.891 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2021-02-24T15:21:28.891 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7044 ms) 2021-02-24T15:21:28.891 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2021-02-24T15:21:28.892 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (22227 ms) 2021-02-24T15:21:28.892 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2021-02-24T15:21:28.892 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6724 ms) 2021-02-24T15:21:28.892 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2021-02-24T15:21:28.893 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7242 ms) 2021-02-24T15:21:28.893 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2021-02-24T15:21:28.893 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6780 ms) 2021-02-24T15:21:28.893 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2021-02-24T15:21:28.893 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (6992 ms) 2021-02-24T15:21:28.894 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2021-02-24T15:21:28.894 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7024 ms) 2021-02-24T15:21:28.894 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2021-02-24T15:21:28.894 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7792 ms) 2021-02-24T15:21:28.894 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (127825 ms total) 2021-02-24T15:21:28.895 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: 2021-02-24T15:21:28.895 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [----------] Global test environment tear-down 2021-02-24T15:21:28.895 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [==========] 40 tests from 2 test suites ran. (236689 ms total) 2021-02-24T15:21:28.896 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio: [ PASSED ] 40 tests. 2021-02-24T15:21:44.071 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [==========] Running 71 tests from 4 test suites. 2021-02-24T15:21:44.072 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [----------] Global test environment set-up. 2021-02-24T15:21:44.072 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2021-02-24T15:21:44.073 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: seed 36860 2021-02-24T15:21:44.073 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2021-02-24T15:21:44.073 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (278 ms) 2021-02-24T15:21:44.074 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2021-02-24T15:21:44.074 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (10820 ms) 2021-02-24T15:21:44.075 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2021-02-24T15:21:44.075 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (30 ms) 2021-02-24T15:21:44.076 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (11128 ms total) 2021-02-24T15:21:44.076 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: 2021-02-24T15:21:44.076 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [----------] 42 tests from LibRadosTwoPoolsPP 2021-02-24T15:21:44.077 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2021-02-24T15:21:44.077 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (8171 ms) 2021-02-24T15:21:44.078 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2021-02-24T15:21:44.079 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (7814 ms) 2021-02-24T15:21:44.084 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2021-02-24T15:21:44.084 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9996 ms) 2021-02-24T15:21:44.084 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2021-02-24T15:21:44.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: my_snaps [4] 2021-02-24T15:21:44.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: my_snaps [5,4] 2021-02-24T15:21:44.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: my_snaps [7,5,4] 2021-02-24T15:21:44.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: my_snaps [8,7,5,4] 2021-02-24T15:21:44.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: promoting some heads 2021-02-24T15:21:44.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: promoting from clones for snap 8 2021-02-24T15:21:44.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: promoting from clones for snap 7 2021-02-24T15:21:44.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: promoting from clones for snap 5 2021-02-24T15:21:44.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: promoting from clones for snap 4 2021-02-24T15:21:44.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: waiting for scrubs... 2021-02-24T15:21:44.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: done waiting 2021-02-24T15:21:44.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (77024 ms) 2021-02-24T15:21:44.088 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2021-02-24T15:21:44.088 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (10002 ms) 2021-02-24T15:21:44.088 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2021-02-24T15:21:44.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (8002 ms) 2021-02-24T15:21:44.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2021-02-24T15:21:44.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (7987 ms) 2021-02-24T15:21:44.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2021-02-24T15:21:44.091 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8619 ms) 2021-02-24T15:21:44.091 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2021-02-24T15:21:44.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (9414 ms) 2021-02-24T15:21:44.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2021-02-24T15:21:44.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (9024 ms) 2021-02-24T15:21:44.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2021-02-24T15:21:44.097 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (25425 ms) 2021-02-24T15:21:44.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2021-02-24T15:21:44.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (7757 ms) 2021-02-24T15:21:44.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2021-02-24T15:21:44.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7785 ms) 2021-02-24T15:21:44.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2021-02-24T15:21:44.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13020 ms) 2021-02-24T15:21:44.106 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2021-02-24T15:21:44.107 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (8011 ms) 2021-02-24T15:21:44.109 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2021-02-24T15:21:44.110 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8976 ms) 2021-02-24T15:21:44.111 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2021-02-24T15:21:44.112 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: hmm, no HitSet yet 2021-02-24T15:21:44.116 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: ok, hit_set contains 179:602f83fe:::foo:head 2021-02-24T15:21:51.084 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9001 ms) 2021-02-24T15:21:51.084 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2021-02-24T15:21:51.084 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg_num = 32 2021-02-24T15:21:51.084 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 0 ls 1614180111,0 2021-02-24T15:21:51.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 1 ls 1614180111,0 2021-02-24T15:21:51.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 2 ls 1614180111,0 2021-02-24T15:21:51.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 3 ls 1614180111,0 2021-02-24T15:21:51.085 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 4 ls 1614180111,0 2021-02-24T15:21:51.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 5 ls 1614180111,0 2021-02-24T15:21:51.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 6 ls 1614180111,0 2021-02-24T15:21:51.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 7 ls 1614180111,0 2021-02-24T15:21:51.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 8 ls 1614180111,0 2021-02-24T15:21:51.086 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 9 ls 1614180111,0 2021-02-24T15:21:51.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 10 ls 1614180111,0 2021-02-24T15:21:51.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 11 ls 1614180111,0 2021-02-24T15:21:51.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 12 ls 1614180111,0 2021-02-24T15:21:51.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 13 ls 1614180111,0 2021-02-24T15:21:51.087 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 14 ls 1614180111,0 2021-02-24T15:21:51.088 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 15 ls 1614180111,0 2021-02-24T15:21:51.088 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 16 ls 1614180111,0 2021-02-24T15:21:51.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 17 ls 1614180111,0 2021-02-24T15:21:51.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 18 ls 1614180111,0 2021-02-24T15:21:51.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 19 ls 1614180111,0 2021-02-24T15:21:51.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 20 ls 1614180111,0 2021-02-24T15:21:51.089 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 21 ls 1614180111,0 2021-02-24T15:21:51.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 22 ls 1614180111,0 2021-02-24T15:21:51.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 23 ls 1614180111,0 2021-02-24T15:21:51.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 24 ls 1614180111,0 2021-02-24T15:21:51.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 25 ls 1614180111,0 2021-02-24T15:21:51.090 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 26 ls 1614180111,0 2021-02-24T15:21:51.091 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 27 ls 1614180111,0 2021-02-24T15:21:51.091 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 28 ls 1614180111,0 2021-02-24T15:21:51.091 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 29 ls 1614180111,0 2021-02-24T15:21:51.091 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 30 ls 1614180111,0 2021-02-24T15:21:51.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg 31 ls 1614180111,0 2021-02-24T15:21:51.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: pg_num = 32 2021-02-24T15:21:51.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:6cac518f:::0:head 2021-02-24T15:21:51.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:02547ec2:::1:head 2021-02-24T15:21:51.092 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:f905c69b:::2:head 2021-02-24T15:21:51.093 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:cfc208b3:::3:head 2021-02-24T15:21:51.093 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d83876eb:::4:head 2021-02-24T15:21:51.093 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:b29083e3:::5:head 2021-02-24T15:21:51.093 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c4fdafeb:::6:head 2021-02-24T15:21:51.093 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:5c6b0b28:::7:head 2021-02-24T15:21:51.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:bd63b0f1:::8:head 2021-02-24T15:21:51.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:e960b815:::9:head 2021-02-24T15:21:51.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:52ea6a34:::10:head 2021-02-24T15:21:51.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:89d3ae78:::11:head 2021-02-24T15:21:51.094 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:de5d7c5f:::12:head 2021-02-24T15:21:51.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:566253c9:::13:head 2021-02-24T15:21:51.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:62a1935d:::14:head 2021-02-24T15:21:51.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:863748b0:::15:head 2021-02-24T15:21:51.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:3958e169:::16:head 2021-02-24T15:21:51.095 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:4d4dabf9:::17:head 2021-02-24T15:21:51.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:8391935d:::18:head 2021-02-24T15:21:51.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:28883081:::19:head 2021-02-24T15:21:51.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:69259c59:::20:head 2021-02-24T15:21:51.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:4bdb80b7:::21:head 2021-02-24T15:21:51.096 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:a11c5d71:::22:head 2021-02-24T15:21:51.097 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:271af37b:::23:head 2021-02-24T15:21:51.097 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:95b121be:::24:head 2021-02-24T15:21:51.097 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:58d1031b:::25:head 2021-02-24T15:21:51.097 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:0a050783:::26:head 2021-02-24T15:21:51.098 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c709704c:::27:head 2021-02-24T15:21:51.098 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:cbe56eaf:::28:head 2021-02-24T15:21:51.098 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:86b4b162:::29:head 2021-02-24T15:21:51.098 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:70d89383:::30:head 2021-02-24T15:21:51.098 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:dd450c7c:::31:head 2021-02-24T15:21:51.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:6d5729b1:::32:head 2021-02-24T15:21:51.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c388f3fb:::33:head 2021-02-24T15:21:51.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:56cfea31:::34:head 2021-02-24T15:21:51.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:9dbc1bf7:::35:head 2021-02-24T15:21:51.099 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:40b74ccd:::36:head 2021-02-24T15:21:51.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:4d5aaf42:::37:head 2021-02-24T15:21:51.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:920f362c:::38:head 2021-02-24T15:21:51.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:6cc53222:::39:head 2021-02-24T15:21:51.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:9cad833f:::40:head 2021-02-24T15:21:51.100 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:1ea84d41:::41:head 2021-02-24T15:21:51.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c4480ef6:::42:head 2021-02-24T15:21:51.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:a694361e:::43:head 2021-02-24T15:21:51.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d1bd33e9:::44:head 2021-02-24T15:21:51.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:ddc2cd5d:::45:head 2021-02-24T15:21:51.101 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:2b782207:::46:head 2021-02-24T15:21:51.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:7b187fca:::47:head 2021-02-24T15:21:51.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:90ecdf6f:::48:head 2021-02-24T15:21:51.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:a5ed95fe:::49:head 2021-02-24T15:21:51.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:ea0eaa55:::50:head 2021-02-24T15:21:51.102 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:f33ef17b:::51:head 2021-02-24T15:21:51.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:a0d1b2f6:::52:head 2021-02-24T15:21:51.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:60c5229e:::53:head 2021-02-24T15:21:51.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:edcbc575:::54:head 2021-02-24T15:21:51.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:102cf253:::55:head 2021-02-24T15:21:51.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:efb7fb0b:::56:head 2021-02-24T15:21:51.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:50d0a326:::57:head 2021-02-24T15:21:51.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d4dc5daf:::58:head 2021-02-24T15:21:51.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:3a130462:::59:head 2021-02-24T15:21:51.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:ec87ed71:::60:head 2021-02-24T15:21:51.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d5bc9454:::61:head 2021-02-24T15:21:51.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:3ddfe313:::62:head 2021-02-24T15:21:51.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:7c2816b9:::63:head 2021-02-24T15:21:51.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:47e00e4d:::64:head 2021-02-24T15:21:51.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c6410c18:::65:head 2021-02-24T15:21:51.106 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:b48ed237:::66:head 2021-02-24T15:21:51.106 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:cd63ad31:::67:head 2021-02-24T15:21:51.106 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:b179e92b:::68:head 2021-02-24T15:21:51.106 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:0d9f741a:::69:head 2021-02-24T15:21:51.106 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:6d3352ae:::70:head 2021-02-24T15:21:51.107 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c6d5c19e:::71:head 2021-02-24T15:21:51.107 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:bc4729c3:::72:head 2021-02-24T15:21:51.107 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:77e930b9:::73:head 2021-02-24T15:21:51.107 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:0abeecfd:::74:head 2021-02-24T15:21:51.107 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:b7c37e15:::75:head 2021-02-24T15:21:51.108 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:b6378398:::76:head 2021-02-24T15:21:51.108 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:02bd68de:::77:head 2021-02-24T15:21:51.108 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:cc795d2d:::78:head 2021-02-24T15:21:51.108 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:630d4fea:::79:head 2021-02-24T15:21:51.108 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:e0d29ef5:::80:head 2021-02-24T15:21:51.109 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:fd6f13d2:::81:head 2021-02-24T15:21:51.109 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:606461d5:::82:head 2021-02-24T15:21:51.109 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:eadbdc43:::83:head 2021-02-24T15:21:51.109 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:8761d0bb:::84:head 2021-02-24T15:21:51.109 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:9ef0186f:::85:head 2021-02-24T15:21:51.110 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:e0d41294:::86:head 2021-02-24T15:21:51.110 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:961de695:::87:head 2021-02-24T15:21:51.110 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:1423148f:::88:head 2021-02-24T15:21:51.110 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:633a8fa2:::89:head 2021-02-24T15:21:51.110 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:a8653809:::90:head 2021-02-24T15:21:51.111 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:3dac8b33:::91:head 2021-02-24T15:21:51.111 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:35aad435:::92:head 2021-02-24T15:21:51.111 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:f6dcc343:::93:head 2021-02-24T15:21:51.111 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:dbbdad87:::94:head 2021-02-24T15:21:51.111 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:1cb48ce0:::95:head 2021-02-24T15:21:51.112 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:03cd461c:::96:head 2021-02-24T15:21:51.112 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:17a4ea99:::97:head 2021-02-24T15:21:51.112 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:9993c9a7:::98:head 2021-02-24T15:21:51.112 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:6394211c:::99:head 2021-02-24T15:21:51.113 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:94c7ae57:::100:head 2021-02-24T15:21:51.113 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:6fdee5bb:::101:head 2021-02-24T15:21:51.113 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:9a477fd1:::102:head 2021-02-24T15:21:51.113 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:eb850916:::103:head 2021-02-24T15:21:51.113 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:affc56b9:::104:head 2021-02-24T15:21:51.114 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:b42dc814:::105:head 2021-02-24T15:21:51.114 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:f319f8f0:::106:head 2021-02-24T15:21:51.114 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:9a40b9de:::107:head 2021-02-24T15:21:51.115 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:8b524f28:::108:head 2021-02-24T15:21:51.115 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:e3de589f:::109:head 2021-02-24T15:21:51.115 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:90f90a5b:::110:head 2021-02-24T15:21:51.115 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:a7b4f1d7:::111:head 2021-02-24T15:21:51.115 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:af51766e:::112:head 2021-02-24T15:21:51.116 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:b6f90bd1:::113:head 2021-02-24T15:21:51.116 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:e0261208:::114:head 2021-02-24T15:21:51.116 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c9569ef7:::115:head 2021-02-24T15:21:51.116 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:61bebe50:::116:head 2021-02-24T15:21:51.116 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:fe93412b:::117:head 2021-02-24T15:21:51.117 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d3d38bee:::118:head 2021-02-24T15:21:51.117 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:3100ba0c:::119:head 2021-02-24T15:21:51.117 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d0560ada:::120:head 2021-02-24T15:21:51.117 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:f0ea8b35:::121:head 2021-02-24T15:21:51.117 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:766f231a:::122:head 2021-02-24T15:21:51.118 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:a07a2582:::123:head 2021-02-24T15:21:51.118 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:bd7c6b3a:::124:head 2021-02-24T15:21:51.118 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:fb2ddaff:::125:head 2021-02-24T15:21:51.118 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:4408e1fe:::126:head 2021-02-24T15:21:51.118 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:ee1df7a7:::127:head 2021-02-24T15:21:51.119 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c3002909:::128:head 2021-02-24T15:21:51.119 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:4f48ffa9:::129:head 2021-02-24T15:21:51.119 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:edf38733:::130:head 2021-02-24T15:21:51.119 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c08425c0:::131:head 2021-02-24T15:21:51.119 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:5f902d98:::132:head 2021-02-24T15:21:51.120 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:41ea2c93:::133:head 2021-02-24T15:21:51.120 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:813cee13:::134:head 2021-02-24T15:21:51.120 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:0131818d:::135:head 2021-02-24T15:21:51.120 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:26ba5a85:::136:head 2021-02-24T15:21:51.120 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:381b8a5a:::137:head 2021-02-24T15:21:51.121 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:28797e47:::138:head 2021-02-24T15:21:51.121 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:bfca7f22:::139:head 2021-02-24T15:21:51.121 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:36807075:::140:head 2021-02-24T15:21:51.121 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:80b03975:::141:head 2021-02-24T15:21:51.121 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:5c15709b:::142:head 2021-02-24T15:21:51.122 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:f39ea15e:::143:head 2021-02-24T15:21:51.122 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:ea992956:::144:head 2021-02-24T15:21:51.122 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:48887b1c:::145:head 2021-02-24T15:21:51.122 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:9f24a9dd:::146:head 2021-02-24T15:21:51.123 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:987f100b:::147:head 2021-02-24T15:21:51.123 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d2dd3581:::148:head 2021-02-24T15:21:51.123 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:7fed1808:::149:head 2021-02-24T15:21:51.123 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c80b70e9:::150:head 2021-02-24T15:21:51.123 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:85ed90f9:::151:head 2021-02-24T15:21:51.124 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:36428b24:::152:head 2021-02-24T15:21:51.124 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d044c34a:::153:head 2021-02-24T15:21:51.124 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:7c18bf58:::154:head 2021-02-24T15:21:51.124 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d1c21232:::155:head 2021-02-24T15:21:51.124 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:a7a3c575:::156:head 2021-02-24T15:21:51.125 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:87da0633:::157:head 2021-02-24T15:21:51.125 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d5ac3822:::158:head 2021-02-24T15:21:51.125 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:3f20522d:::159:head 2021-02-24T15:21:51.125 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:6ca26563:::160:head 2021-02-24T15:21:51.125 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:532ce135:::161:head 2021-02-24T15:21:51.126 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:c78863e6:::162:head 2021-02-24T15:21:51.126 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:7462ddf6:::163:head 2021-02-24T15:21:51.126 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:5d165639:::164:head 2021-02-24T15:21:51.126 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:f43765fc:::165:head 2021-02-24T15:22:11.867 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2021-02-24T15:22:11.869 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2021-02-24T15:22:11.869 INFO:tasks.ceph.mon.c:Restarting daemon 2021-02-24T15:22:11.870 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-02-24T15:22:11.874 INFO:tasks.ceph.mon.c:Started 2021-02-24T15:22:11.874 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:22:11.874 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:22:12.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.005+0000 7f03f4412700 1 Processor -- start 2021-02-24T15:22:12.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.005+0000 7f03f4412700 1 -- start start 2021-02-24T15:22:12.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.006+0000 7f03f4412700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec097d40 con 0x7f03ec062da0 2021-02-24T15:22:12.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.006+0000 7f03f4412700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec063d00 con 0x7f03ec099340 2021-02-24T15:22:12.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.006+0000 7f03f4412700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec097980 con 0x7f03ec063220 2021-02-24T15:22:12.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.006+0000 7f03f19ad700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f03ec062da0 0x7f03ec12fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47672/0 (socket says 172.21.15.152:47672) 2021-02-24T15:22:12.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.006+0000 7f03f29af700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f03ec063220 0x7f03ec133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36150/0 (socket says 172.21.15.152:36150) 2021-02-24T15:22:12.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.006+0000 7f03f19ad700 1 -- 172.21.15.152:0/547299111 learned_addr learned my addr 172.21.15.152:0/547299111 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:12.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.008+0000 7f03f19ad700 1 -- 172.21.15.152:0/547299111 >> v1:172.21.15.152:6789/0 conn(0x7f03ec062da0 legacy=0x7f03ec12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.008+0000 7f03f29af700 1 -- 172.21.15.152:0/547299111 >> v1:172.21.15.152:6790/0 conn(0x7f03ec063220 legacy=0x7f03ec133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.008+0000 7f03f21ae700 1 -- 172.21.15.152:0/547299111 >> v1:172.21.15.181:6789/0 conn(0x7f03ec099340 legacy=0x7f03ec097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.009+0000 7f03f11ac700 1 -- 172.21.15.152:0/547299111 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916217480 0 0) 0x7f03ec063d00 con 0x7f03ec099340 2021-02-24T15:22:12.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.009+0000 7f03f11ac700 1 -- 172.21.15.152:0/547299111 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d4003230 con 0x7f03ec099340 2021-02-24T15:22:12.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.009+0000 7f03f11ac700 1 -- 172.21.15.152:0/547299111 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3360361462 0 0) 0x7f03d4003230 con 0x7f03ec099340 2021-02-24T15:22:12.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.009+0000 7f03f11ac700 1 -- 172.21.15.152:0/547299111 >> v1:172.21.15.152:6790/0 conn(0x7f03ec063220 legacy=0x7f03ec133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.009+0000 7f03f11ac700 1 -- 172.21.15.152:0/547299111 >> v1:172.21.15.152:6789/0 conn(0x7f03ec062da0 legacy=0x7f03ec12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.009+0000 7f03f11ac700 1 -- 172.21.15.152:0/547299111 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec08fac0 con 0x7f03ec099340 2021-02-24T15:22:12.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.009+0000 7f03f11ac700 1 -- 172.21.15.152:0/547299111 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03e4001d00 con 0x7f03ec099340 2021-02-24T15:22:12.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.009+0000 7f03f11ac700 1 -- 172.21.15.152:0/547299111 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f03e4002010 con 0x7f03ec099340 2021-02-24T15:22:12.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.009+0000 7f03f11ac700 1 -- 172.21.15.152:0/547299111 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03e40023e0 con 0x7f03ec099340 2021-02-24T15:22:12.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.010+0000 7f03f4412700 1 -- 172.21.15.152:0/547299111 >> v1:172.21.15.181:6789/0 conn(0x7f03ec099340 legacy=0x7f03ec097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.010+0000 7f03f4412700 1 -- 172.21.15.152:0/547299111 shutdown_connections 2021-02-24T15:22:12.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.010+0000 7f03f4412700 1 -- 172.21.15.152:0/547299111 >> 172.21.15.152:0/547299111 conn(0x7f03ec09dcc0 msgr2=0x7f03ec09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:12.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.010+0000 7f03f4412700 1 -- 172.21.15.152:0/547299111 shutdown_connections 2021-02-24T15:22:12.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.010+0000 7f03f4412700 1 -- 172.21.15.152:0/547299111 wait complete. 2021-02-24T15:22:12.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f4412700 1 librados: starting msgr at 2021-02-24T15:22:12.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f4412700 1 librados: starting objecter 2021-02-24T15:22:12.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f4412700 1 Processor -- start 2021-02-24T15:22:12.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f4412700 1 -- start start 2021-02-24T15:22:12.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f4412700 1 librados: setting wanted keys 2021-02-24T15:22:12.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f4412700 1 librados: calling monclient init 2021-02-24T15:22:12.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f4412700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec116ef0 con 0x7f03ec062da0 2021-02-24T15:22:12.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f4412700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec13add0 con 0x7f03ec063220 2021-02-24T15:22:12.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f4412700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec125350 con 0x7f03ec099340 2021-02-24T15:22:12.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f21ae700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f03ec062da0 0x7f03ec13a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47676/0 (socket says 172.21.15.152:47676) 2021-02-24T15:22:12.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f21ae700 1 -- 172.21.15.152:0/3897624846 learned_addr learned my addr 172.21.15.152:0/3897624846 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:12.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.011+0000 7f03f29af700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f03ec099340 0x7f03ec1424f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36156/0 (socket says 172.21.15.152:36156) 2021-02-24T15:22:12.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03f29af700 1 -- 172.21.15.152:0/3897624846 >> v1:172.21.15.152:6790/0 conn(0x7f03ec099340 legacy=0x7f03ec1424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03f21ae700 1 -- 172.21.15.152:0/3897624846 >> v1:172.21.15.152:6789/0 conn(0x7f03ec062da0 legacy=0x7f03ec13a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 10 client.?.objecter ms_handle_connect 0x7f03ec099340 2021-02-24T15:22:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 10 client.?.objecter ms_handle_connect 0x7f03ec062da0 2021-02-24T15:22:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03f19ad700 1 -- 172.21.15.152:0/3897624846 >> v1:172.21.15.181:6789/0 conn(0x7f03ec063220 legacy=0x7f03ec124c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515317723 0 0) 0x7f03ec116ef0 con 0x7f03ec062da0 2021-02-24T15:22:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03cc004bd0 con 0x7f03ec062da0 2021-02-24T15:22:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 10 client.?.objecter ms_handle_connect 0x7f03ec063220 2021-02-24T15:22:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232060777 0 0) 0x7f03ec13add0 con 0x7f03ec063220 2021-02-24T15:22:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03ec116ef0 con 0x7f03ec063220 2021-02-24T15:22:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4286082778 0 0) 0x7f03cc004bd0 con 0x7f03ec062da0 2021-02-24T15:22:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03ec13add0 con 0x7f03ec062da0 2021-02-24T15:22:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03e4001cc0 con 0x7f03ec062da0 2021-02-24T15:22:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 964830067 0 0) 0x7f03ec116ef0 con 0x7f03ec063220 2021-02-24T15:22:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03cc004bd0 con 0x7f03ec063220 2021-02-24T15:22:12.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03dc001b10 con 0x7f03ec063220 2021-02-24T15:22:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1672460155 0 0) 0x7f03ec13add0 con 0x7f03ec062da0 2021-02-24T15:22:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 >> v1:172.21.15.152:6790/0 conn(0x7f03ec099340 legacy=0x7f03ec1424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 >> v1:172.21.15.181:6789/0 conn(0x7f03ec063220 legacy=0x7f03ec124c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec118580 con 0x7f03ec062da0 2021-02-24T15:22:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec117b50 con 0x7f03ec062da0 2021-02-24T15:22:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03f4412700 10 client.28017.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec1167a0 con 0x7f03ec062da0 2021-02-24T15:22:12.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.014+0000 7f03f4412700 1 librados: init done 2021-02-24T15:22:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.015+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f03e4002af0 con 0x7f03ec062da0 2021-02-24T15:22:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.015+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03e4002e00 con 0x7f03ec062da0 2021-02-24T15:22:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.015+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f03e4002f60 con 0x7f03ec062da0 2021-02-24T15:22:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.016+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(256..256 src has 66..256) v4 ==== 5823+0+0 (unknown 2149169516 0 0) 0x7f03e403b820 con 0x7f03ec062da0 2021-02-24T15:22:12.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.016+0000 7f03da7fc700 10 client.28017.objecter ms_dispatch 0x7f03ec001510 osd_map(256..256 src has 66..256) v4 2021-02-24T15:22:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.016+0000 7f03da7fc700 3 client.28017.objecter handle_osd_map got epochs [256,256] > 0 2021-02-24T15:22:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.016+0000 7f03da7fc700 3 client.28017.objecter handle_osd_map decoding full epoch 256 2021-02-24T15:22:12.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.016+0000 7f03da7fc700 20 client.28017.objecter dump_active .. 0 homeless 2021-02-24T15:22:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.016+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d0004d60 con 0x7f03ec062da0 2021-02-24T15:22:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.018+0000 7f03da7fc700 10 client.28017.objecter ms_handle_connect 0x7f03cc031550 2021-02-24T15:22:12.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.020+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f03e4012d80 con 0x7f03ec062da0 2021-02-24T15:22:12.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.275+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f03d0005590 con 0x7f03ec062da0 2021-02-24T15:22:12.277 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.276+0000 7f03da7fc700 1 -- 172.21.15.152:0/3897624846 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 3784445158) 0x7f03e4012970 con 0x7f03ec062da0 2021-02-24T15:22:12.278 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:22:12.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 10 librados: watch_flush enter 2021-02-24T15:22:12.279 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 10 librados: watch_flush exit 2021-02-24T15:22:12.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 20 client.28017.objecter shutdown clearing up homeless session... 2021-02-24T15:22:12.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 10 client.28017.objecter successfully canceled tick 2021-02-24T15:22:12.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 >> v1:172.21.15.181:6812/33484 conn(0x7f03cc031550 legacy=0x7f03cc033a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 >> v1:172.21.15.152:6789/0 conn(0x7f03ec062da0 legacy=0x7f03ec13a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.280 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 shutdown_connections 2021-02-24T15:22:12.281 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 >> 172.21.15.152:0/3897624846 conn(0x7f03ec09dcc0 msgr2=0x7f03ec09c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:12.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 shutdown_connections 2021-02-24T15:22:12.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 1 -- 172.21.15.152:0/3897624846 wait complete. 2021-02-24T15:22:12.282 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.277+0000 7f03f4412700 1 librados: shutdown 2021-02-24T15:22:12.290 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:22:12.291 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:22:12.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.406+0000 7fd36fb7f700 1 Processor -- start 2021-02-24T15:22:12.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.406+0000 7fd36fb7f700 1 -- start start 2021-02-24T15:22:12.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.407+0000 7fd36fb7f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd368062660 con 0x7fd368068410 2021-02-24T15:22:12.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.407+0000 7fd36fb7f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd368063af0 con 0x7fd368095bb0 2021-02-24T15:22:12.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.407+0000 7fd36fb7f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd368063d90 con 0x7fd3680966a0 2021-02-24T15:22:12.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.407+0000 7fd36e11c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd368068410 0x7fd368133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47698/0 (socket says 172.21.15.152:47698) 2021-02-24T15:22:12.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.407+0000 7fd36e11c700 1 -- 172.21.15.152:0/3703540783 learned_addr learned my addr 172.21.15.152:0/3703540783 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:12.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.407+0000 7fd36d91b700 1 --1- 172.21.15.152:0/3703540783 >> v1:172.21.15.152:6790/0 conn(0x7fd3680966a0 0x7fd368096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36170/0 (socket says 172.21.15.152:36170) 2021-02-24T15:22:12.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.409+0000 7fd36e11c700 1 -- 172.21.15.152:0/3703540783 >> v1:172.21.15.152:6789/0 conn(0x7fd368068410 legacy=0x7fd368133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.409+0000 7fd36d91b700 1 -- 172.21.15.152:0/3703540783 >> v1:172.21.15.152:6790/0 conn(0x7fd3680966a0 legacy=0x7fd368096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.409+0000 7fd36d11a700 1 -- 172.21.15.152:0/3703540783 >> v1:172.21.15.181:6789/0 conn(0x7fd368095bb0 legacy=0x7fd368130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.409+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570747819 0 0) 0x7fd368062660 con 0x7fd368068410 2021-02-24T15:22:12.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.409+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd350003230 con 0x7fd368068410 2021-02-24T15:22:12.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.410+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329797042 0 0) 0x7fd368063af0 con 0x7fd368095bb0 2021-02-24T15:22:12.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.410+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd368062660 con 0x7fd368095bb0 2021-02-24T15:22:12.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.410+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3646474414 0 0) 0x7fd368062660 con 0x7fd368095bb0 2021-02-24T15:22:12.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.410+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 >> v1:172.21.15.152:6790/0 conn(0x7fd3680966a0 legacy=0x7fd368096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.410+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 >> v1:172.21.15.152:6789/0 conn(0x7fd368068410 legacy=0x7fd368133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.410+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368064030 con 0x7fd368095bb0 2021-02-24T15:22:12.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.410+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd35c001980 con 0x7fd368095bb0 2021-02-24T15:22:12.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.410+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd35c001c90 con 0x7fd368095bb0 2021-02-24T15:22:12.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.410+0000 7fd36c919700 1 -- 172.21.15.152:0/3703540783 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd35c002060 con 0x7fd368095bb0 2021-02-24T15:22:12.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.411+0000 7fd36fb7f700 1 -- 172.21.15.152:0/3703540783 >> v1:172.21.15.181:6789/0 conn(0x7fd368095bb0 legacy=0x7fd368130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.411+0000 7fd36fb7f700 1 -- 172.21.15.152:0/3703540783 shutdown_connections 2021-02-24T15:22:12.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.411+0000 7fd36fb7f700 1 -- 172.21.15.152:0/3703540783 >> 172.21.15.152:0/3703540783 conn(0x7fd36809ba40 msgr2=0x7fd36809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:12.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.411+0000 7fd36fb7f700 1 -- 172.21.15.152:0/3703540783 shutdown_connections 2021-02-24T15:22:12.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.411+0000 7fd36fb7f700 1 -- 172.21.15.152:0/3703540783 wait complete. 2021-02-24T15:22:12.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.411+0000 7fd36fb7f700 1 librados: starting msgr at 2021-02-24T15:22:12.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.411+0000 7fd36fb7f700 1 librados: starting objecter 2021-02-24T15:22:12.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36fb7f700 1 Processor -- start 2021-02-24T15:22:12.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36fb7f700 1 -- start start 2021-02-24T15:22:12.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36fb7f700 1 librados: setting wanted keys 2021-02-24T15:22:12.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36fb7f700 1 librados: calling monclient init 2021-02-24T15:22:12.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36fb7f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd368063010 con 0x7fd368095bb0 2021-02-24T15:22:12.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36fb7f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd368067450 con 0x7fd368068410 2021-02-24T15:22:12.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36fb7f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd368134440 con 0x7fd3680966a0 2021-02-24T15:22:12.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36d11a700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd368095bb0 0x7fd36813a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47702/0 (socket says 172.21.15.152:47702) 2021-02-24T15:22:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36e11c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fd3680966a0 0x7fd368142140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36180/0 (socket says 172.21.15.152:36180) 2021-02-24T15:22:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.412+0000 7fd36d11a700 1 -- 172.21.15.152:0/669850370 learned_addr learned my addr 172.21.15.152:0/669850370 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:12.427 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.414+0000 7fd36e11c700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6790/0 conn(0x7fd3680966a0 legacy=0x7fd368142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.427 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.414+0000 7fd36d11a700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6789/0 conn(0x7fd368095bb0 legacy=0x7fd36813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.414+0000 7fd359ffb700 10 client.?.objecter ms_handle_connect 0x7fd3680966a0 2021-02-24T15:22:12.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.414+0000 7fd359ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.414+0000 7fd359ffb700 10 client.?.objecter ms_handle_connect 0x7fd368095bb0 2021-02-24T15:22:12.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.414+0000 7fd359ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.414+0000 7fd359ffb700 10 client.?.objecter ms_handle_connect 0x7fd368068410 2021-02-24T15:22:12.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.414+0000 7fd359ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.414+0000 7fd36d91b700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.181:6789/0 conn(0x7fd368068410 legacy=0x7fd368133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552220412 0 0) 0x7fd368134440 con 0x7fd3680966a0 2021-02-24T15:22:12.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd348004bd0 con 0x7fd3680966a0 2021-02-24T15:22:12.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972083349 0 0) 0x7fd368063010 con 0x7fd368095bb0 2021-02-24T15:22:12.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd368134440 con 0x7fd368095bb0 2021-02-24T15:22:12.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633499395 0 0) 0x7fd368067450 con 0x7fd368068410 2021-02-24T15:22:12.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd368063010 con 0x7fd368068410 2021-02-24T15:22:12.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2592250899 0 0) 0x7fd348004bd0 con 0x7fd3680966a0 2021-02-24T15:22:12.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd368067450 con 0x7fd3680966a0 2021-02-24T15:22:12.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd360001f30 con 0x7fd3680966a0 2021-02-24T15:22:12.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 425606457 0 0) 0x7fd368134440 con 0x7fd368095bb0 2021-02-24T15:22:12.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd348004bd0 con 0x7fd368095bb0 2021-02-24T15:22:12.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd35c001940 con 0x7fd368095bb0 2021-02-24T15:22:12.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 417533681 0 0) 0x7fd368063010 con 0x7fd368068410 2021-02-24T15:22:12.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd368134440 con 0x7fd368068410 2021-02-24T15:22:12.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd364001ad0 con 0x7fd368068410 2021-02-24T15:22:12.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 405244761 0 0) 0x7fd348004bd0 con 0x7fd368095bb0 2021-02-24T15:22:12.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6790/0 conn(0x7fd3680966a0 legacy=0x7fd368142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.181:6789/0 conn(0x7fd368068410 legacy=0x7fd368133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36811b710 con 0x7fd368095bb0 2021-02-24T15:22:12.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36813a800 con 0x7fd368095bb0 2021-02-24T15:22:12.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd35c0025a0 con 0x7fd368095bb0 2021-02-24T15:22:12.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd35c0028b0 con 0x7fd368095bb0 2021-02-24T15:22:12.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd36fb7f700 10 client.28023.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:12.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36811a240 con 0x7fd368095bb0 2021-02-24T15:22:12.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.415+0000 7fd36fb7f700 1 librados: init done 2021-02-24T15:22:12.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.416+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fd35c002b10 con 0x7fd368095bb0 2021-02-24T15:22:12.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.416+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd36811aca0 con 0x7fd3680579e0 2021-02-24T15:22:12.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.416+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(257..257 src has 66..257) v4 ==== 6240+0+0 (unknown 119956432 0 0) 0x7fd35c03b430 con 0x7fd368095bb0 2021-02-24T15:22:12.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.416+0000 7fd359ffb700 10 client.28023.objecter ms_dispatch 0x7fd368001510 osd_map(257..257 src has 66..257) v4 2021-02-24T15:22:12.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.416+0000 7fd359ffb700 3 client.28023.objecter handle_osd_map got epochs [257,257] > 0 2021-02-24T15:22:12.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.416+0000 7fd359ffb700 3 client.28023.objecter handle_osd_map decoding full epoch 257 2021-02-24T15:22:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.416+0000 7fd359ffb700 20 client.28023.objecter dump_active .. 0 homeless 2021-02-24T15:22:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.418+0000 7fd359ffb700 10 client.28023.objecter ms_handle_connect 0x7fd3680579e0 2021-02-24T15:22:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.418+0000 7fd359ffb700 10 client.28023.objecter resend_mon_ops 2021-02-24T15:22:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.418+0000 7fd36d91b700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6789/0 conn(0x7fd3680579e0 legacy=0x7fd3681130b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.418+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096398936 0 0) 0x7fd368134440 con 0x7fd3680579e0 2021-02-24T15:22:12.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.418+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd348004bd0 con 0x7fd3680579e0 2021-02-24T15:22:12.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.419+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1797979027 0 0) 0x7fd348004bd0 con 0x7fd3680579e0 2021-02-24T15:22:12.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.419+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd368134440 con 0x7fd3680579e0 2021-02-24T15:22:12.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.419+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd364004790 con 0x7fd3680579e0 2021-02-24T15:22:12.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.419+0000 7fd359ffb700 10 client.28023.objecter ms_handle_connect 0x7fd3480316e0 2021-02-24T15:22:12.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.419+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1211777847 0 0) 0x7fd368134440 con 0x7fd3680579e0 2021-02-24T15:22:12.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.419+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd368058400 con 0x7fd3680579e0 2021-02-24T15:22:12.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.419+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fd364006950 con 0x7fd3680579e0 2021-02-24T15:22:12.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.419+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6789/0 conn(0x7fd3680579e0 legacy=0x7fd3681130b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.419+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6789/0 conn(0x7fd3680579e0 legacy=0x7fd3681130b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:12.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.427+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd36811aca0 con 0x7fd368057dc0 2021-02-24T15:22:12.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.429+0000 7fd36d91b700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6789/0 conn(0x7fd368057dc0 legacy=0x7fd368147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.446 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.429+0000 7fd359ffb700 10 client.28023.objecter ms_handle_connect 0x7fd368057dc0 2021-02-24T15:22:12.446 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.429+0000 7fd359ffb700 10 client.28023.objecter resend_mon_ops 2021-02-24T15:22:12.446 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522605198 0 0) 0x7fd368063d90 con 0x7fd368057dc0 2021-02-24T15:22:12.447 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd368134440 con 0x7fd368057dc0 2021-02-24T15:22:12.448 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2123394658 0 0) 0x7fd368134440 con 0x7fd368057dc0 2021-02-24T15:22:12.448 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd368063d90 con 0x7fd368057dc0 2021-02-24T15:22:12.448 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd364004ec0 con 0x7fd368057dc0 2021-02-24T15:22:12.449 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2012151268 0 0) 0x7fd368063d90 con 0x7fd368057dc0 2021-02-24T15:22:12.449 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd3680581a0 con 0x7fd368057dc0 2021-02-24T15:22:12.449 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3942 (unknown 0 0 3302279683) 0x7fd364005470 con 0x7fd368057dc0 2021-02-24T15:22:12.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6789/0 conn(0x7fd368057dc0 legacy=0x7fd368147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd359ffb700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6789/0 conn(0x7fd368057dc0 legacy=0x7fd368147880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:12.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd36fb7f700 10 librados: watch_flush enter 2021-02-24T15:22:12.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd36fb7f700 10 librados: watch_flush exit 2021-02-24T15:22:12.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd36fb7f700 20 client.28023.objecter shutdown clearing up homeless session... 2021-02-24T15:22:12.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd36fb7f700 10 client.28023.objecter successfully canceled tick 2021-02-24T15:22:12.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.181:6812/33484 conn(0x7fd3480316e0 legacy=0x7fd348033ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 >> v1:172.21.15.152:6789/0 conn(0x7fd368095bb0 legacy=0x7fd36813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.430+0000 7fd36e11c700 1 -- 172.21.15.152:0/669850370 reap_dead start 2021-02-24T15:22:12.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.431+0000 7fd36e11c700 1 -- 172.21.15.152:0/669850370 reap_dead start 2021-02-24T15:22:12.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.431+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 shutdown_connections 2021-02-24T15:22:12.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.431+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 >> 172.21.15.152:0/669850370 conn(0x7fd36809ba40 msgr2=0x7fd368096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:12.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.431+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 shutdown_connections 2021-02-24T15:22:12.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.431+0000 7fd36fb7f700 1 -- 172.21.15.152:0/669850370 wait complete. 2021-02-24T15:22:12.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.431+0000 7fd36fb7f700 1 librados: shutdown 2021-02-24T15:22:12.454 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:22:12.455 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:12.455 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:12.456 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:22:12.456 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 28, 2021-02-24T15:22:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:22:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:22:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:22:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:22:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.458 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:22:12.458 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:12.458 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:22:12.459 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:22:12.459 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:12.459 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:12.459 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:12.460 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:12.460 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:12.461 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:12.461 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:12.461 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:12.461 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:12.462 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.462 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:22:12.462 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:22:12.463 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:12.463 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:12.463 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:12.463 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:12.464 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:12.464 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:12.465 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:12.465 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:12.466 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:12.467 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.468 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:22:12.468 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:22:12.468 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:22:12.469 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:22:12.469 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:22:12.469 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:22:12.469 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:12.470 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:12.470 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:22:12.470 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:22:12.470 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:22:12.471 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:22:12.471 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:22:12.471 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:12.471 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:22:12.471 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:12.472 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:12.472 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:12.472 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:12.472 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:12.472 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:12.473 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:12.473 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:12.473 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:12.473 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.474 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:22:12.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.474 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:22:12.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.474 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:12.475 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:12.475 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:12.475 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:12.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.475 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:12.476 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:22:12.476 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:12.476 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.477 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.477 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:22:12.479 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:22:12.479 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:12.479 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:12.479 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:12.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.480 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:12.480 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:12.481 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:12.481 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:12.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.482 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:12.482 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:22:12.482 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:12.482 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.482 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.483 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:22:12.483 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:22:12.483 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:12.483 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:12.484 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:12.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.484 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:12.484 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:12.485 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:12.485 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:12.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.485 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:12.485 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:22:12.486 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:12.486 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.486 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.487 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:22:12.487 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:22:12.487 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:12.487 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:12.487 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:12.488 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.488 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.488 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:22:12.488 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:22:12.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.489 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:12.490 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:12.490 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:12.490 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.490 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.490 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:22:12.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.491 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:12.492 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:12.492 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:22:12.492 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.492 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.492 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:22:12.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.493 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:12.493 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:12.493 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6 2021-02-24T15:22:12.493 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.494 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.494 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:22:12.494 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:22:12.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:22:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.610+0000 7fe82a9a5700 1 Processor -- start 2021-02-24T15:22:12.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.610+0000 7fe82a9a5700 1 -- start start 2021-02-24T15:22:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.611+0000 7fe82a9a5700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe824097d40 con 0x7fe824062da0 2021-02-24T15:22:12.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.611+0000 7fe82a9a5700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe824063d00 con 0x7fe824063220 2021-02-24T15:22:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.611+0000 7fe82a9a5700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe824097980 con 0x7fe824099340 2021-02-24T15:22:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.611+0000 7fe823fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fe824099340 0x7fe824097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36188/0 (socket says 172.21.15.152:36188) 2021-02-24T15:22:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.611+0000 7fe81bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe824062da0 0x7fe82412fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47712/0 (socket says 172.21.15.152:47712) 2021-02-24T15:22:12.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.611+0000 7fe823fff700 1 -- 172.21.15.152:0/409683097 learned_addr learned my addr 172.21.15.152:0/409683097 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.613+0000 7fe823fff700 1 -- 172.21.15.152:0/409683097 >> v1:172.21.15.152:6790/0 conn(0x7fe824099340 legacy=0x7fe824097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.613+0000 7fe81bfff700 1 -- 172.21.15.152:0/409683097 >> v1:172.21.15.152:6789/0 conn(0x7fe824062da0 legacy=0x7fe82412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.613+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891609682 0 0) 0x7fe824097980 con 0x7fe824099340 2021-02-24T15:22:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.613+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe804003230 con 0x7fe824099340 2021-02-24T15:22:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413450841 0 0) 0x7fe824097d40 con 0x7fe824062da0 2021-02-24T15:22:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe824097980 con 0x7fe824062da0 2021-02-24T15:22:12.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe828f42700 1 -- 172.21.15.152:0/409683097 >> v1:172.21.15.181:6789/0 conn(0x7fe824063220 legacy=0x7fe824133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1754744296 0 0) 0x7fe804003230 con 0x7fe824099340 2021-02-24T15:22:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 >> v1:172.21.15.181:6789/0 conn(0x7fe824063220 legacy=0x7fe824133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 >> v1:172.21.15.152:6789/0 conn(0x7fe824062da0 legacy=0x7fe82412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82408fac0 con 0x7fe824099340 2021-02-24T15:22:12.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe814001930 con 0x7fe824099340 2021-02-24T15:22:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe814001c40 con 0x7fe824099340 2021-02-24T15:22:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe8237fe700 1 -- 172.21.15.152:0/409683097 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe814004750 con 0x7fe824099340 2021-02-24T15:22:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe82a9a5700 1 -- 172.21.15.152:0/409683097 >> v1:172.21.15.152:6790/0 conn(0x7fe824099340 legacy=0x7fe824097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe82a9a5700 1 -- 172.21.15.152:0/409683097 shutdown_connections 2021-02-24T15:22:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe82a9a5700 1 -- 172.21.15.152:0/409683097 >> 172.21.15.152:0/409683097 conn(0x7fe82409dcc0 msgr2=0x7fe82409e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe82a9a5700 1 -- 172.21.15.152:0/409683097 shutdown_connections 2021-02-24T15:22:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.614+0000 7fe82a9a5700 1 -- 172.21.15.152:0/409683097 wait complete. 2021-02-24T15:22:12.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.615+0000 7fe82a9a5700 1 librados: starting msgr at 2021-02-24T15:22:12.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.615+0000 7fe82a9a5700 1 librados: starting objecter 2021-02-24T15:22:12.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.615+0000 7fe82a9a5700 1 Processor -- start 2021-02-24T15:22:12.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.615+0000 7fe82a9a5700 1 -- start start 2021-02-24T15:22:12.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.615+0000 7fe82a9a5700 1 librados: setting wanted keys 2021-02-24T15:22:12.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.615+0000 7fe82a9a5700 1 librados: calling monclient init 2021-02-24T15:22:12.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.616+0000 7fe82a9a5700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8240998b0 con 0x7fe824062da0 2021-02-24T15:22:12.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.616+0000 7fe82a9a5700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8240959b0 con 0x7fe824099340 2021-02-24T15:22:12.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.616+0000 7fe82a9a5700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe824095c50 con 0x7fe824063220 2021-02-24T15:22:12.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.616+0000 7fe823fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe824062da0 0x7fe824139fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47718/0 (socket says 172.21.15.152:47718) 2021-02-24T15:22:12.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.616+0000 7fe823fff700 1 -- 172.21.15.152:0/370364096 learned_addr learned my addr 172.21.15.152:0/370364096 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:12.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe81bfff700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6790/0 conn(0x7fe824063220 legacy=0x7fe824097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe823fff700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6789/0 conn(0x7fe824062da0 legacy=0x7fe824139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 10 client.?.objecter ms_handle_connect 0x7fe824063220 2021-02-24T15:22:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 10 client.?.objecter ms_handle_connect 0x7fe824062da0 2021-02-24T15:22:12.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 10 client.?.objecter ms_handle_connect 0x7fe824099340 2021-02-24T15:22:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe828f42700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.181:6789/0 conn(0x7fe824099340 legacy=0x7fe824142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967415806 0 0) 0x7fe824095c50 con 0x7fe824063220 2021-02-24T15:22:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe808004bd0 con 0x7fe824063220 2021-02-24T15:22:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406426615 0 0) 0x7fe8240998b0 con 0x7fe824062da0 2021-02-24T15:22:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe824095c50 con 0x7fe824062da0 2021-02-24T15:22:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022856157 0 0) 0x7fe8240959b0 con 0x7fe824099340 2021-02-24T15:22:12.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8240998b0 con 0x7fe824099340 2021-02-24T15:22:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.618+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1842335836 0 0) 0x7fe808004bd0 con 0x7fe824063220 2021-02-24T15:22:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8240959b0 con 0x7fe824063220 2021-02-24T15:22:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe80c001ce0 con 0x7fe824063220 2021-02-24T15:22:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3518580699 0 0) 0x7fe824095c50 con 0x7fe824062da0 2021-02-24T15:22:12.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe808004bd0 con 0x7fe824062da0 2021-02-24T15:22:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe8140018f0 con 0x7fe824062da0 2021-02-24T15:22:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4137246482 0 0) 0x7fe8240998b0 con 0x7fe824099340 2021-02-24T15:22:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe824095c50 con 0x7fe824099340 2021-02-24T15:22:12.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe81c001e70 con 0x7fe824099340 2021-02-24T15:22:12.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 242635251 0 0) 0x7fe8240959b0 con 0x7fe824063220 2021-02-24T15:22:12.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.181:6789/0 conn(0x7fe824099340 legacy=0x7fe824142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6789/0 conn(0x7fe824062da0 legacy=0x7fe824139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82413a6d0 con 0x7fe824063220 2021-02-24T15:22:12.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe824094720 con 0x7fe824063220 2021-02-24T15:22:12.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe82a9a5700 10 client.74105.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:12.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8240979d0 con 0x7fe824063220 2021-02-24T15:22:12.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe82a9a5700 1 librados: init done 2021-02-24T15:22:12.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe80c0047a0 con 0x7fe824063220 2021-02-24T15:22:12.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe80c004ab0 con 0x7fe824063220 2021-02-24T15:22:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.619+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fe80c00d670 con 0x7fe824063220 2021-02-24T15:22:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.620+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe7fc006550 con 0x7fe7fc0027f0 2021-02-24T15:22:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.620+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(257..257 src has 66..257) v4 ==== 6240+0+0 (unknown 119956432 0 0) 0x7fe80c03b2e0 con 0x7fe824063220 2021-02-24T15:22:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.620+0000 7fe820ff9700 10 client.74105.objecter ms_dispatch 0x7fe824001510 osd_map(257..257 src has 66..257) v4 2021-02-24T15:22:12.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.620+0000 7fe820ff9700 3 client.74105.objecter handle_osd_map got epochs [257,257] > 0 2021-02-24T15:22:12.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.620+0000 7fe820ff9700 3 client.74105.objecter handle_osd_map decoding full epoch 257 2021-02-24T15:22:12.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.620+0000 7fe820ff9700 20 client.74105.objecter dump_active .. 0 homeless 2021-02-24T15:22:12.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 10 client.74105.objecter ms_handle_connect 0x7fe7fc0027f0 2021-02-24T15:22:12.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 10 client.74105.objecter resend_mon_ops 2021-02-24T15:22:12.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe823fff700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6790/0 conn(0x7fe7fc0027f0 legacy=0x7fe7fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233735180 0 0) 0x7fe7fc006550 con 0x7fe7fc0027f0 2021-02-24T15:22:12.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8240959b0 con 0x7fe7fc0027f0 2021-02-24T15:22:12.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 10 client.74105.objecter ms_handle_connect 0x7fe808031780 2021-02-24T15:22:12.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3346505215 0 0) 0x7fe8240959b0 con 0x7fe7fc0027f0 2021-02-24T15:22:12.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe7fc006550 con 0x7fe7fc0027f0 2021-02-24T15:22:12.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe814004f60 con 0x7fe7fc0027f0 2021-02-24T15:22:12.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3474335571 0 0) 0x7fe7fc006550 con 0x7fe7fc0027f0 2021-02-24T15:22:12.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.622+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7fc009df0 con 0x7fe7fc0027f0 2021-02-24T15:22:12.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.623+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fe8140071e0 con 0x7fe7fc0027f0 2021-02-24T15:22:12.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.623+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6790/0 conn(0x7fe7fc0027f0 legacy=0x7fe7fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.623+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6790/0 conn(0x7fe7fc0027f0 legacy=0x7fe7fc004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:12.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.630+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe7fc009a80 con 0x7fe7fc008da0 2021-02-24T15:22:12.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 10 client.74105.objecter ms_handle_connect 0x7fe7fc008da0 2021-02-24T15:22:12.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe823fff700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6790/0 conn(0x7fe7fc008da0 legacy=0x7fe7fc009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 10 client.74105.objecter resend_mon_ops 2021-02-24T15:22:12.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971778256 0 0) 0x7fe7fc009a80 con 0x7fe7fc008da0 2021-02-24T15:22:12.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7fc006550 con 0x7fe7fc008da0 2021-02-24T15:22:12.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 50547589 0 0) 0x7fe7fc006550 con 0x7fe7fc008da0 2021-02-24T15:22:12.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe7fc009a80 con 0x7fe7fc008da0 2021-02-24T15:22:12.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe814005830 con 0x7fe7fc008da0 2021-02-24T15:22:12.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1320539425 0 0) 0x7fe7fc009a80 con 0x7fe7fc008da0 2021-02-24T15:22:12.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe7fc0086f0 con 0x7fe7fc008da0 2021-02-24T15:22:12.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 3859672182) 0x7fe814006c00 con 0x7fe7fc008da0 2021-02-24T15:22:12.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6790/0 conn(0x7fe7fc008da0 legacy=0x7fe7fc009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.633+0000 7fe820ff9700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6790/0 conn(0x7fe7fc008da0 legacy=0x7fe7fc009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:12.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 10 librados: watch_flush enter 2021-02-24T15:22:12.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 10 librados: watch_flush exit 2021-02-24T15:22:12.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 20 client.74105.objecter shutdown clearing up homeless session... 2021-02-24T15:22:12.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 10 client.74105.objecter successfully canceled tick 2021-02-24T15:22:12.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.181:6812/33484 conn(0x7fe808031780 legacy=0x7fe808033c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 >> v1:172.21.15.152:6790/0 conn(0x7fe824063220 legacy=0x7fe824097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe828f42700 1 -- 172.21.15.152:0/370364096 reap_dead start 2021-02-24T15:22:12.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe828f42700 1 -- 172.21.15.152:0/370364096 reap_dead start 2021-02-24T15:22:12.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 shutdown_connections 2021-02-24T15:22:12.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 >> 172.21.15.152:0/370364096 conn(0x7fe82409dcc0 msgr2=0x7fe82409c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:12.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 shutdown_connections 2021-02-24T15:22:12.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 1 -- 172.21.15.152:0/370364096 wait complete. 2021-02-24T15:22:12.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.634+0000 7fe82a9a5700 1 librados: shutdown 2021-02-24T15:22:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:22:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:22:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 28, 2021-02-24T15:22:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:22:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:22:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:22:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:22:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:22:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:22:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:22:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:12.652 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:12.652 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:12.652 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.652 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:22:12.652 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:22:12.653 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:12.654 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:12.654 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:12.656 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:12.656 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.656 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:22:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:22:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:22:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:22:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:22:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:22:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:22:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:22:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:22:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:22:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:22:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:22:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:22:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:22:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.664 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:12.664 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:22:12.664 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:22:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:22:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:22:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:22:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:22:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:12.670 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:12.670 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:12.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.670 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:12.671 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:12.671 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:12.671 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:12.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.671 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:12.672 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:22:12.672 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:12.672 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.672 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.673 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:22:12.673 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:22:12.673 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:12.673 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:12.674 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:12.674 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.674 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.674 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:22:12.675 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:22:12.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.675 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:12.675 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:12.675 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:12.676 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.676 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.676 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:22:12.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.677 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:12.677 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:12.677 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:22:12.677 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.677 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.678 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:22:12.678 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:22:12.679 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:22:12.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.796+0000 7f1d889d4700 1 Processor -- start 2021-02-24T15:22:12.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.796+0000 7f1d889d4700 1 -- start start 2021-02-24T15:22:12.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.796+0000 7f1d889d4700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d84095e70 con 0x7f1d8412b320 2021-02-24T15:22:12.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.796+0000 7f1d889d4700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d84096110 con 0x7f1d840670f0 2021-02-24T15:22:12.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.796+0000 7f1d889d4700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d840963b0 con 0x7f1d8412ae70 2021-02-24T15:22:12.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.796+0000 7f1d8359e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1d8412b320 0x7f1d84133220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47730/0 (socket says 172.21.15.152:47730) 2021-02-24T15:22:12.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.796+0000 7f1d8259c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 0x7f1d8412faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36210/0 (socket says 172.21.15.152:36210) 2021-02-24T15:22:12.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.796+0000 7f1d8359e700 1 -- 172.21.15.152:0/2758294167 learned_addr learned my addr 172.21.15.152:0/2758294167 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:12.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.798+0000 7f1d8359e700 1 -- 172.21.15.152:0/2758294167 >> v1:172.21.15.152:6789/0 conn(0x7f1d8412b320 legacy=0x7f1d84133220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.798+0000 7f1d8259c700 1 -- 172.21.15.152:0/2758294167 >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 legacy=0x7f1d8412faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60242654 0 0) 0x7f1d84095e70 con 0x7f1d8412b320 2021-02-24T15:22:12.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d70003230 con 0x7f1d8412b320 2021-02-24T15:22:12.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978799886 0 0) 0x7f1d840963b0 con 0x7f1d8412ae70 2021-02-24T15:22:12.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d84095e70 con 0x7f1d8412ae70 2021-02-24T15:22:12.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d82d9d700 1 -- 172.21.15.152:0/2758294167 >> v1:172.21.15.181:6789/0 conn(0x7f1d840670f0 legacy=0x7f1d8412a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1749840307 0 0) 0x7f1d84095e70 con 0x7f1d8412ae70 2021-02-24T15:22:12.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 >> v1:172.21.15.181:6789/0 conn(0x7f1d840670f0 legacy=0x7f1d8412a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 >> v1:172.21.15.152:6789/0 conn(0x7f1d8412b320 legacy=0x7f1d84133220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8408fb30 con 0x7f1d8412ae70 2021-02-24T15:22:12.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d78001970 con 0x7f1d8412ae70 2021-02-24T15:22:12.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d8259c700 1 --1- 172.21.15.152:0/2758294167 >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 0x7f1d8412faf0 :-1 s=OPENED pgs=8313 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f1d78004690 mon_map magic: 0 v1 2021-02-24T15:22:12.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1d78001c80 con 0x7f1d8412ae70 2021-02-24T15:22:12.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d889d4700 1 -- 172.21.15.152:0/2758294167 >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 legacy=0x7f1d8412faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d81d9b700 1 -- 172.21.15.152:0/2758294167 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d78004690 con 0x7f1d8412ae70 2021-02-24T15:22:12.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d889d4700 1 -- 172.21.15.152:0/2758294167 shutdown_connections 2021-02-24T15:22:12.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d889d4700 1 -- 172.21.15.152:0/2758294167 >> 172.21.15.152:0/2758294167 conn(0x7f1d8406a650 msgr2=0x7f1d84099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:12.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d889d4700 1 -- 172.21.15.152:0/2758294167 shutdown_connections 2021-02-24T15:22:12.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.799+0000 7f1d889d4700 1 -- 172.21.15.152:0/2758294167 wait complete. 2021-02-24T15:22:12.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.800+0000 7f1d889d4700 1 librados: starting msgr at 2021-02-24T15:22:12.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.800+0000 7f1d889d4700 1 librados: starting objecter 2021-02-24T15:22:12.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.800+0000 7f1d889d4700 1 Processor -- start 2021-02-24T15:22:12.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.800+0000 7f1d889d4700 1 -- start start 2021-02-24T15:22:12.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.800+0000 7f1d889d4700 1 librados: setting wanted keys 2021-02-24T15:22:12.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.800+0000 7f1d889d4700 1 librados: calling monclient init 2021-02-24T15:22:12.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.801+0000 7f1d889d4700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8412d360 con 0x7f1d840670f0 2021-02-24T15:22:12.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.801+0000 7f1d889d4700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8412d600 con 0x7f1d8412b320 2021-02-24T15:22:12.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.801+0000 7f1d889d4700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8412bf00 con 0x7f1d8412ae70 2021-02-24T15:22:12.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.801+0000 7f1d82d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1d840670f0 0x7f1d84139d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47736/0 (socket says 172.21.15.152:47736) 2021-02-24T15:22:12.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.801+0000 7f1d82d9d700 1 -- 172.21.15.152:0/3120416678 learned_addr learned my addr 172.21.15.152:0/3120416678 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:12.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d82d9d700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.152:6789/0 conn(0x7f1d840670f0 legacy=0x7f1d84139d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d8259c700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 legacy=0x7f1d84133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d6affd700 10 client.?.objecter ms_handle_connect 0x7f1d840670f0 2021-02-24T15:22:12.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d6affd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d6affd700 10 client.?.objecter ms_handle_connect 0x7f1d8412ae70 2021-02-24T15:22:12.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d6affd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482175577 0 0) 0x7f1d8412d360 con 0x7f1d840670f0 2021-02-24T15:22:12.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d64004bd0 con 0x7f1d840670f0 2021-02-24T15:22:12.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685495752 0 0) 0x7f1d8412bf00 con 0x7f1d8412ae70 2021-02-24T15:22:12.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.803+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8412d360 con 0x7f1d8412ae70 2021-02-24T15:22:12.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d8359e700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.181:6789/0 conn(0x7f1d8412b320 legacy=0x7f1d841420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 10 client.?.objecter ms_handle_connect 0x7f1d8412b320 2021-02-24T15:22:12.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:12.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2050454876 0 0) 0x7f1d8412d360 con 0x7f1d8412ae70 2021-02-24T15:22:12.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d8412bf00 con 0x7f1d8412ae70 2021-02-24T15:22:12.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d780044f0 con 0x7f1d8412ae70 2021-02-24T15:22:12.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4106928423 0 0) 0x7f1d64004bd0 con 0x7f1d840670f0 2021-02-24T15:22:12.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d8412d360 con 0x7f1d840670f0 2021-02-24T15:22:12.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d74001ca0 con 0x7f1d840670f0 2021-02-24T15:22:12.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d8259c700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 legacy=0x7f1d84133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-24T15:22:12.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d8259c700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 legacy=0x7f1d84133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:22:12.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d8259c700 1 --1- 172.21.15.152:0/3120416678 >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 0x7f1d84133b00 :-1 s=OPENED pgs=8314 cs=1 l=1).handle_message read tag failed 2021-02-24T15:22:12.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d8259c700 1 --1- 172.21.15.152:0/3120416678 >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 0x7f1d84133b00 :-1 s=OPENED pgs=8314 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:22:12.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1685466466 0 0) 0x7f1d8412d360 con 0x7f1d840670f0 2021-02-24T15:22:12.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.152:6790/0 conn(0x7f1d8412ae70 legacy=0x7f1d84133b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:12.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.181:6789/0 conn(0x7f1d8412b320 legacy=0x7f1d841420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840938c0 con 0x7f1d840670f0 2021-02-24T15:22:12.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8413a4d0 con 0x7f1d840670f0 2021-02-24T15:22:12.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d889d4700 10 client.28041.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:12.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d84134210 con 0x7f1d840670f0 2021-02-24T15:22:12.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d889d4700 1 librados: init done 2021-02-24T15:22:12.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1d740022d0 con 0x7f1d840670f0 2021-02-24T15:22:12.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.804+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d74002660 con 0x7f1d840670f0 2021-02-24T15:22:12.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.805+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f1d5c006550 con 0x7f1d5c0027f0 2021-02-24T15:22:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.805+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f1d74002840 con 0x7f1d840670f0 2021-02-24T15:22:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.805+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(257..257 src has 66..257) v4 ==== 6240+0+0 (unknown 119956432 0 0) 0x7f1d7403b490 con 0x7f1d840670f0 2021-02-24T15:22:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.805+0000 7f1d6affd700 10 client.28041.objecter ms_dispatch 0x7f1d84001510 osd_map(257..257 src has 66..257) v4 2021-02-24T15:22:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.805+0000 7f1d6affd700 3 client.28041.objecter handle_osd_map got epochs [257,257] > 0 2021-02-24T15:22:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.805+0000 7f1d6affd700 3 client.28041.objecter handle_osd_map decoding full epoch 257 2021-02-24T15:22:12.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.805+0000 7f1d6affd700 20 client.28041.objecter dump_active .. 0 homeless 2021-02-24T15:22:12.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.807+0000 7f1d6affd700 10 client.28041.objecter ms_handle_connect 0x7f1d5c0027f0 2021-02-24T15:22:12.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.807+0000 7f1d6affd700 10 client.28041.objecter resend_mon_ops 2021-02-24T15:22:12.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.807+0000 7f1d8259c700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.181:6789/0 conn(0x7f1d5c0027f0 legacy=0x7f1d5c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.807+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276636504 0 0) 0x7f1d5c006550 con 0x7f1d5c0027f0 2021-02-24T15:22:12.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.807+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8412d360 con 0x7f1d5c0027f0 2021-02-24T15:22:12.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.807+0000 7f1d6affd700 10 client.28041.objecter ms_handle_connect 0x7f1d64031650 2021-02-24T15:22:12.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.808+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1763626972 0 0) 0x7f1d8412d360 con 0x7f1d5c0027f0 2021-02-24T15:22:12.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.808+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d5c006550 con 0x7f1d5c0027f0 2021-02-24T15:22:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.808+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d780019c0 con 0x7f1d5c0027f0 2021-02-24T15:22:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.808+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3743060317 0 0) 0x7f1d5c006550 con 0x7f1d5c0027f0 2021-02-24T15:22:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.808+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d5c009df0 con 0x7f1d5c0027f0 2021-02-24T15:22:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.808+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f1d78005010 con 0x7f1d5c0027f0 2021-02-24T15:22:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.808+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.181:6789/0 conn(0x7f1d5c0027f0 legacy=0x7f1d5c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.808+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.181:6789/0 conn(0x7f1d5c0027f0 legacy=0x7f1d5c004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:12.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.816+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f1d5c009a80 con 0x7f1d5c008da0 2021-02-24T15:22:12.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.819+0000 7f1d8259c700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.181:6789/0 conn(0x7f1d5c008da0 legacy=0x7f1d5c009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.819+0000 7f1d6affd700 10 client.28041.objecter ms_handle_connect 0x7f1d5c008da0 2021-02-24T15:22:12.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.819+0000 7f1d6affd700 10 client.28041.objecter resend_mon_ops 2021-02-24T15:22:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.819+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455135960 0 0) 0x7f1d5c009a80 con 0x7f1d5c008da0 2021-02-24T15:22:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.819+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d5c006550 con 0x7f1d5c008da0 2021-02-24T15:22:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.819+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2731083621 0 0) 0x7f1d5c006550 con 0x7f1d5c008da0 2021-02-24T15:22:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.819+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d5c009a80 con 0x7f1d5c008da0 2021-02-24T15:22:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.819+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1d78006ea0 con 0x7f1d5c008da0 2021-02-24T15:22:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.820+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2039758467 0 0) 0x7f1d5c009a80 con 0x7f1d5c008da0 2021-02-24T15:22:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.820+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1d5c0086f0 con 0x7f1d5c008da0 2021-02-24T15:22:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.820+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4110 (unknown 0 0 2271839089) 0x7f1d78005980 con 0x7f1d5c008da0 2021-02-24T15:22:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.820+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.181:6789/0 conn(0x7f1d5c008da0 legacy=0x7f1d5c009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.820+0000 7f1d6affd700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.181:6789/0 conn(0x7f1d5c008da0 legacy=0x7f1d5c009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:12.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.820+0000 7f1d889d4700 10 librados: watch_flush enter 2021-02-24T15:22:12.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 10 librados: watch_flush exit 2021-02-24T15:22:12.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 20 client.28041.objecter shutdown clearing up homeless session... 2021-02-24T15:22:12.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 10 client.28041.objecter successfully canceled tick 2021-02-24T15:22:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.181:6812/33484 conn(0x7f1d64031650 legacy=0x7f1d64033b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 >> v1:172.21.15.152:6789/0 conn(0x7f1d840670f0 legacy=0x7f1d84139d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d8359e700 1 -- 172.21.15.152:0/3120416678 reap_dead start 2021-02-24T15:22:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d8359e700 1 -- 172.21.15.152:0/3120416678 reap_dead start 2021-02-24T15:22:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 shutdown_connections 2021-02-24T15:22:12.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 >> 172.21.15.152:0/3120416678 conn(0x7f1d8406a650 msgr2=0x7f1d8412a190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:12.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 shutdown_connections 2021-02-24T15:22:12.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 1 -- 172.21.15.152:0/3120416678 wait complete. 2021-02-24T15:22:12.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.821+0000 7f1d889d4700 1 librados: shutdown 2021-02-24T15:22:12.831 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:22:12.832 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:12.832 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:12.832 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:22:12.832 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 28, 2021-02-24T15:22:12.833 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:22:12.833 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:22:12.833 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:22:12.833 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:22:12.833 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.834 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:22:12.834 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:12.834 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:22:12.834 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:22:12.835 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:12.835 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:12.835 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:12.835 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:12.835 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:12.836 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:12.836 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:12.836 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:12.836 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:12.836 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.837 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:22:12.837 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:22:12.837 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:12.837 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:12.837 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:12.838 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:12.838 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:12.838 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:12.838 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:12.839 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:12.839 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:12.839 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.839 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:22:12.840 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:22:12.840 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:22:12.840 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:22:12.840 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:22:12.840 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:22:12.841 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:12.841 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:12.841 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:22:12.841 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:22:12.841 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:22:12.842 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:22:12.842 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:22:12.842 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:12.842 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:22:12.843 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:12.843 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:12.843 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:12.843 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:12.843 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:22:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:22:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:12.846 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:12.846 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:12.846 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:12.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.847 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:12.847 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:22:12.847 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:12.847 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.847 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:22:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:22:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:12.850 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:12.850 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:12.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.850 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:22:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:22:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:22:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:12.854 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:12.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.854 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:12.854 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:22:12.854 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:12.855 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.855 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.855 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:22:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:22:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:22:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:22:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:22:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:22:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:22:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:22:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:12.863 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:12.863 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:12.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:12.863 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:22:12.863 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:22:12.865 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2021-02-24T15:22:12.865 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2021-02-24T15:22:12.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.983+0000 7ff6e1af9700 1 Processor -- start 2021-02-24T15:22:12.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.983+0000 7ff6e1af9700 1 -- start start 2021-02-24T15:22:12.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.983+0000 7ff6e1af9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc097d40 con 0x7ff6dc099340 2021-02-24T15:22:12.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.983+0000 7ff6e1af9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc063d00 con 0x7ff6dc063220 2021-02-24T15:22:12.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.983+0000 7ff6e1af9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc097980 con 0x7ff6dc062da0 2021-02-24T15:22:12.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.983+0000 7ff6db7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff6dc099340 0x7ff6dc097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47748/0 (socket says 172.21.15.152:47748) 2021-02-24T15:22:12.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.983+0000 7ff6daffd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff6dc062da0 0x7ff6dc12fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36224/0 (socket says 172.21.15.152:36224) 2021-02-24T15:22:12.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.983+0000 7ff6db7fe700 1 -- 172.21.15.152:0/1829145025 learned_addr learned my addr 172.21.15.152:0/1829145025 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:12.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.985+0000 7ff6db7fe700 1 -- 172.21.15.152:0/1829145025 >> v1:172.21.15.152:6789/0 conn(0x7ff6dc099340 legacy=0x7ff6dc097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.985+0000 7ff6daffd700 1 -- 172.21.15.152:0/1829145025 >> v1:172.21.15.152:6790/0 conn(0x7ff6dc062da0 legacy=0x7ff6dc12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6dbfff700 1 -- 172.21.15.152:0/1829145025 >> v1:172.21.15.181:6789/0 conn(0x7ff6dc063220 legacy=0x7ff6dc133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:12.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008261078 0 0) 0x7ff6dc097980 con 0x7ff6dc062da0 2021-02-24T15:22:12.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c8003230 con 0x7ff6dc062da0 2021-02-24T15:22:12.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788004658 0 0) 0x7ff6dc097d40 con 0x7ff6dc099340 2021-02-24T15:22:12.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6dc097980 con 0x7ff6dc099340 2021-02-24T15:22:12.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732009471 0 0) 0x7ff6dc063d00 con 0x7ff6dc063220 2021-02-24T15:22:12.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6dc097d40 con 0x7ff6dc063220 2021-02-24T15:22:12.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4193765254 0 0) 0x7ff6c8003230 con 0x7ff6dc062da0 2021-02-24T15:22:12.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 >> v1:172.21.15.181:6789/0 conn(0x7ff6dc063220 legacy=0x7ff6dc133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 >> v1:172.21.15.152:6789/0 conn(0x7ff6dc099340 legacy=0x7ff6dc097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc08fac0 con 0x7ff6dc062da0 2021-02-24T15:22:12.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6d0001930 con 0x7ff6dc062da0 2021-02-24T15:22:12.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6d0001c40 con 0x7ff6dc062da0 2021-02-24T15:22:12.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6da7fc700 1 -- 172.21.15.152:0/1829145025 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6d0004690 con 0x7ff6dc062da0 2021-02-24T15:22:12.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6e1af9700 1 -- 172.21.15.152:0/1829145025 >> v1:172.21.15.152:6790/0 conn(0x7ff6dc062da0 legacy=0x7ff6dc12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:12.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6e1af9700 1 -- 172.21.15.152:0/1829145025 shutdown_connections 2021-02-24T15:22:12.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6e1af9700 1 -- 172.21.15.152:0/1829145025 >> 172.21.15.152:0/1829145025 conn(0x7ff6dc09dcc0 msgr2=0x7ff6dc09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:12.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6e1af9700 1 -- 172.21.15.152:0/1829145025 shutdown_connections 2021-02-24T15:22:12.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.986+0000 7ff6e1af9700 1 -- 172.21.15.152:0/1829145025 wait complete. 2021-02-24T15:22:12.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.987+0000 7ff6e1af9700 1 librados: starting msgr at 2021-02-24T15:22:12.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.987+0000 7ff6e1af9700 1 librados: starting objecter 2021-02-24T15:22:12.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.987+0000 7ff6e1af9700 1 Processor -- start 2021-02-24T15:22:12.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.987+0000 7ff6e1af9700 1 -- start start 2021-02-24T15:22:12.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.987+0000 7ff6e1af9700 1 librados: setting wanted keys 2021-02-24T15:22:12.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.987+0000 7ff6e1af9700 1 librados: calling monclient init 2021-02-24T15:22:12.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.988+0000 7ff6e1af9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc0998b0 con 0x7ff6dc063220 2021-02-24T15:22:12.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.988+0000 7ff6e1af9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc095670 con 0x7ff6dc062da0 2021-02-24T15:22:12.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.988+0000 7ff6e1af9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc095910 con 0x7ff6dc099340 2021-02-24T15:22:12.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.988+0000 7ff6daffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff6dc063220 0x7ff6dc096dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47754/0 (socket says 172.21.15.152:47754) 2021-02-24T15:22:12.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.988+0000 7ff6daffd700 1 -- 172.21.15.152:0/2579045805 learned_addr learned my addr 172.21.15.152:0/2579045805 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:13.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6dbfff700 1 -- 172.21.15.152:0/2579045805 >> v1:172.21.15.152:6790/0 conn(0x7ff6dc099340 legacy=0x7ff6dc142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:13.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 10 client.?.objecter ms_handle_connect 0x7ff6dc099340 2021-02-24T15:22:13.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6daffd700 1 -- 172.21.15.152:0/2579045805 >> v1:172.21.15.152:6789/0 conn(0x7ff6dc063220 legacy=0x7ff6dc096dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:13.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:13.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 10 client.?.objecter ms_handle_connect 0x7ff6dc063220 2021-02-24T15:22:13.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:13.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 10 client.?.objecter ms_handle_connect 0x7ff6dc062da0 2021-02-24T15:22:13.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:13.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6db7fe700 1 -- 172.21.15.152:0/2579045805 >> v1:172.21.15.181:6789/0 conn(0x7ff6dc062da0 legacy=0x7ff6dc139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:13.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718729201 0 0) 0x7ff6dc095910 con 0x7ff6dc099340 2021-02-24T15:22:13.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc004bd0 con 0x7ff6dc099340 2021-02-24T15:22:13.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20890459 0 0) 0x7ff6dc0998b0 con 0x7ff6dc063220 2021-02-24T15:22:13.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6dc095910 con 0x7ff6dc063220 2021-02-24T15:22:13.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365644980 0 0) 0x7ff6dc095670 con 0x7ff6dc062da0 2021-02-24T15:22:13.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.990+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6dc0998b0 con 0x7ff6dc062da0 2021-02-24T15:22:13.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3853989605 0 0) 0x7ff6bc004bd0 con 0x7ff6dc099340 2021-02-24T15:22:13.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6dc095670 con 0x7ff6dc099340 2021-02-24T15:22:13.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6d4001fa0 con 0x7ff6dc099340 2021-02-24T15:22:13.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1086368539 0 0) 0x7ff6dc095910 con 0x7ff6dc063220 2021-02-24T15:22:13.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6bc004bd0 con 0x7ff6dc063220 2021-02-24T15:22:13.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 961131628 0 0) 0x7ff6dc0998b0 con 0x7ff6dc062da0 2021-02-24T15:22:13.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6dc095910 con 0x7ff6dc062da0 2021-02-24T15:22:13.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6d00018f0 con 0x7ff6dc063220 2021-02-24T15:22:13.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6cc001c60 con 0x7ff6dc062da0 2021-02-24T15:22:13.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3572099618 0 0) 0x7ff6dc095670 con 0x7ff6dc099340 2021-02-24T15:22:13.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 >> v1:172.21.15.181:6789/0 conn(0x7ff6dc062da0 legacy=0x7ff6dc139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:13.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 >> v1:172.21.15.152:6789/0 conn(0x7ff6dc063220 legacy=0x7ff6dc096dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:13.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc0943e0 con 0x7ff6dc099340 2021-02-24T15:22:13.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc094dd0 con 0x7ff6dc099340 2021-02-24T15:22:13.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6e1af9700 10 client.74123.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:13.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc13ac30 con 0x7ff6dc099340 2021-02-24T15:22:13.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6e1af9700 1 librados: init done 2021-02-24T15:22:13.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6d40025b0 con 0x7ff6dc099340 2021-02-24T15:22:13.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.991+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6d40028c0 con 0x7ff6dc099340 2021-02-24T15:22:13.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.992+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff6d4002b20 con 0x7ff6dc099340 2021-02-24T15:22:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.992+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(257..257 src has 66..257) v4 ==== 6240+0+0 (unknown 119956432 0 0) 0x7ff6d403b780 con 0x7ff6dc099340 2021-02-24T15:22:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.992+0000 7ff6c37fe700 10 client.74123.objecter ms_dispatch 0x7ff6dc001510 osd_map(257..257 src has 66..257) v4 2021-02-24T15:22:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.992+0000 7ff6c37fe700 3 client.74123.objecter handle_osd_map got epochs [257,257] > 0 2021-02-24T15:22:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.992+0000 7ff6c37fe700 3 client.74123.objecter handle_osd_map decoding full epoch 257 2021-02-24T15:22:13.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.992+0000 7ff6c37fe700 20 client.74123.objecter dump_active .. 0 homeless 2021-02-24T15:22:13.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.992+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b4004d60 con 0x7ff6dc099340 2021-02-24T15:22:13.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.994+0000 7ff6c37fe700 10 client.74123.objecter ms_handle_connect 0x7ff6bc0318b0 2021-02-24T15:22:13.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:12.996+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7ff6d4003090 con 0x7ff6dc099340 2021-02-24T15:22:13.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.243+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7ff6b4005820 con 0x7ff6dc099340 2021-02-24T15:22:13.246 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.244+0000 7ff6c37fe700 1 -- 172.21.15.152:0/2579045805 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (unknown 246732539 0 0) 0x7ff6d4012910 con 0x7ff6dc099340 2021-02-24T15:22:13.246 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.244+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.247 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.244+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=13,config=2,health=11,kv=6,logm=68} crc {auth=1934995097,config=3140514009,health=2276989310,kv=2558848642,logm=1530227101}) 2021-02-24T15:22:13.247 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.244+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=12,kv=6,logm=67} crc {auth=2960271555,config=55734535,health=2773866530,kv=2558848642,logm=1283272297}) 2021-02-24T15:22:13.247 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.244+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.247 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.244+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=13,config=2,health=11,kv=6,logm=68} crc {auth=1934995097,config=3140514009,health=2276989310,kv=2558848642,logm=1530227101}) 2021-02-24T15:22:13.247 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.245+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=2,health=11,kv=6,logm=69} crc {auth=948669952,config=3140514009,health=3142512206,kv=2558848642,logm=3737944989}) 2021-02-24T15:22:13.249 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.245+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.249 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.245+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171605489}) 2021-02-24T15:22:13.249 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.245+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2344439943}) 2021-02-24T15:22:13.250 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.245+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.250 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.245+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171605489}) 2021-02-24T15:22:13.250 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.245+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4203293293}) 2021-02-24T15:22:13.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 10 librados: watch_flush enter 2021-02-24T15:22:13.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 10 librados: watch_flush exit 2021-02-24T15:22:13.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 20 client.74123.objecter shutdown clearing up homeless session... 2021-02-24T15:22:13.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 10 client.74123.objecter successfully canceled tick 2021-02-24T15:22:13.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 >> v1:172.21.15.181:6812/33484 conn(0x7ff6bc0318b0 legacy=0x7ff6bc033d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:13.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 >> v1:172.21.15.152:6790/0 conn(0x7ff6dc099340 legacy=0x7ff6dc142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 shutdown_connections 2021-02-24T15:22:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 >> 172.21.15.152:0/2579045805 conn(0x7ff6dc09dcc0 msgr2=0x7ff6dc09c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 shutdown_connections 2021-02-24T15:22:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 1 -- 172.21.15.152:0/2579045805 wait complete. 2021-02-24T15:22:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:13.246+0000 7ff6e1af9700 1 librados: shutdown 2021-02-24T15:22:13.259 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2021-02-24T15:22:13.414 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.413+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.415 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.413+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1561111995}) 2021-02-24T15:22:13.415 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.413+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=118108045}) 2021-02-24T15:22:13.415 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.413+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.416 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.413+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1561111995}) 2021-02-24T15:22:13.416 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.413+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3150876937}) 2021-02-24T15:22:13.419 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.417+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.419 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.417+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=179340554}) 2021-02-24T15:22:13.419 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.417+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3377822368}) 2021-02-24T15:22:13.420 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.417+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.420 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.418+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=179340554}) 2021-02-24T15:22:13.420 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.418+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=789790935}) 2021-02-24T15:22:13.782 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.780+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.782 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.780+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059633428}) 2021-02-24T15:22:13.782 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.780+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3673680460}) 2021-02-24T15:22:13.782 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.780+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.783 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.780+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059633428}) 2021-02-24T15:22:13.783 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.780+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2056405266}) 2021-02-24T15:22:13.784 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.782+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.784 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.782+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=45,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=4,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=24} crc {logm=2385506821,mdsmap=1531151339,mgr=3027754224,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=360286569,mon_config_key=3951946154,monmap=1283604369,osd_metadata=4080698752,osd_pg_creating=23622163,osd_snap=2797634999}) 2021-02-24T15:22:13.784 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.782+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=45,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=20} crc {logm=2501812103,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=543938053,mon_config_key=3464270479,monmap=1275913442,osd_metadata=4080698752,osd_pg_creating=23622163,osd_snap=1087139924}) 2021-02-24T15:22:13.784 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.782+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.785 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.782+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=45,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=4,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=24} crc {logm=2385506821,mdsmap=1531151339,mgr=3027754224,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=360286569,mon_config_key=3951946154,monmap=1283604369,osd_metadata=4080698752,osd_pg_creating=23622163,osd_snap=2797634999}) 2021-02-24T15:22:13.785 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.782+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=44,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=22} crc {logm=1804277649,mdsmap=1531151339,mgr=3734000080,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=543938053,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=23622163,osd_snap=695655686}) 2021-02-24T15:22:13.786 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.783+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.787 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.783+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=6,osdmap=94} crc {osd_snap=2720684817,osdmap=1241500053}) 2021-02-24T15:22:13.787 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.783+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=8,osdmap=92} crc {osd_snap=365125420,osdmap=1210641697}) 2021-02-24T15:22:13.787 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.783+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.787 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.783+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=6,osdmap=94} crc {osd_snap=2720684817,osdmap=1241500053}) 2021-02-24T15:22:13.788 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.783+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=426031886,osdmap=619577006}) 2021-02-24T15:22:13.788 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.784+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.788 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.784+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1607174636}) 2021-02-24T15:22:13.788 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.784+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=429422900}) 2021-02-24T15:22:13.789 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.784+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.789 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.784+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1607174636}) 2021-02-24T15:22:13.789 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.784+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3780004079}) 2021-02-24T15:22:13.790 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.786+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.790 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.786+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=96} crc {osdmap=2674266508}) 2021-02-24T15:22:13.791 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.786+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=98} crc {osdmap=990022620}) 2021-02-24T15:22:13.791 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.786+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:22:13.791 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.786+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=96} crc {osdmap=2674266508}) 2021-02-24T15:22:13.791 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:22:13.786+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=99} crc {osdmap=534326969}) 2021-02-24T15:22:14.260 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:22:14.260 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:22:14.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.389+0000 7fbecca5a700 1 Processor -- start 2021-02-24T15:22:14.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.389+0000 7fbecca5a700 1 -- start start 2021-02-24T15:22:14.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.390+0000 7fbecca5a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec8062660 con 0x7fbec8068410 2021-02-24T15:22:14.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.390+0000 7fbecca5a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec8063af0 con 0x7fbec8095bb0 2021-02-24T15:22:14.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.390+0000 7fbecca5a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec8063d90 con 0x7fbec80966a0 2021-02-24T15:22:14.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.390+0000 7fbec6d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbec8068410 0x7fbec8133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47764/0 (socket says 172.21.15.152:47764) 2021-02-24T15:22:14.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.390+0000 7fbec659c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fbec80966a0 0x7fbec8096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36240/0 (socket says 172.21.15.152:36240) 2021-02-24T15:22:14.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.390+0000 7fbec6d9d700 1 -- 172.21.15.152:0/2926659621 learned_addr learned my addr 172.21.15.152:0/2926659621 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:14.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.392+0000 7fbec659c700 1 -- 172.21.15.152:0/2926659621 >> v1:172.21.15.152:6790/0 conn(0x7fbec80966a0 legacy=0x7fbec8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.392+0000 7fbec6d9d700 1 -- 172.21.15.152:0/2926659621 >> v1:172.21.15.152:6789/0 conn(0x7fbec8068410 legacy=0x7fbec8133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec5d9b700 1 -- 172.21.15.152:0/2926659621 >> v1:172.21.15.181:6789/0 conn(0x7fbec8095bb0 legacy=0x7fbec8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534339187 0 0) 0x7fbec8063d90 con 0x7fbec80966a0 2021-02-24T15:22:14.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeac003230 con 0x7fbec80966a0 2021-02-24T15:22:14.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902573192 0 0) 0x7fbec8062660 con 0x7fbec8068410 2021-02-24T15:22:14.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec8063d90 con 0x7fbec8068410 2021-02-24T15:22:14.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301753226 0 0) 0x7fbec8063af0 con 0x7fbec8095bb0 2021-02-24T15:22:14.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec8062660 con 0x7fbec8095bb0 2021-02-24T15:22:14.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 683616653 0 0) 0x7fbec8063d90 con 0x7fbec8068410 2021-02-24T15:22:14.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 >> v1:172.21.15.152:6790/0 conn(0x7fbec80966a0 legacy=0x7fbec8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 >> v1:172.21.15.181:6789/0 conn(0x7fbec8095bb0 legacy=0x7fbec8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec8064030 con 0x7fbec8068410 2021-02-24T15:22:14.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbec0001cb0 con 0x7fbec8068410 2021-02-24T15:22:14.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbec0001fd0 con 0x7fbec8068410 2021-02-24T15:22:14.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.393+0000 7fbec559a700 1 -- 172.21.15.152:0/2926659621 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbec0004ad0 con 0x7fbec8068410 2021-02-24T15:22:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.394+0000 7fbecca5a700 1 -- 172.21.15.152:0/2926659621 >> v1:172.21.15.152:6789/0 conn(0x7fbec8068410 legacy=0x7fbec8133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.394+0000 7fbecca5a700 1 -- 172.21.15.152:0/2926659621 shutdown_connections 2021-02-24T15:22:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.394+0000 7fbecca5a700 1 -- 172.21.15.152:0/2926659621 >> 172.21.15.152:0/2926659621 conn(0x7fbec809ba40 msgr2=0x7fbec809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.394+0000 7fbecca5a700 1 -- 172.21.15.152:0/2926659621 shutdown_connections 2021-02-24T15:22:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.394+0000 7fbecca5a700 1 -- 172.21.15.152:0/2926659621 wait complete. 2021-02-24T15:22:14.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.394+0000 7fbecca5a700 1 librados: starting msgr at 2021-02-24T15:22:14.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.394+0000 7fbecca5a700 1 librados: starting objecter 2021-02-24T15:22:14.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbecca5a700 1 Processor -- start 2021-02-24T15:22:14.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbecca5a700 1 -- start start 2021-02-24T15:22:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbecca5a700 1 librados: setting wanted keys 2021-02-24T15:22:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbecca5a700 1 librados: calling monclient init 2021-02-24T15:22:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbecca5a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec8063010 con 0x7fbec80966a0 2021-02-24T15:22:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbecca5a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec81345a0 con 0x7fbec8068410 2021-02-24T15:22:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbecca5a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec811b870 con 0x7fbec8095bb0 2021-02-24T15:22:14.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbec5d9b700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fbec8095bb0 0x7fbec8133e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36244/0 (socket says 172.21.15.152:36244) 2021-02-24T15:22:14.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbec6d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbec80966a0 0x7fbec81422a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47770/0 (socket says 172.21.15.152:47770) 2021-02-24T15:22:14.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.395+0000 7fbec5d9b700 1 -- 172.21.15.152:0/3321768523 learned_addr learned my addr 172.21.15.152:0/3321768523 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:14.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.397+0000 7fbec6d9d700 1 -- 172.21.15.152:0/3321768523 >> v1:172.21.15.152:6789/0 conn(0x7fbec80966a0 legacy=0x7fbec81422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.397+0000 7fbeb67fc700 10 client.?.objecter ms_handle_connect 0x7fbec80966a0 2021-02-24T15:22:14.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.397+0000 7fbeb67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:14.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.397+0000 7fbeb67fc700 10 client.?.objecter ms_handle_connect 0x7fbec8095bb0 2021-02-24T15:22:14.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.397+0000 7fbeb67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:14.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.397+0000 7fbec5d9b700 1 -- 172.21.15.152:0/3321768523 >> v1:172.21.15.152:6790/0 conn(0x7fbec8095bb0 legacy=0x7fbec8133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.397+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625739439 0 0) 0x7fbec8063010 con 0x7fbec80966a0 2021-02-24T15:22:14.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.397+0000 7fbec659c700 1 -- 172.21.15.152:0/3321768523 >> v1:172.21.15.181:6789/0 conn(0x7fbec8068410 legacy=0x7fbec813a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbea4004bd0 con 0x7fbec80966a0 2021-02-24T15:22:14.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 10 client.?.objecter ms_handle_connect 0x7fbec8068410 2021-02-24T15:22:14.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:14.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227402850 0 0) 0x7fbec811b870 con 0x7fbec8095bb0 2021-02-24T15:22:14.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec8063010 con 0x7fbec8095bb0 2021-02-24T15:22:14.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419746287 0 0) 0x7fbec81345a0 con 0x7fbec8068410 2021-02-24T15:22:14.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec811b870 con 0x7fbec8068410 2021-02-24T15:22:14.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3369625384 0 0) 0x7fbec8063010 con 0x7fbec8095bb0 2021-02-24T15:22:14.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbec81345a0 con 0x7fbec8095bb0 2021-02-24T15:22:14.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1281839456 0 0) 0x7fbea4004bd0 con 0x7fbec80966a0 2021-02-24T15:22:14.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbec8063010 con 0x7fbec80966a0 2021-02-24T15:22:14.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbebc001be0 con 0x7fbec8095bb0 2021-02-24T15:22:14.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbec0001c70 con 0x7fbec80966a0 2021-02-24T15:22:14.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4090400664 0 0) 0x7fbec811b870 con 0x7fbec8068410 2021-02-24T15:22:14.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbea4004bd0 con 0x7fbec8068410 2021-02-24T15:22:14.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbeb8001c60 con 0x7fbec8068410 2021-02-24T15:22:14.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2056494072 0 0) 0x7fbec8063010 con 0x7fbec80966a0 2021-02-24T15:22:14.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 >> v1:172.21.15.152:6790/0 conn(0x7fbec8095bb0 legacy=0x7fbec8133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 >> v1:172.21.15.181:6789/0 conn(0x7fbec8068410 legacy=0x7fbec813a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec811ada0 con 0x7fbec80966a0 2021-02-24T15:22:14.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec80673a0 con 0x7fbec80966a0 2021-02-24T15:22:14.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbecca5a700 10 client.28053.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:14.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec8118ba0 con 0x7fbec80966a0 2021-02-24T15:22:14.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbecca5a700 1 librados: init done 2021-02-24T15:22:14.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbec00018e0 con 0x7fbec80966a0 2021-02-24T15:22:14.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.398+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbec00052a0 con 0x7fbec80966a0 2021-02-24T15:22:14.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.399+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fbec000dda0 con 0x7fbec80966a0 2021-02-24T15:22:14.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.399+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea8004d60 con 0x7fbec80966a0 2021-02-24T15:22:14.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.399+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(259..259 src has 66..259) v4 ==== 5259+0+0 (unknown 2962860947 0 0) 0x7fbec003b3c0 con 0x7fbec80966a0 2021-02-24T15:22:14.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.399+0000 7fbeb67fc700 10 client.28053.objecter ms_dispatch 0x7fbec8001510 osd_map(259..259 src has 66..259) v4 2021-02-24T15:22:14.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.399+0000 7fbeb67fc700 3 client.28053.objecter handle_osd_map got epochs [259,259] > 0 2021-02-24T15:22:14.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.399+0000 7fbeb67fc700 3 client.28053.objecter handle_osd_map decoding full epoch 259 2021-02-24T15:22:14.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.399+0000 7fbeb67fc700 20 client.28053.objecter dump_active .. 0 homeless 2021-02-24T15:22:14.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.402+0000 7fbeb67fc700 10 client.28053.objecter ms_handle_connect 0x7fbea40317a0 2021-02-24T15:22:14.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.403+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fbec00129f0 con 0x7fbec80966a0 2021-02-24T15:22:14.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.637+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbea8005590 con 0x7fbec80966a0 2021-02-24T15:22:14.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.637+0000 7fbeb67fc700 1 -- 172.21.15.152:0/3321768523 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 1426305798) 0x7fbec0012810 con 0x7fbec80966a0 2021-02-24T15:22:14.639 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:22:14.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 10 librados: watch_flush enter 2021-02-24T15:22:14.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 10 librados: watch_flush exit 2021-02-24T15:22:14.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 20 client.28053.objecter shutdown clearing up homeless session... 2021-02-24T15:22:14.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 10 client.28053.objecter successfully canceled tick 2021-02-24T15:22:14.641 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 >> v1:172.21.15.181:6812/33484 conn(0x7fbea40317a0 legacy=0x7fbea4033c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 >> v1:172.21.15.152:6789/0 conn(0x7fbec80966a0 legacy=0x7fbec81422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 shutdown_connections 2021-02-24T15:22:14.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 >> 172.21.15.152:0/3321768523 conn(0x7fbec809ba40 msgr2=0x7fbec81120a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:14.642 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 shutdown_connections 2021-02-24T15:22:14.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 1 -- 172.21.15.152:0/3321768523 wait complete. 2021-02-24T15:22:14.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.639+0000 7fbecca5a700 1 librados: shutdown 2021-02-24T15:22:14.652 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:22:14.652 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-02-24T15:22:14.653 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:22:14.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.769+0000 7fde3cef1700 1 Processor -- start 2021-02-24T15:22:14.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.769+0000 7fde3cef1700 1 -- start start 2021-02-24T15:22:14.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.770+0000 7fde3cef1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde38097d40 con 0x7fde38063220 2021-02-24T15:22:14.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.770+0000 7fde3cef1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde38063d00 con 0x7fde38062da0 2021-02-24T15:22:14.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.770+0000 7fde3cef1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde38097980 con 0x7fde38099340 2021-02-24T15:22:14.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.770+0000 7fde36d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fde38063220 0x7fde38133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47780/0 (socket says 172.21.15.152:47780) 2021-02-24T15:22:14.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.770+0000 7fde3659c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fde38099340 0x7fde38097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36252/0 (socket says 172.21.15.152:36252) 2021-02-24T15:22:14.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.770+0000 7fde36d9d700 1 -- 172.21.15.152:0/2140937807 learned_addr learned my addr 172.21.15.152:0/2140937807 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.772+0000 7fde3659c700 1 -- 172.21.15.152:0/2140937807 >> v1:172.21.15.152:6790/0 conn(0x7fde38099340 legacy=0x7fde38097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.772+0000 7fde36d9d700 1 -- 172.21.15.152:0/2140937807 >> v1:172.21.15.152:6789/0 conn(0x7fde38063220 legacy=0x7fde38133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.772+0000 7fde35d9b700 1 -- 172.21.15.152:0/2140937807 >> v1:172.21.15.181:6789/0 conn(0x7fde38062da0 legacy=0x7fde3812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517159866 0 0) 0x7fde38097980 con 0x7fde38099340 2021-02-24T15:22:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde18003230 con 0x7fde38099340 2021-02-24T15:22:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846771713 0 0) 0x7fde38097d40 con 0x7fde38063220 2021-02-24T15:22:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde38097980 con 0x7fde38063220 2021-02-24T15:22:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319953537 0 0) 0x7fde38063d00 con 0x7fde38062da0 2021-02-24T15:22:14.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde38097d40 con 0x7fde38062da0 2021-02-24T15:22:14.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2388991755 0 0) 0x7fde38097980 con 0x7fde38063220 2021-02-24T15:22:14.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 >> v1:172.21.15.152:6790/0 conn(0x7fde38099340 legacy=0x7fde38097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 >> v1:172.21.15.181:6789/0 conn(0x7fde38062da0 legacy=0x7fde3812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3808fac0 con 0x7fde38063220 2021-02-24T15:22:14.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fde30001cb0 con 0x7fde38063220 2021-02-24T15:22:14.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fde30001fd0 con 0x7fde38063220 2021-02-24T15:22:14.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3559a700 1 -- 172.21.15.152:0/2140937807 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fde30004ad0 con 0x7fde38063220 2021-02-24T15:22:14.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.773+0000 7fde3cef1700 1 -- 172.21.15.152:0/2140937807 >> v1:172.21.15.152:6789/0 conn(0x7fde38063220 legacy=0x7fde38133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 -- 172.21.15.152:0/2140937807 shutdown_connections 2021-02-24T15:22:14.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 -- 172.21.15.152:0/2140937807 >> 172.21.15.152:0/2140937807 conn(0x7fde3809dcc0 msgr2=0x7fde3809e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:14.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 -- 172.21.15.152:0/2140937807 shutdown_connections 2021-02-24T15:22:14.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 -- 172.21.15.152:0/2140937807 wait complete. 2021-02-24T15:22:14.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 librados: starting msgr at 2021-02-24T15:22:14.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 librados: starting objecter 2021-02-24T15:22:14.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 Processor -- start 2021-02-24T15:22:14.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 -- start start 2021-02-24T15:22:14.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 librados: setting wanted keys 2021-02-24T15:22:14.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.774+0000 7fde3cef1700 1 librados: calling monclient init 2021-02-24T15:22:14.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.775+0000 7fde3cef1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde380998b0 con 0x7fde38063220 2021-02-24T15:22:14.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.775+0000 7fde3cef1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde38126250 con 0x7fde38099340 2021-02-24T15:22:14.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.775+0000 7fde3cef1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde38095450 con 0x7fde38062da0 2021-02-24T15:22:14.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.775+0000 7fde35d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fde38063220 0x7fde38133e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47784/0 (socket says 172.21.15.152:47784) 2021-02-24T15:22:14.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.775+0000 7fde3659c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fde38062da0 0x7fde38133770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36258/0 (socket says 172.21.15.152:36258) 2021-02-24T15:22:14.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.775+0000 7fde35d9b700 1 -- 172.21.15.152:0/3672314092 learned_addr learned my addr 172.21.15.152:0/3672314092 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:14.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde3659c700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6790/0 conn(0x7fde38062da0 legacy=0x7fde38133770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 10 client.?.objecter ms_handle_connect 0x7fde38062da0 2021-02-24T15:22:14.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:14.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 10 client.?.objecter ms_handle_connect 0x7fde38063220 2021-02-24T15:22:14.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:14.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde35d9b700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6789/0 conn(0x7fde38063220 legacy=0x7fde38133e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 10 client.?.objecter ms_handle_connect 0x7fde38099340 2021-02-24T15:22:14.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:14.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde36d9d700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.181:6789/0 conn(0x7fde38099340 legacy=0x7fde38142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103577718 0 0) 0x7fde38095450 con 0x7fde38062da0 2021-02-24T15:22:14.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde1c004bd0 con 0x7fde38062da0 2021-02-24T15:22:14.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247712291 0 0) 0x7fde380998b0 con 0x7fde38063220 2021-02-24T15:22:14.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde38095450 con 0x7fde38063220 2021-02-24T15:22:14.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456448188 0 0) 0x7fde38126250 con 0x7fde38099340 2021-02-24T15:22:14.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde380998b0 con 0x7fde38099340 2021-02-24T15:22:14.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3743362816 0 0) 0x7fde1c004bd0 con 0x7fde38062da0 2021-02-24T15:22:14.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde38126250 con 0x7fde38062da0 2021-02-24T15:22:14.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fde28001c60 con 0x7fde38062da0 2021-02-24T15:22:14.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3278078021 0 0) 0x7fde38095450 con 0x7fde38063220 2021-02-24T15:22:14.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.777+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde1c004bd0 con 0x7fde38063220 2021-02-24T15:22:14.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fde200019a0 con 0x7fde38063220 2021-02-24T15:22:14.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4050319202 0 0) 0x7fde38126250 con 0x7fde38062da0 2021-02-24T15:22:14.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.181:6789/0 conn(0x7fde38099340 legacy=0x7fde38142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6789/0 conn(0x7fde38063220 legacy=0x7fde38133e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde380956f0 con 0x7fde38062da0 2021-02-24T15:22:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde38093600 con 0x7fde38062da0 2021-02-24T15:22:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde3cef1700 10 client.74135.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fde38092a40 con 0x7fde38062da0 2021-02-24T15:22:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde3cef1700 1 librados: init done 2021-02-24T15:22:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fde28004860 con 0x7fde38062da0 2021-02-24T15:22:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fde28004b70 con 0x7fde38062da0 2021-02-24T15:22:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.778+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fde28004d50 con 0x7fde38062da0 2021-02-24T15:22:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.779+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fde10006550 con 0x7fde100027f0 2021-02-24T15:22:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.779+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(259..259 src has 66..259) v4 ==== 5259+0+0 (unknown 2962860947 0 0) 0x7fde2803afa0 con 0x7fde38062da0 2021-02-24T15:22:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.779+0000 7fde2e7fc700 10 client.74135.objecter ms_dispatch 0x7fde38001510 osd_map(259..259 src has 66..259) v4 2021-02-24T15:22:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.779+0000 7fde2e7fc700 3 client.74135.objecter handle_osd_map got epochs [259,259] > 0 2021-02-24T15:22:14.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.779+0000 7fde2e7fc700 3 client.74135.objecter handle_osd_map decoding full epoch 259 2021-02-24T15:22:14.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.779+0000 7fde2e7fc700 20 client.74135.objecter dump_active .. 0 homeless 2021-02-24T15:22:14.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 10 client.74135.objecter ms_handle_connect 0x7fde100027f0 2021-02-24T15:22:14.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 10 client.74135.objecter resend_mon_ops 2021-02-24T15:22:14.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde35d9b700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6789/0 conn(0x7fde100027f0 legacy=0x7fde10004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683308124 0 0) 0x7fde10006550 con 0x7fde100027f0 2021-02-24T15:22:14.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde38126250 con 0x7fde100027f0 2021-02-24T15:22:14.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1821193427 0 0) 0x7fde38126250 con 0x7fde100027f0 2021-02-24T15:22:14.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde10006550 con 0x7fde100027f0 2021-02-24T15:22:14.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fde20002300 con 0x7fde100027f0 2021-02-24T15:22:14.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 10 client.74135.objecter ms_handle_connect 0x7fde1c031730 2021-02-24T15:22:14.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3676674319 0 0) 0x7fde10006550 con 0x7fde100027f0 2021-02-24T15:22:14.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde10009df0 con 0x7fde100027f0 2021-02-24T15:22:14.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.781+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fde20002690 con 0x7fde100027f0 2021-02-24T15:22:14.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.782+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6789/0 conn(0x7fde100027f0 legacy=0x7fde10004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.782+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6789/0 conn(0x7fde100027f0 legacy=0x7fde10004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:14.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.789+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fde10007520 con 0x7fde100068c0 2021-02-24T15:22:14.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde35d9b700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6789/0 conn(0x7fde100068c0 legacy=0x7fde10006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 10 client.74135.objecter ms_handle_connect 0x7fde100068c0 2021-02-24T15:22:14.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 10 client.74135.objecter resend_mon_ops 2021-02-24T15:22:14.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76286600 0 0) 0x7fde10007520 con 0x7fde100068c0 2021-02-24T15:22:14.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde10006550 con 0x7fde100068c0 2021-02-24T15:22:14.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 345048968 0 0) 0x7fde10006550 con 0x7fde100068c0 2021-02-24T15:22:14.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde10007520 con 0x7fde100068c0 2021-02-24T15:22:14.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fde20002d60 con 0x7fde100068c0 2021-02-24T15:22:14.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 90533020 0 0) 0x7fde10007520 con 0x7fde100068c0 2021-02-24T15:22:14.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fde10008720 con 0x7fde100068c0 2021-02-24T15:22:14.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3942 (unknown 0 0 1928201574) 0x7fde200076c0 con 0x7fde100068c0 2021-02-24T15:22:14.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6789/0 conn(0x7fde100068c0 legacy=0x7fde10006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.792+0000 7fde2e7fc700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6789/0 conn(0x7fde100068c0 legacy=0x7fde10006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:14.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 10 librados: watch_flush enter 2021-02-24T15:22:14.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 10 librados: watch_flush exit 2021-02-24T15:22:14.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 20 client.74135.objecter shutdown clearing up homeless session... 2021-02-24T15:22:14.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 10 client.74135.objecter successfully canceled tick 2021-02-24T15:22:14.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.181:6812/33484 conn(0x7fde1c031730 legacy=0x7fde1c033bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 >> v1:172.21.15.152:6790/0 conn(0x7fde38062da0 legacy=0x7fde38133770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde36d9d700 1 -- 172.21.15.152:0/3672314092 reap_dead start 2021-02-24T15:22:14.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde36d9d700 1 -- 172.21.15.152:0/3672314092 reap_dead start 2021-02-24T15:22:14.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 shutdown_connections 2021-02-24T15:22:14.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 >> 172.21.15.152:0/3672314092 conn(0x7fde3809dcc0 msgr2=0x7fde3809c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:14.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 shutdown_connections 2021-02-24T15:22:14.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 1 -- 172.21.15.152:0/3672314092 wait complete. 2021-02-24T15:22:14.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.793+0000 7fde3cef1700 1 librados: shutdown 2021-02-24T15:22:14.810 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:22:14.810 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:14.810 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:14.811 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:22:14.811 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 28, 2021-02-24T15:22:14.811 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:22:14.811 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:22:14.812 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:22:14.812 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:22:14.812 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:14.812 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 2, 2021-02-24T15:22:14.812 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:14.813 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:22:14.813 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:22:14.813 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:14.813 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:14.813 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:14.814 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:14.814 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:14.814 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:14.814 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:14.814 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:14.815 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:14.815 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:14.815 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:22:14.815 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:22:14.815 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:14.816 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:14.816 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:14.816 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:14.816 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:14.817 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:14.817 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:14.817 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:14.817 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:14.817 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:14.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:14.818 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:22:14.818 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:22:14.818 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:22:14.818 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:22:14.819 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:22:14.819 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:22:14.819 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:14.819 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:14.819 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:22:14.820 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:22:14.820 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:22:14.820 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:22:14.820 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:22:14.820 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:14.821 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:22:14.821 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:14.821 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:14.821 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:14.822 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:14.822 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:14.822 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:14.822 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:14.822 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:14.823 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:14.823 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:14.823 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:22:14.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:14.823 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:22:14.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:14.824 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:14.824 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:14.824 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:14.824 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:14.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:14.825 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:14.825 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:22:14.825 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:14.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:14.826 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:14.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:14.826 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:22:14.826 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:22:14.826 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:14.827 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:14.827 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:14.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:14.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:14.827 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:14.828 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:14.828 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:14.828 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:14.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:14.829 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:14.830 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:22:14.830 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:14.830 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:14.830 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:14.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:14.831 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:22:14.831 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:22:14.831 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:14.832 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:14.832 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:14.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:14.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:14.832 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:14.833 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:14.833 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:14.833 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:14.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:14.833 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:14.834 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:22:14.834 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:14.834 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:14.834 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:14.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:14.835 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:22:14.835 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:22:14.836 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:14.836 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:14.836 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:14.837 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:14.837 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:14.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:14.838 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:22:14.838 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:22:14.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:14.838 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:14.839 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:14.839 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:14.839 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:14.839 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:14.839 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:22:14.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:14.840 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:14.840 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:14.840 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:22:14.840 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:14.841 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:14.841 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:22:14.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:14.841 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:14.842 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:14.842 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:22:14.842 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:14.842 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:14.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:14.843 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:22:14.843 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:22:14.844 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:22:14.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.959+0000 7ff6f9d2a700 1 Processor -- start 2021-02-24T15:22:14.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.959+0000 7ff6f9d2a700 1 -- start start 2021-02-24T15:22:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.960+0000 7ff6f9d2a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f40688c0 con 0x7ff6f4090640 2021-02-24T15:22:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.960+0000 7ff6f9d2a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f4068af0 con 0x7ff6f40974d0 2021-02-24T15:22:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.960+0000 7ff6f9d2a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f4068530 con 0x7ff6f4130e30 2021-02-24T15:22:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.960+0000 7ff6f3fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff6f4130e30 0x7ff6f4133220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36274/0 (socket says 172.21.15.152:36274) 2021-02-24T15:22:14.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.960+0000 7ff6f2ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff6f4090640 0x7ff6f4090ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47796/0 (socket says 172.21.15.152:47796) 2021-02-24T15:22:14.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.960+0000 7ff6f3fff700 1 -- 172.21.15.152:0/3132222088 learned_addr learned my addr 172.21.15.152:0/3132222088 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:14.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f3fff700 1 -- 172.21.15.152:0/3132222088 >> v1:172.21.15.152:6790/0 conn(0x7ff6f4130e30 legacy=0x7ff6f4133220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f2ffd700 1 -- 172.21.15.152:0/3132222088 >> v1:172.21.15.152:6789/0 conn(0x7ff6f4090640 legacy=0x7ff6f4090ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f37fe700 1 -- 172.21.15.152:0/3132222088 >> v1:172.21.15.181:6789/0 conn(0x7ff6f40974d0 legacy=0x7ff6f4127aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512868823 0 0) 0x7ff6f4068530 con 0x7ff6f4130e30 2021-02-24T15:22:14.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e0003230 con 0x7ff6f4130e30 2021-02-24T15:22:14.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655540447 0 0) 0x7ff6f40688c0 con 0x7ff6f4090640 2021-02-24T15:22:14.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f4068530 con 0x7ff6f4090640 2021-02-24T15:22:14.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2996191449 0 0) 0x7ff6f4068530 con 0x7ff6f4090640 2021-02-24T15:22:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 >> v1:172.21.15.152:6790/0 conn(0x7ff6f4130e30 legacy=0x7ff6f4133220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 >> v1:172.21.15.181:6789/0 conn(0x7ff6f40974d0 legacy=0x7ff6f4127aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4067fd0 con 0x7ff6f4090640 2021-02-24T15:22:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6e8001930 con 0x7ff6f4090640 2021-02-24T15:22:14.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f2ffd700 1 --1- 172.21.15.152:0/3132222088 >> v1:172.21.15.152:6789/0 conn(0x7ff6f4090640 0x7ff6f4090ac0 :-1 s=OPENED pgs=8986 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7ff6e8004690 mon_map magic: 0 v1 2021-02-24T15:22:14.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.962+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6e8001c40 con 0x7ff6f4090640 2021-02-24T15:22:14.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.963+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/3132222088 >> v1:172.21.15.152:6789/0 conn(0x7ff6f4090640 legacy=0x7ff6f4090ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.963+0000 7ff6f27fc700 1 -- 172.21.15.152:0/3132222088 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6e8004690 con 0x7ff6f4090640 2021-02-24T15:22:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.963+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/3132222088 shutdown_connections 2021-02-24T15:22:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.963+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/3132222088 >> 172.21.15.152:0/3132222088 conn(0x7ff6f409ab10 msgr2=0x7ff6f4096ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:14.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.963+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/3132222088 shutdown_connections 2021-02-24T15:22:14.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.963+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/3132222088 wait complete. 2021-02-24T15:22:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f9d2a700 1 librados: starting msgr at 2021-02-24T15:22:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f9d2a700 1 librados: starting objecter 2021-02-24T15:22:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f9d2a700 1 Processor -- start 2021-02-24T15:22:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f9d2a700 1 -- start start 2021-02-24T15:22:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f9d2a700 1 librados: setting wanted keys 2021-02-24T15:22:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f9d2a700 1 librados: calling monclient init 2021-02-24T15:22:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f9d2a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f4134630 con 0x7ff6f4090640 2021-02-24T15:22:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f9d2a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f4093650 con 0x7ff6f40974d0 2021-02-24T15:22:14.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f9d2a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f4092b60 con 0x7ff6f4130e30 2021-02-24T15:22:14.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f37fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff6f4090640 0x7ff6f4093a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47800/0 (socket says 172.21.15.152:47800) 2021-02-24T15:22:14.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.964+0000 7ff6f37fe700 1 -- 172.21.15.152:0/4128270717 learned_addr learned my addr 172.21.15.152:0/4128270717 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6f37fe700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6789/0 conn(0x7ff6f4090640 legacy=0x7ff6f4093a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6f3fff700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6790/0 conn(0x7ff6f4130e30 legacy=0x7ff6f4142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 10 client.?.objecter ms_handle_connect 0x7ff6f4090640 2021-02-24T15:22:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 10 client.?.objecter ms_handle_connect 0x7ff6f4130e30 2021-02-24T15:22:14.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429440269 0 0) 0x7ff6f4134630 con 0x7ff6f4090640 2021-02-24T15:22:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d4004bd0 con 0x7ff6f4090640 2021-02-24T15:22:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641874510 0 0) 0x7ff6f4092b60 con 0x7ff6f4130e30 2021-02-24T15:22:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f4134630 con 0x7ff6f4130e30 2021-02-24T15:22:14.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 10 client.?.objecter ms_handle_connect 0x7ff6f40974d0 2021-02-24T15:22:14.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:14.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6f2ffd700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.181:6789/0 conn(0x7ff6f40974d0 legacy=0x7ff6f413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 999733706 0 0) 0x7ff6f4134630 con 0x7ff6f4130e30 2021-02-24T15:22:14.981 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6f4092b60 con 0x7ff6f4130e30 2021-02-24T15:22:14.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6ec001fe0 con 0x7ff6f4130e30 2021-02-24T15:22:14.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1978824389 0 0) 0x7ff6d4004bd0 con 0x7ff6f4090640 2021-02-24T15:22:14.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6f4134630 con 0x7ff6f4090640 2021-02-24T15:22:14.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159153815 0 0) 0x7ff6f4093650 con 0x7ff6f40974d0 2021-02-24T15:22:14.982 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d4004bd0 con 0x7ff6f40974d0 2021-02-24T15:22:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6e4001c40 con 0x7ff6f4090640 2021-02-24T15:22:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3198845952 0 0) 0x7ff6f4092b60 con 0x7ff6f4130e30 2021-02-24T15:22:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.181:6789/0 conn(0x7ff6f40974d0 legacy=0x7ff6f413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6789/0 conn(0x7ff6f4090640 legacy=0x7ff6f4093a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4092dc0 con 0x7ff6f4130e30 2021-02-24T15:22:14.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f4094120 con 0x7ff6f4130e30 2021-02-24T15:22:14.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6f9d2a700 10 client.74141.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:14.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f408dbc0 con 0x7ff6f4130e30 2021-02-24T15:22:14.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6f9d2a700 1 librados: init done 2021-02-24T15:22:14.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6ec004bf0 con 0x7ff6f4130e30 2021-02-24T15:22:14.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.967+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6ec004f00 con 0x7ff6f4130e30 2021-02-24T15:22:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.968+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff6ec005120 con 0x7ff6f4130e30 2021-02-24T15:22:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.968+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff6cc006550 con 0x7ff6cc0027f0 2021-02-24T15:22:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.968+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(259..259 src has 66..259) v4 ==== 5259+0+0 (unknown 2962860947 0 0) 0x7ff6ec03b410 con 0x7ff6f4130e30 2021-02-24T15:22:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.968+0000 7ff6db7fe700 10 client.74141.objecter ms_dispatch 0x7ff6f4001510 osd_map(259..259 src has 66..259) v4 2021-02-24T15:22:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.968+0000 7ff6db7fe700 3 client.74141.objecter handle_osd_map got epochs [259,259] > 0 2021-02-24T15:22:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.968+0000 7ff6db7fe700 3 client.74141.objecter handle_osd_map decoding full epoch 259 2021-02-24T15:22:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.968+0000 7ff6db7fe700 20 client.74141.objecter dump_active .. 0 homeless 2021-02-24T15:22:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.970+0000 7ff6db7fe700 10 client.74141.objecter ms_handle_connect 0x7ff6cc0027f0 2021-02-24T15:22:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.970+0000 7ff6db7fe700 10 client.74141.objecter resend_mon_ops 2021-02-24T15:22:14.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.970+0000 7ff6f37fe700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6790/0 conn(0x7ff6cc0027f0 legacy=0x7ff6cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.970+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489024775 0 0) 0x7ff6cc006550 con 0x7ff6cc0027f0 2021-02-24T15:22:14.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.970+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f4092b60 con 0x7ff6cc0027f0 2021-02-24T15:22:14.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.971+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3711892324 0 0) 0x7ff6f4092b60 con 0x7ff6cc0027f0 2021-02-24T15:22:14.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.971+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6cc006550 con 0x7ff6cc0027f0 2021-02-24T15:22:14.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.971+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6e4002380 con 0x7ff6cc0027f0 2021-02-24T15:22:14.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.971+0000 7ff6db7fe700 10 client.74141.objecter ms_handle_connect 0x7ff6d40316d0 2021-02-24T15:22:14.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.971+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1314195476 0 0) 0x7ff6cc006550 con 0x7ff6cc0027f0 2021-02-24T15:22:14.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.971+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6cc009df0 con 0x7ff6cc0027f0 2021-02-24T15:22:14.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.971+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7ff6e4002690 con 0x7ff6cc0027f0 2021-02-24T15:22:14.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.971+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6790/0 conn(0x7ff6cc0027f0 legacy=0x7ff6cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.971+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6790/0 conn(0x7ff6cc0027f0 legacy=0x7ff6cc004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:14.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.979+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff6cc007520 con 0x7ff6cc0068c0 2021-02-24T15:22:14.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6db7fe700 10 client.74141.objecter ms_handle_connect 0x7ff6cc0068c0 2021-02-24T15:22:14.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6db7fe700 10 client.74141.objecter resend_mon_ops 2021-02-24T15:22:14.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6f37fe700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6790/0 conn(0x7ff6cc0068c0 legacy=0x7ff6cc006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:14.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525418368 0 0) 0x7ff6cc007520 con 0x7ff6cc0068c0 2021-02-24T15:22:14.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6cc006550 con 0x7ff6cc0068c0 2021-02-24T15:22:14.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2408493199 0 0) 0x7ff6cc006550 con 0x7ff6cc0068c0 2021-02-24T15:22:14.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6cc007520 con 0x7ff6cc0068c0 2021-02-24T15:22:14.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6e4002d20 con 0x7ff6cc0068c0 2021-02-24T15:22:14.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2579479894 0 0) 0x7ff6cc007520 con 0x7ff6cc0068c0 2021-02-24T15:22:14.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.981+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff6cc008720 con 0x7ff6cc0068c0 2021-02-24T15:22:14.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 2134470443) 0x7ff6e4006ed0 con 0x7ff6cc0068c0 2021-02-24T15:22:14.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6790/0 conn(0x7ff6cc0068c0 legacy=0x7ff6cc006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6db7fe700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6790/0 conn(0x7ff6cc0068c0 legacy=0x7ff6cc006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:14.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 10 librados: watch_flush enter 2021-02-24T15:22:14.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 10 librados: watch_flush exit 2021-02-24T15:22:14.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 20 client.74141.objecter shutdown clearing up homeless session... 2021-02-24T15:22:14.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 10 client.74141.objecter successfully canceled tick 2021-02-24T15:22:14.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.181:6812/33484 conn(0x7ff6d40316d0 legacy=0x7ff6d4033b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 >> v1:172.21.15.152:6790/0 conn(0x7ff6f4130e30 legacy=0x7ff6f4142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:14.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f3fff700 1 -- 172.21.15.152:0/4128270717 reap_dead start 2021-02-24T15:22:14.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f3fff700 1 -- 172.21.15.152:0/4128270717 reap_dead start 2021-02-24T15:22:14.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 shutdown_connections 2021-02-24T15:22:14.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 >> 172.21.15.152:0/4128270717 conn(0x7ff6f409ab10 msgr2=0x7ff6f40872d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:14.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 shutdown_connections 2021-02-24T15:22:14.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 1 -- 172.21.15.152:0/4128270717 wait complete. 2021-02-24T15:22:14.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:14.982+0000 7ff6f9d2a700 1 librados: shutdown 2021-02-24T15:22:14.999 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:22:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:22:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 28, 2021-02-24T15:22:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:22:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:22:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:22:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:22:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 2, 2021-02-24T15:22:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:22:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:22:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:22:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:22:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:22:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:22:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:22:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:22:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:22:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:22:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:22:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:22:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:22:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:22:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:22:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:22:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:22:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:22:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:22:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:22:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:22:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:22:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:22:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:22:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:22:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:22:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:22:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:22:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:22:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:22:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:22:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:22:15.030 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:22:15.032 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:22:15.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.156+0000 7fac813ac700 1 Processor -- start 2021-02-24T15:22:15.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.156+0000 7fac813ac700 1 -- start start 2021-02-24T15:22:15.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.156+0000 7fac813ac700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c097d40 con 0x7fac7c063220 2021-02-24T15:22:15.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.156+0000 7fac813ac700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c063d00 con 0x7fac7c062da0 2021-02-24T15:22:15.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.156+0000 7fac813ac700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c097980 con 0x7fac7c099340 2021-02-24T15:22:15.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.156+0000 7fac7b7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fac7c063220 0x7fac7c133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47820/0 (socket says 172.21.15.152:47820) 2021-02-24T15:22:15.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.156+0000 7fac7b7fe700 1 -- 172.21.15.152:0/2028148555 learned_addr learned my addr 172.21.15.152:0/2028148555 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:15.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac7b7fe700 1 -- 172.21.15.152:0/2028148555 >> v1:172.21.15.152:6789/0 conn(0x7fac7c063220 legacy=0x7fac7c133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac7affd700 1 -- 172.21.15.152:0/2028148555 >> v1:172.21.15.152:6790/0 conn(0x7fac7c099340 legacy=0x7fac7c097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac79ffb700 1 -- 172.21.15.152:0/2028148555 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904444391 0 0) 0x7fac7c097d40 con 0x7fac7c063220 2021-02-24T15:22:15.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac79ffb700 1 -- 172.21.15.152:0/2028148555 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac68003230 con 0x7fac7c063220 2021-02-24T15:22:15.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac7a7fc700 1 -- 172.21.15.152:0/2028148555 >> v1:172.21.15.181:6789/0 conn(0x7fac7c062da0 legacy=0x7fac7c12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac79ffb700 1 -- 172.21.15.152:0/2028148555 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4198571895 0 0) 0x7fac68003230 con 0x7fac7c063220 2021-02-24T15:22:15.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac79ffb700 1 -- 172.21.15.152:0/2028148555 >> v1:172.21.15.152:6790/0 conn(0x7fac7c099340 legacy=0x7fac7c097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac79ffb700 1 -- 172.21.15.152:0/2028148555 >> v1:172.21.15.181:6789/0 conn(0x7fac7c062da0 legacy=0x7fac7c12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac79ffb700 1 -- 172.21.15.152:0/2028148555 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c08fac0 con 0x7fac7c063220 2021-02-24T15:22:15.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac79ffb700 1 -- 172.21.15.152:0/2028148555 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fac74001cb0 con 0x7fac7c063220 2021-02-24T15:22:15.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac79ffb700 1 -- 172.21.15.152:0/2028148555 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fac74001fc0 con 0x7fac7c063220 2021-02-24T15:22:15.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.159+0000 7fac79ffb700 1 -- 172.21.15.152:0/2028148555 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fac74004ad0 con 0x7fac7c063220 2021-02-24T15:22:15.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.160+0000 7fac813ac700 1 -- 172.21.15.152:0/2028148555 >> v1:172.21.15.152:6789/0 conn(0x7fac7c063220 legacy=0x7fac7c133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.160+0000 7fac813ac700 1 -- 172.21.15.152:0/2028148555 shutdown_connections 2021-02-24T15:22:15.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.160+0000 7fac813ac700 1 -- 172.21.15.152:0/2028148555 >> 172.21.15.152:0/2028148555 conn(0x7fac7c09dcc0 msgr2=0x7fac7c09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:15.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.160+0000 7fac813ac700 1 -- 172.21.15.152:0/2028148555 shutdown_connections 2021-02-24T15:22:15.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.160+0000 7fac813ac700 1 -- 172.21.15.152:0/2028148555 wait complete. 2021-02-24T15:22:15.169 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac813ac700 1 librados: starting msgr at 2021-02-24T15:22:15.170 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac813ac700 1 librados: starting objecter 2021-02-24T15:22:15.170 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac813ac700 1 Processor -- start 2021-02-24T15:22:15.170 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac813ac700 1 -- start start 2021-02-24T15:22:15.170 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac813ac700 1 librados: setting wanted keys 2021-02-24T15:22:15.171 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac813ac700 1 librados: calling monclient init 2021-02-24T15:22:15.171 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac813ac700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c092160 con 0x7fac7c063220 2021-02-24T15:22:15.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac813ac700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c1280d0 con 0x7fac7c062da0 2021-02-24T15:22:15.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac813ac700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c094260 con 0x7fac7c099340 2021-02-24T15:22:15.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac7b7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fac7c099340 0x7fac7c142240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36302/0 (socket says 172.21.15.152:36302) 2021-02-24T15:22:15.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac7a7fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fac7c063220 0x7fac7c096720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47824/0 (socket says 172.21.15.152:47824) 2021-02-24T15:22:15.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.161+0000 7fac7b7fe700 1 -- 172.21.15.152:0/152318474 learned_addr learned my addr 172.21.15.152:0/152318474 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:15.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac7b7fe700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.152:6790/0 conn(0x7fac7c099340 legacy=0x7fac7c142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac7a7fc700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.152:6789/0 conn(0x7fac7c063220 legacy=0x7fac7c096720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 10 client.?.objecter ms_handle_connect 0x7fac7c099340 2021-02-24T15:22:15.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:15.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 10 client.?.objecter ms_handle_connect 0x7fac7c063220 2021-02-24T15:22:15.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:15.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 10 client.?.objecter ms_handle_connect 0x7fac7c062da0 2021-02-24T15:22:15.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:15.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac7affd700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6789/0 conn(0x7fac7c062da0 legacy=0x7fac7c13a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846722198 0 0) 0x7fac7c092160 con 0x7fac7c063220 2021-02-24T15:22:15.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac5c004bd0 con 0x7fac7c063220 2021-02-24T15:22:15.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551030627 0 0) 0x7fac7c094260 con 0x7fac7c099340 2021-02-24T15:22:15.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac7c092160 con 0x7fac7c099340 2021-02-24T15:22:15.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac7affd700 1 --1- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6789/0 conn(0x7fac7c062da0 0x7fac7c13a0b0 :-1 s=OPENED pgs=742 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7fac7c1280d0 auth_reply(proto 2 0 (0) Success) v1 2021-02-24T15:22:15.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3795171315 0 0) 0x7fac5c004bd0 con 0x7fac7c063220 2021-02-24T15:22:15.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fac7c094260 con 0x7fac7c063220 2021-02-24T15:22:15.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fac70001b60 con 0x7fac7c063220 2021-02-24T15:22:15.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 767693167 0 0) 0x7fac7c092160 con 0x7fac7c099340 2021-02-24T15:22:15.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fac5c004bd0 con 0x7fac7c099340 2021-02-24T15:22:15.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fac74001c70 con 0x7fac7c099340 2021-02-24T15:22:15.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2854410239 0 0) 0x7fac7c094260 con 0x7fac7c063220 2021-02-24T15:22:15.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.152:6790/0 conn(0x7fac7c099340 legacy=0x7fac7c142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6789/0 conn(0x7fac7c062da0 legacy=0x7fac7c13a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c0998b0 con 0x7fac7c063220 2021-02-24T15:22:15.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453370306 0 0) 0x7fac7c1280d0 con 0x7fac7c062da0 2021-02-24T15:22:15.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7c13a7c0 con 0x7fac7c063220 2021-02-24T15:22:15.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac813ac700 10 client.28077.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:15.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c096ff0 con 0x7fac7c063220 2021-02-24T15:22:15.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac813ac700 1 librados: init done 2021-02-24T15:22:15.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fac70002230 con 0x7fac7c063220 2021-02-24T15:22:15.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.164+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fac70002540 con 0x7fac7c063220 2021-02-24T15:22:15.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.165+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fac700026a0 con 0x7fac7c063220 2021-02-24T15:22:15.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.165+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(260..260 src has 66..260) v4 ==== 5341+0+0 (unknown 2635226971 0 0) 0x7fac7003aee0 con 0x7fac7c063220 2021-02-24T15:22:15.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.165+0000 7fac62ffd700 10 client.28077.objecter ms_dispatch 0x7fac7c001510 osd_map(260..260 src has 66..260) v4 2021-02-24T15:22:15.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.165+0000 7fac62ffd700 3 client.28077.objecter handle_osd_map got epochs [260,260] > 0 2021-02-24T15:22:15.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.165+0000 7fac62ffd700 3 client.28077.objecter handle_osd_map decoding full epoch 260 2021-02-24T15:22:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.165+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fac54006550 con 0x7fac540027f0 2021-02-24T15:22:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.165+0000 7fac62ffd700 20 client.28077.objecter dump_active .. 0 homeless 2021-02-24T15:22:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 10 client.28077.objecter ms_handle_connect 0x7fac540027f0 2021-02-24T15:22:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 10 client.28077.objecter resend_mon_ops 2021-02-24T15:22:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac7b7fe700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6789/0 conn(0x7fac540027f0 legacy=0x7fac54004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 10 client.28077.objecter ms_handle_connect 0x7fac5c0315a0 2021-02-24T15:22:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602264392 0 0) 0x7fac54006550 con 0x7fac540027f0 2021-02-24T15:22:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac7c1280d0 con 0x7fac540027f0 2021-02-24T15:22:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2048289266 0 0) 0x7fac7c1280d0 con 0x7fac540027f0 2021-02-24T15:22:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fac54006550 con 0x7fac540027f0 2021-02-24T15:22:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fac74005070 con 0x7fac540027f0 2021-02-24T15:22:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3461976329 0 0) 0x7fac54006550 con 0x7fac540027f0 2021-02-24T15:22:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac54009df0 con 0x7fac540027f0 2021-02-24T15:22:15.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.168+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fac74005250 con 0x7fac540027f0 2021-02-24T15:22:15.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.169+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6789/0 conn(0x7fac540027f0 legacy=0x7fac54004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.169+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6789/0 conn(0x7fac540027f0 legacy=0x7fac54004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:15.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.176+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fac54009a80 con 0x7fac54008da0 2021-02-24T15:22:15.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac62ffd700 10 client.28077.objecter ms_handle_connect 0x7fac54008da0 2021-02-24T15:22:15.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac62ffd700 10 client.28077.objecter resend_mon_ops 2021-02-24T15:22:15.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac7b7fe700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6789/0 conn(0x7fac54008da0 legacy=0x7fac54009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316672320 0 0) 0x7fac54009a80 con 0x7fac54008da0 2021-02-24T15:22:15.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac54006550 con 0x7fac54008da0 2021-02-24T15:22:15.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2998232102 0 0) 0x7fac54006550 con 0x7fac54008da0 2021-02-24T15:22:15.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fac54009a80 con 0x7fac54008da0 2021-02-24T15:22:15.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fac740059d0 con 0x7fac54008da0 2021-02-24T15:22:15.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2916216125 0 0) 0x7fac54009a80 con 0x7fac54008da0 2021-02-24T15:22:15.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.179+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fac540086f0 con 0x7fac54008da0 2021-02-24T15:22:15.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4110 (unknown 0 0 3227234225) 0x7fac74007020 con 0x7fac54008da0 2021-02-24T15:22:15.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6789/0 conn(0x7fac54008da0 legacy=0x7fac54009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.189 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac62ffd700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6789/0 conn(0x7fac54008da0 legacy=0x7fac54009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:15.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 10 librados: watch_flush enter 2021-02-24T15:22:15.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 10 librados: watch_flush exit 2021-02-24T15:22:15.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 20 client.28077.objecter shutdown clearing up homeless session... 2021-02-24T15:22:15.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 10 client.28077.objecter successfully canceled tick 2021-02-24T15:22:15.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.181:6812/33484 conn(0x7fac5c0315a0 legacy=0x7fac5c033a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 >> v1:172.21.15.152:6789/0 conn(0x7fac7c063220 legacy=0x7fac7c096720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac7b7fe700 1 -- 172.21.15.152:0/152318474 reap_dead start 2021-02-24T15:22:15.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac7b7fe700 1 -- 172.21.15.152:0/152318474 reap_dead start 2021-02-24T15:22:15.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 shutdown_connections 2021-02-24T15:22:15.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 >> 172.21.15.152:0/152318474 conn(0x7fac7c09dcc0 msgr2=0x7fac7c09c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:15.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 shutdown_connections 2021-02-24T15:22:15.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 1 -- 172.21.15.152:0/152318474 wait complete. 2021-02-24T15:22:15.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.180+0000 7fac813ac700 1 librados: shutdown 2021-02-24T15:22:15.192 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:22:15.193 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:15.193 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:15.193 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:22:15.193 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 28, 2021-02-24T15:22:15.194 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:22:15.194 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:22:15.194 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:22:15.194 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:22:15.194 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.195 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:22:15.195 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:15.195 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:22:15.195 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:22:15.195 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:15.196 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:15.196 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:15.196 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:15.196 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:15.196 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:15.197 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:15.197 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:15.197 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:15.197 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.198 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:22:15.198 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:22:15.198 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:15.198 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:15.198 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:15.199 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:15.199 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:15.199 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:15.199 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:15.199 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:15.200 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:15.200 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.200 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:22:15.201 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:22:15.201 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:22:15.201 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:22:15.201 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:22:15.201 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:22:15.202 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:15.202 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:15.202 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:22:15.202 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:22:15.202 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:22:15.203 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:22:15.203 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:22:15.203 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:15.203 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:22:15.203 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:15.204 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:15.204 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:15.204 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:15.204 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:15.205 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:15.205 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:15.205 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:15.205 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:15.205 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.206 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:22:15.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.206 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:22:15.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.206 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:15.207 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:15.207 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:15.207 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:15.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.207 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:15.208 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:22:15.208 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:15.208 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.208 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.209 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:22:15.209 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:22:15.209 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:15.210 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:15.210 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:15.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.210 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:15.211 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:15.211 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:15.211 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:15.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.212 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:15.212 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:22:15.212 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:15.212 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.212 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.213 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:22:15.213 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:22:15.213 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:15.213 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:15.214 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:15.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.214 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:15.214 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:15.215 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:15.215 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:15.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.215 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:15.215 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:22:15.216 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:15.216 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.216 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.217 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:22:15.217 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:22:15.221 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:15.221 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:15.221 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:15.222 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.222 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.222 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:22:15.223 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:22:15.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.223 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:15.224 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:15.225 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:15.225 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.225 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.225 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:22:15.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.226 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:15.227 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:15.227 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:22:15.227 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.227 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.227 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:22:15.228 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.228 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:15.228 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:15.228 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:15.228 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.229 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:15.229 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:22:15.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:15.229 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:15.229 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:15.230 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:15.230 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:15.230 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:15.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:15.231 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:22:15.231 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:22:15.232 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2021-02-24T15:22:15.232 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2021-02-24T15:22:15.233 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2021-02-24T15:22:15.233 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2021-02-24T15:22:15.233 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-02-24T15:22:15.233 INFO:teuthology.orchestra.run:waiting for 300 2021-02-24T15:22:15.243 INFO:tasks.ceph.mon.c:Stopped 2021-02-24T15:22:15.243 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2021-02-24T15:22:15.244 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:22:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.397+0000 7f09b7b1c700 1 Processor -- start 2021-02-24T15:22:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.397+0000 7f09b7b1c700 1 -- start start 2021-02-24T15:22:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.398+0000 7f09b7b1c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b0097d40 con 0x7f09b0062da0 2021-02-24T15:22:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.398+0000 7f09b7b1c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b0063d00 con 0x7f09b0063220 2021-02-24T15:22:15.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.398+0000 7f09b7b1c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b0097980 con 0x7f09b0099340 2021-02-24T15:22:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.398+0000 7f09b58b8700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f09b0099340 legacy=0x7f09b0097270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.398+0000 7f09b50b7700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f09b0062da0 0x7f09b012fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47834/0 (socket says 172.21.15.152:47834) 2021-02-24T15:22:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.398+0000 7f09b50b7700 1 -- 172.21.15.152:0/3831916494 learned_addr learned my addr 172.21.15.152:0/3831916494 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:15.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.400+0000 7f09b50b7700 1 -- 172.21.15.152:0/3831916494 >> v1:172.21.15.152:6789/0 conn(0x7f09b0062da0 legacy=0x7f09b012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.400+0000 7f09b60b9700 1 -- 172.21.15.152:0/3831916494 >> v1:172.21.15.181:6789/0 conn(0x7f09b0063220 legacy=0x7f09b0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.400+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301203054 0 0) 0x7f09b0097d40 con 0x7f09b0062da0 2021-02-24T15:22:15.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0998003230 con 0x7f09b0062da0 2021-02-24T15:22:15.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368974306 0 0) 0x7f09b0063d00 con 0x7f09b0063220 2021-02-24T15:22:15.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b0097d40 con 0x7f09b0063220 2021-02-24T15:22:15.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 486468190 0 0) 0x7f0998003230 con 0x7f09b0062da0 2021-02-24T15:22:15.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 >> v1:172.21.15.152:6790/0 conn(0x7f09b0099340 legacy=0x7f09b0097270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:22:15.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 >> v1:172.21.15.181:6789/0 conn(0x7f09b0063220 legacy=0x7f09b0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b008fac0 con 0x7f09b0062da0 2021-02-24T15:22:15.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f09a0001930 con 0x7f09b0062da0 2021-02-24T15:22:15.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f09a0001c40 con 0x7f09b0062da0 2021-02-24T15:22:15.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b48b6700 1 -- 172.21.15.152:0/3831916494 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f09a0004750 con 0x7f09b0062da0 2021-02-24T15:22:15.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3831916494 >> v1:172.21.15.152:6789/0 conn(0x7f09b0062da0 legacy=0x7f09b012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3831916494 shutdown_connections 2021-02-24T15:22:15.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3831916494 >> 172.21.15.152:0/3831916494 conn(0x7f09b009dcc0 msgr2=0x7f09b009e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:15.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3831916494 shutdown_connections 2021-02-24T15:22:15.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.401+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3831916494 wait complete. 2021-02-24T15:22:15.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.402+0000 7f09b7b1c700 1 librados: starting msgr at 2021-02-24T15:22:15.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.402+0000 7f09b7b1c700 1 librados: starting objecter 2021-02-24T15:22:15.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.402+0000 7f09b7b1c700 1 Processor -- start 2021-02-24T15:22:15.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.402+0000 7f09b7b1c700 1 -- start start 2021-02-24T15:22:15.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.402+0000 7f09b7b1c700 1 librados: setting wanted keys 2021-02-24T15:22:15.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.402+0000 7f09b7b1c700 1 librados: calling monclient init 2021-02-24T15:22:15.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.403+0000 7f09b7b1c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b0095480 con 0x7f09b0099340 2021-02-24T15:22:15.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.403+0000 7f09b7b1c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b0095720 con 0x7f09b0063220 2021-02-24T15:22:15.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.403+0000 7f09b7b1c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00959c0 con 0x7f09b0062da0 2021-02-24T15:22:15.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.403+0000 7f09b58b8700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f09b0062da0 legacy=0x7f09b0139f20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:15.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.403+0000 7f09b60b9700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f09b0099340 0x7f09b0142270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47844/0 (socket says 172.21.15.152:47844) 2021-02-24T15:22:15.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.403+0000 7f09b60b9700 1 -- 172.21.15.152:0/3735015826 learned_addr learned my addr 172.21.15.152:0/3735015826 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:15.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f09b60b9700 1 -- 172.21.15.152:0/3735015826 >> v1:172.21.15.152:6789/0 conn(0x7f09b0099340 legacy=0x7f09b0142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 10 client.?.objecter ms_handle_connect 0x7f09b0099340 2021-02-24T15:22:15.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:15.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 10 client.?.objecter ms_handle_connect 0x7f09b0063220 2021-02-24T15:22:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f09b50b7700 1 -- 172.21.15.152:0/3735015826 >> v1:172.21.15.181:6789/0 conn(0x7f09b0063220 legacy=0x7f09b0096e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862512730 0 0) 0x7f09b0095480 con 0x7f09b0099340 2021-02-24T15:22:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0990004bd0 con 0x7f09b0099340 2021-02-24T15:22:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736050644 0 0) 0x7f09b0095720 con 0x7f09b0063220 2021-02-24T15:22:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b0095480 con 0x7f09b0063220 2021-02-24T15:22:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1059329781 0 0) 0x7f0990004bd0 con 0x7f09b0099340 2021-02-24T15:22:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f09b0095720 con 0x7f09b0099340 2021-02-24T15:22:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f09a8002010 con 0x7f09b0099340 2021-02-24T15:22:15.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 973309866 0 0) 0x7f09b0095480 con 0x7f09b0063220 2021-02-24T15:22:15.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0990004bd0 con 0x7f09b0063220 2021-02-24T15:22:15.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f09a00018f0 con 0x7f09b0063220 2021-02-24T15:22:15.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.405+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1767688085 0 0) 0x7f09b0095720 con 0x7f09b0099340 2021-02-24T15:22:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 >> v1:172.21.15.152:6790/0 conn(0x7f09b0062da0 legacy=0x7f09b0139f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:22:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 >> v1:172.21.15.181:6789/0 conn(0x7f09b0063220 legacy=0x7f09b0096e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b013ad50 con 0x7f09b0099340 2021-02-24T15:22:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b0093850 con 0x7f09b0099340 2021-02-24T15:22:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f09a80026a0 con 0x7f09b0099340 2021-02-24T15:22:15.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f09a80029b0 con 0x7f09b0099340 2021-02-24T15:22:15.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f09b7b1c700 10 client.28083.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:15.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b0097580 con 0x7f09b0099340 2021-02-24T15:22:15.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f09b7b1c700 1 librados: init done 2021-02-24T15:22:15.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.406+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f09a8002b10 con 0x7f09b0099340 2021-02-24T15:22:15.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.407+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(260..260 src has 66..260) v4 ==== 5341+0+0 (unknown 2635226971 0 0) 0x7f09a803b3c0 con 0x7f09b0099340 2021-02-24T15:22:15.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.407+0000 7f099dffb700 10 client.28083.objecter ms_dispatch 0x7f09b0001510 osd_map(260..260 src has 66..260) v4 2021-02-24T15:22:15.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.407+0000 7f099dffb700 3 client.28083.objecter handle_osd_map got epochs [260,260] > 0 2021-02-24T15:22:15.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.407+0000 7f099dffb700 3 client.28083.objecter handle_osd_map decoding full epoch 260 2021-02-24T15:22:15.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.407+0000 7f099dffb700 20 client.28083.objecter dump_active .. 0 homeless 2021-02-24T15:22:15.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.407+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b01268c0 con 0x7f09b0099340 2021-02-24T15:22:15.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.409+0000 7f099dffb700 10 client.28083.objecter ms_handle_connect 0x7f0990031440 2021-02-24T15:22:15.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.411+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f09a8012b00 con 0x7f09b0099340 2021-02-24T15:22:15.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.643+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f09b0095280 con 0x7f09b0099340 2021-02-24T15:22:15.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.644+0000 7f099dffb700 1 -- 172.21.15.152:0/3735015826 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 256601334) 0x7f09a80126f0 con 0x7f09b0099340 2021-02-24T15:22:15.645 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:22:15.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 10 librados: watch_flush enter 2021-02-24T15:22:15.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 10 librados: watch_flush exit 2021-02-24T15:22:15.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 20 client.28083.objecter shutdown clearing up homeless session... 2021-02-24T15:22:15.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 10 client.28083.objecter successfully canceled tick 2021-02-24T15:22:15.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 >> v1:172.21.15.181:6812/33484 conn(0x7f0990031440 legacy=0x7f0990033900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 >> v1:172.21.15.152:6789/0 conn(0x7f09b0099340 legacy=0x7f09b0142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:15.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 shutdown_connections 2021-02-24T15:22:15.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 >> 172.21.15.152:0/3735015826 conn(0x7f09b009dcc0 msgr2=0x7f09b009c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:15.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 shutdown_connections 2021-02-24T15:22:15.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 1 -- 172.21.15.152:0/3735015826 wait complete. 2021-02-24T15:22:15.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:15.645+0000 7f09b7b1c700 1 librados: shutdown 2021-02-24T15:22:18.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:22:18.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.786+0000 7f3e87f7e700 1 Processor -- start 2021-02-24T15:22:18.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.786+0000 7f3e87f7e700 1 -- start start 2021-02-24T15:22:18.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.787+0000 7f3e87f7e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e80097d40 con 0x7f3e80062da0 2021-02-24T15:22:18.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.787+0000 7f3e87f7e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e80063d00 con 0x7f3e80063220 2021-02-24T15:22:18.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.787+0000 7f3e87f7e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e80097980 con 0x7f3e80099340 2021-02-24T15:22:18.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.787+0000 7f3e85d1a700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f3e80099340 legacy=0x7f3e80097270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:18.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.787+0000 7f3e85519700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3e80062da0 0x7f3e8012fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47858/0 (socket says 172.21.15.152:47858) 2021-02-24T15:22:18.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.787+0000 7f3e85519700 1 -- 172.21.15.152:0/4101478238 learned_addr learned my addr 172.21.15.152:0/4101478238 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:18.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e85519700 1 -- 172.21.15.152:0/4101478238 >> v1:172.21.15.152:6789/0 conn(0x7f3e80062da0 legacy=0x7f3e8012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:18.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e84d18700 1 -- 172.21.15.152:0/4101478238 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380440095 0 0) 0x7f3e80097d40 con 0x7f3e80062da0 2021-02-24T15:22:18.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e84d18700 1 -- 172.21.15.152:0/4101478238 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e68003230 con 0x7f3e80062da0 2021-02-24T15:22:18.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e84d18700 1 -- 172.21.15.152:0/4101478238 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1973557024 0 0) 0x7f3e68003230 con 0x7f3e80062da0 2021-02-24T15:22:18.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e84d18700 1 -- 172.21.15.152:0/4101478238 >> v1:172.21.15.152:6790/0 conn(0x7f3e80099340 legacy=0x7f3e80097270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:22:18.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e84d18700 1 -- 172.21.15.152:0/4101478238 >> v1:172.21.15.181:6789/0 conn(0x7f3e80063220 legacy=0x7f3e80133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-24T15:22:18.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e84d18700 1 -- 172.21.15.152:0/4101478238 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8008fac0 con 0x7f3e80062da0 2021-02-24T15:22:18.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e84d18700 1 -- 172.21.15.152:0/4101478238 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3e700019f0 con 0x7f3e80062da0 2021-02-24T15:22:18.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e84d18700 1 -- 172.21.15.152:0/4101478238 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3e70001ce0 con 0x7f3e80062da0 2021-02-24T15:22:18.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.789+0000 7f3e84d18700 1 -- 172.21.15.152:0/4101478238 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3e70004750 con 0x7f3e80062da0 2021-02-24T15:22:18.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.790+0000 7f3e87f7e700 1 -- 172.21.15.152:0/4101478238 >> v1:172.21.15.152:6789/0 conn(0x7f3e80062da0 legacy=0x7f3e8012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:18.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.790+0000 7f3e87f7e700 1 -- 172.21.15.152:0/4101478238 shutdown_connections 2021-02-24T15:22:18.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.790+0000 7f3e87f7e700 1 -- 172.21.15.152:0/4101478238 >> 172.21.15.152:0/4101478238 conn(0x7f3e8009dcc0 msgr2=0x7f3e8009e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:18.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.790+0000 7f3e87f7e700 1 -- 172.21.15.152:0/4101478238 shutdown_connections 2021-02-24T15:22:18.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.790+0000 7f3e87f7e700 1 -- 172.21.15.152:0/4101478238 wait complete. 2021-02-24T15:22:18.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e87f7e700 1 librados: starting msgr at 2021-02-24T15:22:18.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e87f7e700 1 librados: starting objecter 2021-02-24T15:22:18.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e87f7e700 1 Processor -- start 2021-02-24T15:22:18.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e87f7e700 1 -- start start 2021-02-24T15:22:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e87f7e700 1 librados: setting wanted keys 2021-02-24T15:22:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e87f7e700 1 librados: calling monclient init 2021-02-24T15:22:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e87f7e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8012c370 con 0x7f3e80099340 2021-02-24T15:22:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e87f7e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8012c610 con 0x7f3e801344d0 2021-02-24T15:22:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e87f7e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8012c8b0 con 0x7f3e80063220 2021-02-24T15:22:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e85d1a700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f3e80063220 legacy=0x7f3e80133dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e85519700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3e80099340 0x7f3e8013ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47866/0 (socket says 172.21.15.152:47866) 2021-02-24T15:22:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.791+0000 7f3e85519700 1 -- 172.21.15.152:0/929094432 learned_addr learned my addr 172.21.15.152:0/929094432 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e85519700 1 -- 172.21.15.152:0/929094432 >> v1:172.21.15.152:6789/0 conn(0x7f3e80099340 legacy=0x7f3e8013ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:18.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 10 client.?.objecter ms_handle_connect 0x7f3e80099340 2021-02-24T15:22:18.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:18.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215771667 0 0) 0x7f3e8012c370 con 0x7f3e80099340 2021-02-24T15:22:18.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e60004bd0 con 0x7f3e80099340 2021-02-24T15:22:18.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 10 client.?.objecter ms_handle_connect 0x7f3e801344d0 2021-02-24T15:22:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e8651b700 1 -- 172.21.15.152:0/929094432 >> v1:172.21.15.181:6789/0 conn(0x7f3e801344d0 legacy=0x7f3e801426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1573837995 0 0) 0x7f3e60004bd0 con 0x7f3e80099340 2021-02-24T15:22:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3e8012c370 con 0x7f3e80099340 2021-02-24T15:22:18.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3e700019b0 con 0x7f3e80099340 2021-02-24T15:22:18.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2413542084 0 0) 0x7f3e8012c370 con 0x7f3e80099340 2021-02-24T15:22:18.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 >> v1:172.21.15.152:6790/0 conn(0x7f3e80063220 legacy=0x7f3e80133dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:22:18.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 >> v1:172.21.15.181:6789/0 conn(0x7f3e801344d0 legacy=0x7f3e801426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:18.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8012a740 con 0x7f3e80099340 2021-02-24T15:22:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e80129be0 con 0x7f3e80099340 2021-02-24T15:22:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3e70004d70 con 0x7f3e80099340 2021-02-24T15:22:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3e70005080 con 0x7f3e80099340 2021-02-24T15:22:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e87f7e700 10 client.28089.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e80135200 con 0x7f3e80099340 2021-02-24T15:22:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.794+0000 7f3e87f7e700 1 librados: init done 2021-02-24T15:22:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.795+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f3e7000dbc0 con 0x7f3e80099340 2021-02-24T15:22:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.795+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(260..260 src has 66..260) v4 ==== 5341+0+0 (unknown 2635226971 0 0) 0x7f3e7003b220 con 0x7f3e80099340 2021-02-24T15:22:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.795+0000 7f3e6dffb700 10 client.28089.objecter ms_dispatch 0x7f3e80001510 osd_map(260..260 src has 66..260) v4 2021-02-24T15:22:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.795+0000 7f3e6dffb700 3 client.28089.objecter handle_osd_map got epochs [260,260] > 0 2021-02-24T15:22:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.795+0000 7f3e6dffb700 3 client.28089.objecter handle_osd_map decoding full epoch 260 2021-02-24T15:22:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.795+0000 7f3e6dffb700 20 client.28089.objecter dump_active .. 0 homeless 2021-02-24T15:22:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.795+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e80058400 con 0x7f3e80099340 2021-02-24T15:22:18.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.798+0000 7f3e6dffb700 10 client.28089.objecter ms_handle_connect 0x7f3e600313e0 2021-02-24T15:22:18.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:18.799+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f3e700129c0 con 0x7f3e80099340 2021-02-24T15:22:19.036 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.034+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3e80044c90 con 0x7f3e80099340 2021-02-24T15:22:19.037 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.034+0000 7f3e6dffb700 1 -- 172.21.15.152:0/929094432 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 969718327) 0x7f3e700125b0 con 0x7f3e80099340 2021-02-24T15:22:19.037 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:22:19.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 10 librados: watch_flush enter 2021-02-24T15:22:19.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 10 librados: watch_flush exit 2021-02-24T15:22:19.041 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 20 client.28089.objecter shutdown clearing up homeless session... 2021-02-24T15:22:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 10 client.28089.objecter successfully canceled tick 2021-02-24T15:22:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 >> v1:172.21.15.181:6812/33484 conn(0x7f3e600313e0 legacy=0x7f3e600338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 >> v1:172.21.15.152:6789/0 conn(0x7f3e80099340 legacy=0x7f3e8013ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 shutdown_connections 2021-02-24T15:22:19.045 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 >> 172.21.15.152:0/929094432 conn(0x7f3e8009dcc0 msgr2=0x7f3e8009c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:19.045 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 shutdown_connections 2021-02-24T15:22:19.045 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 1 -- 172.21.15.152:0/929094432 wait complete. 2021-02-24T15:22:19.046 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:19.036+0000 7f3e87f7e700 1 librados: shutdown 2021-02-24T15:22:22.051 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:22:22.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.179+0000 7fa33b59e700 1 Processor -- start 2021-02-24T15:22:22.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.179+0000 7fa33b59e700 1 -- start start 2021-02-24T15:22:22.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.180+0000 7fa33b59e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c0639d0 con 0x7fa33c097040 2021-02-24T15:22:22.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.180+0000 7fa33b59e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c09a060 con 0x7fa33c0635f0 2021-02-24T15:22:22.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.180+0000 7fa33b59e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c09a300 con 0x7fa33c0974f0 2021-02-24T15:22:22.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.180+0000 7fa33ad9d700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa33c133180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:22.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.180+0000 7fa339d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa33c097040 0x7fa33c12fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47872/0 (socket says 172.21.15.152:47872) 2021-02-24T15:22:22.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.180+0000 7fa339d9b700 1 -- 172.21.15.152:0/3566970055 learned_addr learned my addr 172.21.15.152:0/3566970055 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:22.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.182+0000 7fa339d9b700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6789/0 conn(0x7fa33c097040 legacy=0x7fa33c12fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:22.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.182+0000 7fa33a59c700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.181:6789/0 conn(0x7fa33c0635f0 legacy=0x7fa33c12abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:22.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.381+0000 7fa33ad9d700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa33c133180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:22.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:22.782+0000 7fa33ad9d700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa33c133180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:23.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:23.583+0000 7fa33ad9d700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa33c133180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:25.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.180+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa33c133180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:22:25.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.180+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.181:6789/0 conn(0x7fa33c0635f0 legacy=0x7fa33c12abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:25.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.180+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6789/0 conn(0x7fa33c097040 legacy=0x7fa33c12fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:25.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.180+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c08fb30 con 0x7fa33c097040 2021-02-24T15:22:25.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.180+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c09a300 con 0x7fa33c0635f0 2021-02-24T15:22:25.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.180+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31800fcb0 con 0x7fa33c0974f0 2021-02-24T15:22:25.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.180+0000 7fa33a59c700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa3180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:25.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.182+0000 7fa33ad9d700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6789/0 conn(0x7fa33c097040 legacy=0x7fa31800c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:25.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.182+0000 7fa339d9b700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.181:6789/0 conn(0x7fa33c0635f0 legacy=0x7fa318008c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:25.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.381+0000 7fa33a59c700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa3180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:25.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:25.782+0000 7fa33a59c700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa3180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:26.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:26.583+0000 7fa33a59c700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa3180054f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:28.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.181+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa3180054f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:22:28.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.181+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.181:6789/0 conn(0x7fa33c0635f0 legacy=0x7fa318008c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:28.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.181+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6789/0 conn(0x7fa33c097040 legacy=0x7fa31800c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:28.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.181+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa318010f80 con 0x7fa3180106d0 2021-02-24T15:22:28.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.181+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31800fcb0 con 0x7fa33c0635f0 2021-02-24T15:22:28.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.181+0000 7fa32bfff700 1 -- 172.21.15.152:0/3566970055 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa318010c30 con 0x7fa33c0974f0 2021-02-24T15:22:28.183 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.181+0000 7fa33a59c700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa31800ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:28.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.182+0000 7fa339d9b700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6789/0 conn(0x7fa3180106d0 legacy=0x7fa3180054f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:28.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.183+0000 7fa33ad9d700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.181:6789/0 conn(0x7fa33c0635f0 legacy=0x7fa318008c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.382+0000 7fa33a59c700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa31800ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:28.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:28.783+0000 7fa33a59c700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa31800ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:29.585 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:29.584+0000 7fa33a59c700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa31800ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:30.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.193+0000 7fa33959a700 1 -- 172.21.15.152:0/3566970055 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172382241 0 0) 0x7fa31800fcb0 con 0x7fa33c0635f0 2021-02-24T15:22:30.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.193+0000 7fa33959a700 1 -- 172.21.15.152:0/3566970055 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa320003230 con 0x7fa33c0635f0 2021-02-24T15:22:30.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.194+0000 7fa33959a700 1 -- 172.21.15.152:0/3566970055 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 836891246 0 0) 0x7fa320003230 con 0x7fa33c0635f0 2021-02-24T15:22:30.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.194+0000 7fa33959a700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6790/0 conn(0x7fa33c0974f0 legacy=0x7fa31800ffc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:22:30.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.194+0000 7fa33959a700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.152:6789/0 conn(0x7fa3180106d0 legacy=0x7fa3180054f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.198 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.194+0000 7fa33959a700 1 -- 172.21.15.152:0/3566970055 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31800c3e0 con 0x7fa33c0635f0 2021-02-24T15:22:30.198 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.194+0000 7fa33959a700 1 -- 172.21.15.152:0/3566970055 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa334004510 con 0x7fa33c0635f0 2021-02-24T15:22:30.198 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.194+0000 7fa33959a700 1 -- 172.21.15.152:0/3566970055 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa334004830 con 0x7fa33c0635f0 2021-02-24T15:22:30.199 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.194+0000 7fa33959a700 1 -- 172.21.15.152:0/3566970055 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa334004b80 con 0x7fa33c0635f0 2021-02-24T15:22:30.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.195+0000 7fa33b59e700 1 -- 172.21.15.152:0/3566970055 >> v1:172.21.15.181:6789/0 conn(0x7fa33c0635f0 legacy=0x7fa318008c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.195+0000 7fa33b59e700 1 -- 172.21.15.152:0/3566970055 shutdown_connections 2021-02-24T15:22:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.195+0000 7fa33b59e700 1 -- 172.21.15.152:0/3566970055 >> 172.21.15.152:0/3566970055 conn(0x7fa33c09d9e0 msgr2=0x7fa33c09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.195+0000 7fa33b59e700 1 -- 172.21.15.152:0/3566970055 shutdown_connections 2021-02-24T15:22:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.196+0000 7fa33b59e700 1 -- 172.21.15.152:0/3566970055 wait complete. 2021-02-24T15:22:30.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33b59e700 1 librados: starting msgr at 2021-02-24T15:22:30.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33b59e700 1 librados: starting objecter 2021-02-24T15:22:30.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33b59e700 1 Processor -- start 2021-02-24T15:22:30.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33b59e700 1 -- start start 2021-02-24T15:22:30.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33b59e700 1 librados: setting wanted keys 2021-02-24T15:22:30.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33b59e700 1 librados: calling monclient init 2021-02-24T15:22:30.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33b59e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c092cb0 con 0x7fa33c0974f0 2021-02-24T15:22:30.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33b59e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c092f50 con 0x7fa33c0635f0 2021-02-24T15:22:30.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33b59e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c091950 con 0x7fa3180106d0 2021-02-24T15:22:30.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.197+0000 7fa33a59c700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fa3180106d0 legacy=0x7fa33c096420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:30.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.198+0000 7fa33ad9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa33c0974f0 0x7fa33c14f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47920/0 (socket says 172.21.15.152:47920) 2021-02-24T15:22:30.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.198+0000 7fa33ad9d700 1 -- 172.21.15.152:0/3390071890 learned_addr learned my addr 172.21.15.152:0/3390071890 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:30.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.200+0000 7fa339d9b700 1 -- 172.21.15.152:0/3390071890 >> v1:172.21.15.181:6789/0 conn(0x7fa33c0635f0 legacy=0x7fa33c14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.200+0000 7fa32a7fc700 10 client.?.objecter ms_handle_connect 0x7fa33c0635f0 2021-02-24T15:22:30.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.200+0000 7fa32a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:30.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.200+0000 7fa32a7fc700 10 client.?.objecter ms_handle_connect 0x7fa33c0974f0 2021-02-24T15:22:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.200+0000 7fa33ad9d700 1 -- 172.21.15.152:0/3390071890 >> v1:172.21.15.152:6789/0 conn(0x7fa33c0974f0 legacy=0x7fa33c14f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.200+0000 7fa32a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.204+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648651442 0 0) 0x7fa33c092cb0 con 0x7fa33c0974f0 2021-02-24T15:22:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.204+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa318010c30 con 0x7fa33c0974f0 2021-02-24T15:22:30.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.206+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1879086660 0 0) 0x7fa318010c30 con 0x7fa33c0974f0 2021-02-24T15:22:30.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.206+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa33c092cb0 con 0x7fa33c0974f0 2021-02-24T15:22:30.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.206+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa334004b40 con 0x7fa33c0974f0 2021-02-24T15:22:30.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3341656419 0 0) 0x7fa33c092cb0 con 0x7fa33c0974f0 2021-02-24T15:22:30.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 >> v1:172.21.15.152:6790/0 conn(0x7fa3180106d0 legacy=0x7fa33c096420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:22:30.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 >> v1:172.21.15.181:6789/0 conn(0x7fa33c0635f0 legacy=0x7fa33c14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c096b30 con 0x7fa33c0974f0 2021-02-24T15:22:30.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33c096d80 con 0x7fa33c0974f0 2021-02-24T15:22:30.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa33b59e700 10 client.28095.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:30.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33c067e80 con 0x7fa33c0974f0 2021-02-24T15:22:30.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa33b59e700 1 librados: init done 2021-02-24T15:22:30.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa334004180 con 0x7fa33c0974f0 2021-02-24T15:22:30.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.207+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa3340051b0 con 0x7fa33c0974f0 2021-02-24T15:22:30.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.208+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fa334005310 con 0x7fa33c0974f0 2021-02-24T15:22:30.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.209+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(261..261 src has 66..261) v4 ==== 5245+0+0 (unknown 2970034551 0 0) 0x7fa33403b4c0 con 0x7fa33c0974f0 2021-02-24T15:22:30.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.209+0000 7fa32a7fc700 10 client.28095.objecter ms_dispatch 0x7fa33c001510 osd_map(261..261 src has 66..261) v4 2021-02-24T15:22:30.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.209+0000 7fa32a7fc700 3 client.28095.objecter handle_osd_map got epochs [261,261] > 0 2021-02-24T15:22:30.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.209+0000 7fa32a7fc700 3 client.28095.objecter handle_osd_map decoding full epoch 261 2021-02-24T15:22:30.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.209+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c004d60 con 0x7fa33c0974f0 2021-02-24T15:22:30.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.209+0000 7fa32a7fc700 20 client.28095.objecter dump_active .. 0 homeless 2021-02-24T15:22:30.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.211+0000 7fa32a7fc700 10 client.28095.objecter ms_handle_connect 0x7fa318031f30 2021-02-24T15:22:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.216+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fa334012d20 con 0x7fa33c0974f0 2021-02-24T15:22:30.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.458+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa31c005590 con 0x7fa33c0974f0 2021-02-24T15:22:30.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.459+0000 7fa32a7fc700 1 -- 172.21.15.152:0/3390071890 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1336 (unknown 254746657 0 2234849699) 0x7fa334012910 con 0x7fa33c0974f0 2021-02-24T15:22:30.462 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":32,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:22:30.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 10 librados: watch_flush enter 2021-02-24T15:22:30.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 10 librados: watch_flush exit 2021-02-24T15:22:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 20 client.28095.objecter shutdown clearing up homeless session... 2021-02-24T15:22:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 10 client.28095.objecter successfully canceled tick 2021-02-24T15:22:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 >> v1:172.21.15.181:6812/33484 conn(0x7fa318031f30 legacy=0x7fa3180343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 >> v1:172.21.15.152:6789/0 conn(0x7fa33c0974f0 legacy=0x7fa33c14f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 shutdown_connections 2021-02-24T15:22:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 >> 172.21.15.152:0/3390071890 conn(0x7fa33c09d9e0 msgr2=0x7fa33c12a050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:30.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 shutdown_connections 2021-02-24T15:22:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 1 -- 172.21.15.152:0/3390071890 wait complete. 2021-02-24T15:22:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.460+0000 7fa33b59e700 1 librados: shutdown 2021-02-24T15:22:30.475 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2021-02-24T15:22:30.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:22:30.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.593+0000 7fe7ede12700 1 Processor -- start 2021-02-24T15:22:30.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.593+0000 7fe7ede12700 1 -- start start 2021-02-24T15:22:30.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.593+0000 7fe7ede12700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e8099130 con 0x7fe7e8067ef0 2021-02-24T15:22:30.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.593+0000 7fe7ede12700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e8099de0 con 0x7fe7e81355d0 2021-02-24T15:22:30.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.593+0000 7fe7ede12700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e809a080 con 0x7fe7e80634e0 2021-02-24T15:22:30.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.593+0000 7fe7e7fff700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fe7e80634e0 legacy=0x7fe7e8133eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:30.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.593+0000 7fe7ece10700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe7e8067ef0 0x7fe7e812cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47926/0 (socket says 172.21.15.152:47926) 2021-02-24T15:22:30.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.594+0000 7fe7ece10700 1 -- 172.21.15.152:0/2161507263 learned_addr learned my addr 172.21.15.152:0/2161507263 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:30.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7ece10700 1 -- 172.21.15.152:0/2161507263 >> v1:172.21.15.152:6789/0 conn(0x7fe7e8067ef0 legacy=0x7fe7e812cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7ed611700 1 -- 172.21.15.152:0/2161507263 >> v1:172.21.15.181:6789/0 conn(0x7fe7e81355d0 legacy=0x7fe7e81379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420243921 0 0) 0x7fe7e8099130 con 0x7fe7e8067ef0 2021-02-24T15:22:30.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7cc003230 con 0x7fe7e8067ef0 2021-02-24T15:22:30.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055067478 0 0) 0x7fe7e8099de0 con 0x7fe7e81355d0 2021-02-24T15:22:30.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e8099130 con 0x7fe7e81355d0 2021-02-24T15:22:30.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3775699913 0 0) 0x7fe7cc003230 con 0x7fe7e8067ef0 2021-02-24T15:22:30.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 >> v1:172.21.15.152:6790/0 conn(0x7fe7e80634e0 legacy=0x7fe7e8133eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:22:30.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 >> v1:172.21.15.181:6789/0 conn(0x7fe7e81355d0 legacy=0x7fe7e81379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8064860 con 0x7fe7e8067ef0 2021-02-24T15:22:30.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe7dc001930 con 0x7fe7e8067ef0 2021-02-24T15:22:30.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe7dc001c40 con 0x7fe7e8067ef0 2021-02-24T15:22:30.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.596+0000 7fe7e77fe700 1 -- 172.21.15.152:0/2161507263 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe7dc004750 con 0x7fe7e8067ef0 2021-02-24T15:22:30.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.597+0000 7fe7ede12700 1 -- 172.21.15.152:0/2161507263 >> v1:172.21.15.152:6789/0 conn(0x7fe7e8067ef0 legacy=0x7fe7e812cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.597+0000 7fe7ede12700 1 -- 172.21.15.152:0/2161507263 shutdown_connections 2021-02-24T15:22:30.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.597+0000 7fe7ede12700 1 -- 172.21.15.152:0/2161507263 >> 172.21.15.152:0/2161507263 conn(0x7fe7e809d9e0 msgr2=0x7fe7e809ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:30.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.597+0000 7fe7ede12700 1 -- 172.21.15.152:0/2161507263 shutdown_connections 2021-02-24T15:22:30.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.597+0000 7fe7ede12700 1 -- 172.21.15.152:0/2161507263 wait complete. 2021-02-24T15:22:30.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.598+0000 7fe7ede12700 1 librados: starting msgr at 2021-02-24T15:22:30.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.598+0000 7fe7ede12700 1 librados: starting objecter 2021-02-24T15:22:30.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.598+0000 7fe7ede12700 1 Processor -- start 2021-02-24T15:22:30.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.598+0000 7fe7ede12700 1 -- start start 2021-02-24T15:22:30.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.598+0000 7fe7ede12700 1 librados: setting wanted keys 2021-02-24T15:22:30.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.598+0000 7fe7ede12700 1 librados: calling monclient init 2021-02-24T15:22:30.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.598+0000 7fe7ede12700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e8064d90 con 0x7fe7e81355d0 2021-02-24T15:22:30.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.598+0000 7fe7ede12700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e8097cd0 con 0x7fe7e80634e0 2021-02-24T15:22:30.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.598+0000 7fe7ede12700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e81258c0 con 0x7fe7e8067ef0 2021-02-24T15:22:30.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.599+0000 7fe7e7fff700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7fe7e8067ef0 legacy=0x7fe7e81251b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:30.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.599+0000 7fe7ed611700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe7e81355d0 0x7fe7e8146ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47936/0 (socket says 172.21.15.152:47936) 2021-02-24T15:22:30.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.599+0000 7fe7ed611700 1 -- 172.21.15.152:0/913707983 learned_addr learned my addr 172.21.15.152:0/913707983 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:30.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7ed611700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.152:6789/0 conn(0x7fe7e81355d0 legacy=0x7fe7e8146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 10 client.?.objecter ms_handle_connect 0x7fe7e81355d0 2021-02-24T15:22:30.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:30.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881352625 0 0) 0x7fe7e8064d90 con 0x7fe7e81355d0 2021-02-24T15:22:30.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c8004bd0 con 0x7fe7e81355d0 2021-02-24T15:22:30.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 10 client.?.objecter ms_handle_connect 0x7fe7e80634e0 2021-02-24T15:22:30.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:30.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7ece10700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.181:6789/0 conn(0x7fe7e80634e0 legacy=0x7fe7e8124aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 976791333 0 0) 0x7fe7c8004bd0 con 0x7fe7e81355d0 2021-02-24T15:22:30.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe7e8064d90 con 0x7fe7e81355d0 2021-02-24T15:22:30.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe7e0001d60 con 0x7fe7e81355d0 2021-02-24T15:22:30.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734461881 0 0) 0x7fe7e8097cd0 con 0x7fe7e80634e0 2021-02-24T15:22:30.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c8004bd0 con 0x7fe7e80634e0 2021-02-24T15:22:30.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1328253837 0 0) 0x7fe7e8064d90 con 0x7fe7e81355d0 2021-02-24T15:22:30.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.152:6790/0 conn(0x7fe7e8067ef0 legacy=0x7fe7e81251b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:22:30.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.181:6789/0 conn(0x7fe7e80634e0 legacy=0x7fe7e8124aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8066060 con 0x7fe7e81355d0 2021-02-24T15:22:30.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e8066300 con 0x7fe7e81355d0 2021-02-24T15:22:30.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7ede12700 10 client.28107.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:30.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e8066c80 con 0x7fe7e81355d0 2021-02-24T15:22:30.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7ede12700 1 librados: init done 2021-02-24T15:22:30.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe7e00027c0 con 0x7fe7e81355d0 2021-02-24T15:22:30.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.601+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe7e0002ad0 con 0x7fe7e81355d0 2021-02-24T15:22:30.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.602+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fe7e0002cb0 con 0x7fe7e81355d0 2021-02-24T15:22:30.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.602+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe7c0006550 con 0x7fe7c00027f0 2021-02-24T15:22:30.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.602+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(261..261 src has 66..261) v4 ==== 5245+0+0 (unknown 2970034551 0 0) 0x7fe7e003b460 con 0x7fe7e81355d0 2021-02-24T15:22:30.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.602+0000 7fe7e4ff9700 10 client.28107.objecter ms_dispatch 0x7fe7e8001510 osd_map(261..261 src has 66..261) v4 2021-02-24T15:22:30.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.602+0000 7fe7e4ff9700 3 client.28107.objecter handle_osd_map got epochs [261,261] > 0 2021-02-24T15:22:30.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.602+0000 7fe7e4ff9700 3 client.28107.objecter handle_osd_map decoding full epoch 261 2021-02-24T15:22:30.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.602+0000 7fe7e4ff9700 20 client.28107.objecter dump_active .. 0 homeless 2021-02-24T15:22:30.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.604+0000 7fe7ece10700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.152:6789/0 conn(0x7fe7c00027f0 legacy=0x7fe7c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.604+0000 7fe7e4ff9700 10 client.28107.objecter ms_handle_connect 0x7fe7c00027f0 2021-02-24T15:22:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.604+0000 7fe7e4ff9700 10 client.28107.objecter resend_mon_ops 2021-02-24T15:22:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.604+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581689767 0 0) 0x7fe7c0006550 con 0x7fe7c00027f0 2021-02-24T15:22:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.604+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e8064d90 con 0x7fe7c00027f0 2021-02-24T15:22:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.605+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1356585360 0 0) 0x7fe7e8064d90 con 0x7fe7c00027f0 2021-02-24T15:22:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.605+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe7c0006550 con 0x7fe7c00027f0 2021-02-24T15:22:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.605+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe7dc0012e0 con 0x7fe7c00027f0 2021-02-24T15:22:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.605+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2350773862 0 0) 0x7fe7c0006550 con 0x7fe7c00027f0 2021-02-24T15:22:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.605+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7c0009df0 con 0x7fe7c00027f0 2021-02-24T15:22:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.605+0000 7fe7e4ff9700 10 client.28107.objecter ms_handle_connect 0x7fe7c8031430 2021-02-24T15:22:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.605+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fe7dc0016c0 con 0x7fe7c00027f0 2021-02-24T15:22:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.605+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.152:6789/0 conn(0x7fe7c00027f0 legacy=0x7fe7c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.605+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.152:6789/0 conn(0x7fe7c00027f0 legacy=0x7fe7c0004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:30.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.614+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fe7c0007520 con 0x7fe7c00068c0 2021-02-24T15:22:30.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.616+0000 7fe7ece10700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.152:6789/0 conn(0x7fe7c00068c0 legacy=0x7fe7c0006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.616+0000 7fe7e4ff9700 10 client.28107.objecter ms_handle_connect 0x7fe7c00068c0 2021-02-24T15:22:30.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.616+0000 7fe7e4ff9700 10 client.28107.objecter resend_mon_ops 2021-02-24T15:22:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.616+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007860173 0 0) 0x7fe7c0007520 con 0x7fe7c00068c0 2021-02-24T15:22:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c0006550 con 0x7fe7c00068c0 2021-02-24T15:22:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3785625698 0 0) 0x7fe7c0006550 con 0x7fe7c00068c0 2021-02-24T15:22:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe7c0007520 con 0x7fe7c00068c0 2021-02-24T15:22:30.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fe7dc004cf0 con 0x7fe7c00068c0 2021-02-24T15:22:30.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2000295287 0 0) 0x7fe7c0007520 con 0x7fe7c00068c0 2021-02-24T15:22:30.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe7c0008720 con 0x7fe7c00068c0 2021-02-24T15:22:30.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3931 (unknown 0 0 1447224436) 0x7fe7dc005040 con 0x7fe7c00068c0 2021-02-24T15:22:30.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.152:6789/0 conn(0x7fe7c00068c0 legacy=0x7fe7c0006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7e4ff9700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.152:6789/0 conn(0x7fe7c00068c0 legacy=0x7fe7c0006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ede12700 10 librados: watch_flush enter 2021-02-24T15:22:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ede12700 10 librados: watch_flush exit 2021-02-24T15:22:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ede12700 20 client.28107.objecter shutdown clearing up homeless session... 2021-02-24T15:22:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ede12700 10 client.28107.objecter successfully canceled tick 2021-02-24T15:22:30.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.181:6812/33484 conn(0x7fe7c8031430 legacy=0x7fe7c80338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 >> v1:172.21.15.152:6789/0 conn(0x7fe7e81355d0 legacy=0x7fe7e8146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ed611700 1 -- 172.21.15.152:0/913707983 reap_dead start 2021-02-24T15:22:30.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ed611700 1 -- 172.21.15.152:0/913707983 reap_dead start 2021-02-24T15:22:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 shutdown_connections 2021-02-24T15:22:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.617+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 >> 172.21.15.152:0/913707983 conn(0x7fe7e809d9e0 msgr2=0x7fe7e8128dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.618+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 shutdown_connections 2021-02-24T15:22:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.618+0000 7fe7ede12700 1 -- 172.21.15.152:0/913707983 wait complete. 2021-02-24T15:22:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.618+0000 7fe7ede12700 1 librados: shutdown 2021-02-24T15:22:30.628 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:22:30.628 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:30.628 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:30.628 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:22:30.629 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 32, 2021-02-24T15:22:30.629 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:22:30.629 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:22:30.629 INFO:teuthology.orchestra.run.smithi152.stdout: 1 2021-02-24T15:22:30.629 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.630 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:22:30.630 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:30.630 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:22:30.630 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:22:30.630 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:30.631 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:30.631 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:30.631 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:30.631 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:30.632 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:30.632 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:30.632 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:30.632 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:30.633 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.633 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:22:30.633 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:22:30.633 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:30.634 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:30.634 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:30.634 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:30.634 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:30.635 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:30.635 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:30.635 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:30.635 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:30.636 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.636 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:22:30.636 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:22:30.636 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:22:30.637 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:22:30.637 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:22:30.637 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:22:30.637 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:30.637 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:30.638 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:22:30.638 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:22:30.638 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:22:30.638 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:22:30.639 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:22:30.639 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:30.639 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:22:30.639 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:30.639 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:30.640 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:30.640 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:30.640 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:30.640 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:30.640 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:30.641 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:30.641 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:30.641 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.641 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:22:30.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.642 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:22:30.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.642 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:30.642 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:30.642 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:30.643 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:30.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.643 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:30.643 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:22:30.644 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:30.644 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.644 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.645 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:22:30.645 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:22:30.645 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:30.645 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:30.646 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:30.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.646 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:30.646 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:30.647 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:30.647 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:30.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.648 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:22:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.650 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:22:30.650 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:22:30.650 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:30.651 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:30.651 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:30.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.652 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:30.652 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:30.652 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:30.652 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:30.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.653 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:30.653 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:22:30.653 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:30.653 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.654 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.654 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:22:30.654 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:22:30.655 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:30.655 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:30.655 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:30.655 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.655 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.656 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:22:30.656 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:22:30.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.656 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.657 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:22:30.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.658 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:30.658 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:30.659 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:22:30.659 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.659 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.659 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:22:30.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.660 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:30.660 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:30.661 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6 2021-02-24T15:22:30.661 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.662 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.662 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:22:30.662 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:22:30.664 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:22:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.780+0000 7f6882784700 1 Processor -- start 2021-02-24T15:22:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.780+0000 7f6882784700 1 -- start start 2021-02-24T15:22:30.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.780+0000 7f6882784700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c0922a0 con 0x7f687c0939f0 2021-02-24T15:22:30.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.780+0000 7f6882784700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c092540 con 0x7f687c0945b0 2021-02-24T15:22:30.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.780+0000 7f6882784700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c0927e0 con 0x7f687c12e1c0 2021-02-24T15:22:30.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.780+0000 7f6880d21700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f687c12e1c0 legacy=0x7f687c1305b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:30.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.780+0000 7f687b7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f687c0939f0 0x7f687c090130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47944/0 (socket says 172.21.15.152:47944) 2021-02-24T15:22:30.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.780+0000 7f687b7fe700 1 -- 172.21.15.152:0/3489286350 learned_addr learned my addr 172.21.15.152:0/3489286350 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687b7fe700 1 -- 172.21.15.152:0/3489286350 >> v1:172.21.15.152:6789/0 conn(0x7f687c0939f0 legacy=0x7f687c090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687affd700 1 -- 172.21.15.152:0/3489286350 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590415596 0 0) 0x7f687c0922a0 con 0x7f687c0939f0 2021-02-24T15:22:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687affd700 1 -- 172.21.15.152:0/3489286350 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6868003230 con 0x7f687c0939f0 2021-02-24T15:22:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687bfff700 1 -- 172.21.15.152:0/3489286350 >> v1:172.21.15.181:6789/0 conn(0x7f687c0945b0 legacy=0x7f687c08fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687affd700 1 -- 172.21.15.152:0/3489286350 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1600219531 0 0) 0x7f6868003230 con 0x7f687c0939f0 2021-02-24T15:22:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687affd700 1 -- 172.21.15.152:0/3489286350 >> v1:172.21.15.152:6790/0 conn(0x7f687c12e1c0 legacy=0x7f687c1305b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:22:30.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687affd700 1 -- 172.21.15.152:0/3489286350 >> v1:172.21.15.181:6789/0 conn(0x7f687c0945b0 legacy=0x7f687c08fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687affd700 1 -- 172.21.15.152:0/3489286350 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c092a80 con 0x7f687c0939f0 2021-02-24T15:22:30.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687affd700 1 -- 172.21.15.152:0/3489286350 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f68700019f0 con 0x7f687c0939f0 2021-02-24T15:22:30.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687affd700 1 -- 172.21.15.152:0/3489286350 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6870001ce0 con 0x7f687c0939f0 2021-02-24T15:22:30.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f687affd700 1 -- 172.21.15.152:0/3489286350 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6870004750 con 0x7f687c0939f0 2021-02-24T15:22:30.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f6882784700 1 -- 172.21.15.152:0/3489286350 >> v1:172.21.15.152:6789/0 conn(0x7f687c0939f0 legacy=0x7f687c090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f6882784700 1 -- 172.21.15.152:0/3489286350 shutdown_connections 2021-02-24T15:22:30.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.783+0000 7f6882784700 1 -- 172.21.15.152:0/3489286350 >> 172.21.15.152:0/3489286350 conn(0x7f687c0999a0 msgr2=0x7f687c099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:30.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.784+0000 7f6882784700 1 -- 172.21.15.152:0/3489286350 shutdown_connections 2021-02-24T15:22:30.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.784+0000 7f6882784700 1 -- 172.21.15.152:0/3489286350 wait complete. 2021-02-24T15:22:30.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.784+0000 7f6882784700 1 librados: starting msgr at 2021-02-24T15:22:30.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.784+0000 7f6882784700 1 librados: starting objecter 2021-02-24T15:22:30.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.784+0000 7f6882784700 1 Processor -- start 2021-02-24T15:22:30.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.785+0000 7f6882784700 1 -- start start 2021-02-24T15:22:30.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.785+0000 7f6882784700 1 librados: setting wanted keys 2021-02-24T15:22:30.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.785+0000 7f6882784700 1 librados: calling monclient init 2021-02-24T15:22:30.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.785+0000 7f6882784700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c110150 con 0x7f687c0939f0 2021-02-24T15:22:30.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.785+0000 7f6882784700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c1103f0 con 0x7f687c12e1c0 2021-02-24T15:22:30.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.785+0000 7f6882784700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c110690 con 0x7f687c0945b0 2021-02-24T15:22:30.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.785+0000 7f687b7fe700 1 -- >> v1:172.21.15.152:6790/0 conn(0x7f687c0945b0 legacy=0x7f687c13d160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6790/0 2021-02-24T15:22:30.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.785+0000 7f687bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f687c0939f0 0x7f687c128f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47948/0 (socket says 172.21.15.152:47948) 2021-02-24T15:22:30.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.785+0000 7f687bfff700 1 -- 172.21.15.152:0/3802656804 learned_addr learned my addr 172.21.15.152:0/3802656804 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:22:30.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.787+0000 7f687bfff700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.152:6789/0 conn(0x7f687c0939f0 legacy=0x7f687c128f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.787+0000 7f6863fff700 10 client.?.objecter ms_handle_connect 0x7f687c0939f0 2021-02-24T15:22:30.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.787+0000 7f6863fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:30.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.787+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433503713 0 0) 0x7f687c110150 con 0x7f687c0939f0 2021-02-24T15:22:30.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.787+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f685c004bd0 con 0x7f687c0939f0 2021-02-24T15:22:30.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.787+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 DispatchQueue::entry inject delay of 0.002000 2021-02-24T15:22:30.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.787+0000 7f6880d21700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.181:6789/0 conn(0x7f687c12e1c0 legacy=0x7f687c140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 10 client.?.objecter ms_handle_connect 0x7f687c12e1c0 2021-02-24T15:22:30.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:22:30.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1401688285 0 0) 0x7f685c004bd0 con 0x7f687c0939f0 2021-02-24T15:22:30.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f687c110150 con 0x7f687c0939f0 2021-02-24T15:22:30.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305927503 0 0) 0x7f687c1103f0 con 0x7f687c12e1c0 2021-02-24T15:22:30.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f685c004bd0 con 0x7f687c12e1c0 2021-02-24T15:22:30.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f686c001c80 con 0x7f687c0939f0 2021-02-24T15:22:30.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 984525730 0 0) 0x7f687c110150 con 0x7f687c0939f0 2021-02-24T15:22:30.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.152:6790/0 conn(0x7f687c0945b0 legacy=0x7f687c13d160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:22:30.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.181:6789/0 conn(0x7f687c12e1c0 legacy=0x7f687c140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c110930 con 0x7f687c0939f0 2021-02-24T15:22:30.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c132d90 con 0x7f687c0939f0 2021-02-24T15:22:30.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6882784700 10 client.28119.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:22:30.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c12d8a0 con 0x7f687c0939f0 2021-02-24T15:22:30.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6882784700 1 librados: init done 2021-02-24T15:22:30.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f686c0021f0 con 0x7f687c0939f0 2021-02-24T15:22:30.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f686c002500 con 0x7f687c0939f0 2021-02-24T15:22:30.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f687bfff700 1 --1- 172.21.15.152:0/3802656804 >> v1:172.21.15.152:6789/0 conn(0x7f687c0939f0 0x7f687c128f50 :-1 s=OPENED pgs=9015 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f686c002690 mgrmap(e 4) v1 2021-02-24T15:22:30.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.790+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f686c002690 con 0x7f687c0939f0 2021-02-24T15:22:30.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.791+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f6854006550 con 0x7f68540027f0 2021-02-24T15:22:30.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.793+0000 7f6880d21700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.181:6789/0 conn(0x7f68540027f0 legacy=0x7f6854004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.793+0000 7f6863fff700 10 client.28119.objecter ms_handle_connect 0x7f68540027f0 2021-02-24T15:22:30.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.793+0000 7f6863fff700 10 client.28119.objecter resend_mon_ops 2021-02-24T15:22:30.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.793+0000 7f6863fff700 10 client.28119.objecter ms_handle_connect 0x7f685c0314d0 2021-02-24T15:22:30.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.793+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485791966 0 0) 0x7f6854006550 con 0x7f68540027f0 2021-02-24T15:22:30.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.793+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f687c110150 con 0x7f68540027f0 2021-02-24T15:22:30.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.794+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4100472415 0 0) 0x7f687c110150 con 0x7f68540027f0 2021-02-24T15:22:30.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.794+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6854006550 con 0x7f68540027f0 2021-02-24T15:22:30.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.794+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6874004280 con 0x7f68540027f0 2021-02-24T15:22:30.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.794+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3003040477 0 0) 0x7f6854006550 con 0x7f68540027f0 2021-02-24T15:22:30.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.794+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6854009df0 con 0x7f68540027f0 2021-02-24T15:22:30.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.794+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f6874006670 con 0x7f68540027f0 2021-02-24T15:22:30.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.794+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.181:6789/0 conn(0x7f68540027f0 legacy=0x7f6854004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.794+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.181:6789/0 conn(0x7f68540027f0 legacy=0x7f6854004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:30.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.802+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f6854007420 con 0x7f68540068a0 2021-02-24T15:22:30.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6880d21700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.181:6789/0 conn(0x7f68540068a0 legacy=0x7f6854006d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:22:30.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6863fff700 10 client.28119.objecter ms_handle_connect 0x7f68540068a0 2021-02-24T15:22:30.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6863fff700 10 client.28119.objecter resend_mon_ops 2021-02-24T15:22:30.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890447306 0 0) 0x7f6854007420 con 0x7f68540068a0 2021-02-24T15:22:30.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6854006550 con 0x7f68540068a0 2021-02-24T15:22:30.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1264171292 0 0) 0x7f6854006550 con 0x7f68540068a0 2021-02-24T15:22:30.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6854007420 con 0x7f68540068a0 2021-02-24T15:22:30.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6874004b60 con 0x7f68540068a0 2021-02-24T15:22:30.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 799486121 0 0) 0x7f6854007420 con 0x7f68540068a0 2021-02-24T15:22:30.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.805+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6854008720 con 0x7f68540068a0 2021-02-24T15:22:30.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4099 (unknown 0 0 1996467113) 0x7f6874006880 con 0x7f68540068a0 2021-02-24T15:22:30.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.181:6789/0 conn(0x7f68540068a0 legacy=0x7f6854006d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.181:6789/0 conn(0x7f68540068a0 legacy=0x7f6854006d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:22:30.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 10 librados: watch_flush enter 2021-02-24T15:22:30.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 10 librados: watch_flush exit 2021-02-24T15:22:30.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 20 client.28119.objecter shutdown clearing up homeless session... 2021-02-24T15:22:30.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 10 client.28119.objecter successfully canceled tick 2021-02-24T15:22:30.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.181:6812/33484 conn(0x7f685c0314d0 legacy=0x7f685c033990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 >> v1:172.21.15.152:6789/0 conn(0x7f687c0939f0 legacy=0x7f687c128f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:22:30.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6880d21700 1 -- 172.21.15.152:0/3802656804 reap_dead start 2021-02-24T15:22:30.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6863fff700 1 -- 172.21.15.152:0/3802656804 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(261..261 src has 66..261) v4 ==== 5245+0+0 (unknown 2970034551 0 0) 0x7f686c03afa0 con 0x7f687c0939f0 2021-02-24T15:22:30.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6863fff700 10 client.28119.objecter ms_dispatch 0x7f687c001510 osd_map(261..261 src has 66..261) v4 2021-02-24T15:22:30.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6863fff700 10 librados: disconnected, discarding osd_map(261..261 src has 66..261) v4 2021-02-24T15:22:30.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 shutdown_connections 2021-02-24T15:22:30.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 >> 172.21.15.152:0/3802656804 conn(0x7f687c0999a0 msgr2=0x7f687c094de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:22:30.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 shutdown_connections 2021-02-24T15:22:30.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 1 -- 172.21.15.152:0/3802656804 wait complete. 2021-02-24T15:22:30.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:22:30.806+0000 7f6882784700 1 librados: shutdown 2021-02-24T15:22:30.819 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:22:30.819 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:30.819 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:30.819 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:22:30.819 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 32, 2021-02-24T15:22:30.820 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:22:30.820 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:22:30.820 INFO:teuthology.orchestra.run.smithi152.stdout: 1 2021-02-24T15:22:30.820 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.820 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:22:30.821 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:30.821 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:22:30.821 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:22:30.821 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:30.821 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:30.822 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:30.822 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:30.822 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:30.822 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:30.823 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:30.823 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:30.823 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:30.823 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.823 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:22:30.824 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:22:30.824 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:30.824 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:30.824 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:30.824 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:30.825 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:30.825 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:30.825 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:30.825 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:30.825 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:30.826 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.826 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:22:30.826 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:22:30.827 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:22:30.827 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:22:30.827 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:22:30.827 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:22:30.827 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:30.828 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:22:30.828 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:22:30.828 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:22:30.829 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:22:30.829 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:22:30.829 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:22:30.829 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:22:30.830 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:22:30.830 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:22:30.830 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:22:30.830 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:22:30.830 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:22:30.831 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:22:30.831 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:22:30.831 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:22:30.831 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:22:30.831 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:22:30.832 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.832 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:22:30.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.832 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:22:30.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.833 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:22:30.833 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:22:30.833 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:30.833 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:30.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.834 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:30.834 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:22:30.834 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:30.835 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.835 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.835 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:22:30.836 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:22:30.836 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:30.836 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:30.836 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:30.836 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.837 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:22:30.837 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:22:30.837 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:30.837 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:30.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.838 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:30.838 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:22:30.838 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:30.838 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.839 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.839 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:22:30.839 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:22:30.840 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:30.840 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:30.840 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:30.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.841 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:22:30.841 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:22:30.841 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:22:30.841 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:22:30.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.842 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:22:30.842 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:22:30.842 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:22:30.842 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.842 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.843 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:22:30.843 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:22:30.843 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:22:30.843 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:22:30.844 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:22:30.844 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.844 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.844 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:22:30.845 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:22:30.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.845 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:30.845 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:30.845 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:30.846 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.846 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.846 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:22:30.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.847 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:30.847 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:30.847 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:22:30.847 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.847 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.848 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:22:30.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.848 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:30.848 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:30.849 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:30.849 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.849 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:22:30.849 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:22:30.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:22:30.850 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:22:30.850 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:22:30.850 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:22:30.850 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:22:30.851 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:22:30.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:22:30.851 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:22:30.851 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:22:30.852 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-02-24T15:22:51.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:b ] LibRadosAio.RoundTripCmpExtPP (3011 ms) 2021-02-24T15:22:51.142 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2021-02-24T15:22:51.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3024 ms) 2021-02-24T15:22:51.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] 28 tests from LibRadosAio (131877 ms total) 2021-02-24T15:22:51.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: 2021-02-24T15:22:51.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2021-02-24T15:22:51.145 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2021-02-24T15:22:51.145 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (2965 ms) 2021-02-24T15:22:51.146 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2021-02-24T15:22:51.146 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9314 ms) 2021-02-24T15:22:51.147 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2021-02-24T15:22:51.147 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14708 ms) 2021-02-24T15:22:51.148 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2021-02-24T15:22:51.148 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3016 ms) 2021-02-24T15:22:51.149 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30003 ms total) 2021-02-24T15:22:51.149 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: 2021-02-24T15:22:51.150 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2021-02-24T15:22:51.150 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2021-02-24T15:22:51.151 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (2989 ms) 2021-02-24T15:22:51.151 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (2989 ms total) 2021-02-24T15:22:51.152 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: 2021-02-24T15:22:51.152 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2021-02-24T15:22:51.154 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2021-02-24T15:22:51.155 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (29269 ms) 2021-02-24T15:22:51.156 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2021-02-24T15:22:51.156 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6715 ms) 2021-02-24T15:22:51.156 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2021-02-24T15:22:51.156 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7246 ms) 2021-02-24T15:22:51.157 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2021-02-24T15:22:51.157 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (6784 ms) 2021-02-24T15:22:51.157 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2021-02-24T15:22:51.157 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3005 ms) 2021-02-24T15:22:51.158 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2021-02-24T15:22:51.158 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6995 ms) 2021-02-24T15:22:51.158 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2021-02-24T15:22:51.158 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6993 ms) 2021-02-24T15:22:51.158 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2021-02-24T15:22:51.159 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7815 ms) 2021-02-24T15:22:51.159 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2021-02-24T15:22:51.159 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (6702 ms) 2021-02-24T15:22:51.160 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2021-02-24T15:22:51.160 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (6494 ms) 2021-02-24T15:22:51.160 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2021-02-24T15:22:51.160 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7439 ms) 2021-02-24T15:22:51.161 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2021-02-24T15:22:51.161 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (6567 ms) 2021-02-24T15:22:51.161 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2021-02-24T15:22:51.162 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6986 ms) 2021-02-24T15:22:51.162 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2021-02-24T15:22:51.162 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3030 ms) 2021-02-24T15:22:51.162 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2021-02-24T15:22:51.162 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (21095 ms) 2021-02-24T15:22:51.163 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2021-02-24T15:22:51.163 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (6895 ms) 2021-02-24T15:22:51.163 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2021-02-24T15:22:51.164 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7011 ms) 2021-02-24T15:22:51.164 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2021-02-24T15:23:05.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7030 ms) 2021-02-24T15:23:05.103 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2021-02-24T15:23:05.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (6981 ms) 2021-02-24T15:23:05.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2021-02-24T15:23:05.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (6981 ms) 2021-02-24T15:23:05.104 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (168033 ms total) 2021-02-24T15:23:05.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: 2021-02-24T15:23:05.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [----------] Global test environment tear-down 2021-02-24T15:23:05.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [==========] 53 tests from 4 test suites ran. (332902 ms total) 2021-02-24T15:23:05.105 INFO:tasks.workunit.client.0.smithi181.stdout: api_aio_pp: [ PASSED ] 53 tests. 2021-02-24T15:23:05.105 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.106 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36733 2021-02-24T15:23:05.106 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36733 2021-02-24T15:23:05.106 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.106 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36880 2021-02-24T15:23:05.107 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36880 2021-02-24T15:23:05.107 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.107 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36820 2021-02-24T15:23:05.108 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36820 2021-02-24T15:23:05.108 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.108 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36757 2021-02-24T15:23:05.108 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36757 2021-02-24T15:23:05.108 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.109 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37056 2021-02-24T15:23:05.109 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37056 2021-02-24T15:23:05.109 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.109 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36725 2021-02-24T15:23:05.109 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36725 2021-02-24T15:23:05.110 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.110 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37095 2021-02-24T15:23:05.110 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37095 2021-02-24T15:23:05.110 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.110 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36937 2021-02-24T15:23:05.111 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36937 2021-02-24T15:23:05.111 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.111 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37202 2021-02-24T15:23:05.111 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37202 2021-02-24T15:23:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37080 2021-02-24T15:23:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37080 2021-02-24T15:23:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37250 2021-02-24T15:23:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37250 2021-02-24T15:23:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36709 2021-02-24T15:23:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36709 2021-02-24T15:23:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37221 2021-02-24T15:23:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37221 2021-02-24T15:23:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=37123 2021-02-24T15:23:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 37123 2021-02-24T15:23:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:+ for t in "${!pids[@]}" 2021-02-24T15:23:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:+ pid=36851 2021-02-24T15:23:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:+ wait 36851 2021-02-24T15:23:24.121 INFO:tasks.workunit.client.0.smithi181.stdout:4c720e9:::166:head 2021-02-24T15:23:24.122 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:e694b040:::167:head 2021-02-24T15:23:24.123 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:afa38db2:::168:head 2021-02-24T15:23:24.123 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:77ba9f53:::169:head 2021-02-24T15:23:24.124 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:87495034:::170:head 2021-02-24T15:23:24.124 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:7c96bf0e:::171:head 2021-02-24T15:23:24.124 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:dbe346cc:::172:head 2021-02-24T15:23:24.125 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:e943ec24:::173:head 2021-02-24T15:23:24.125 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:f97a9c0c:::174:head 2021-02-24T15:23:24.126 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:6f26e74d:::175:head 2021-02-24T15:23:24.126 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:4f95e106:::176:head 2021-02-24T15:23:24.127 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:0e6f2f8f:::177:head 2021-02-24T15:23:24.127 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:05db05f1:::178:head 2021-02-24T15:23:24.127 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:38a78d66:::179:head 2021-02-24T15:23:24.128 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:d095610b:::180:head 2021-02-24T15:23:24.128 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:a1a9d709:::181:head 2021-02-24T15:23:24.132 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:1e5d39db:::182:head 2021-02-24T15:23:24.132 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:f7df4fb9:::183:head 2021-02-24T15:23:24.132 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:03a7f161:::184:head 2021-02-24T15:23:24.133 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:ba70721e:::185:head 2021-02-24T15:23:24.133 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:28e5662d:::186:head 2021-02-24T15:23:24.133 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:973d52de:::187:head 2021-02-24T15:23:24.134 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:4303eb1c:::188:head 2021-02-24T15:23:24.134 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:b990b48e:::189:head 2021-02-24T15:23:24.134 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:29b8165b:::190:head 2021-02-24T15:23:24.135 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:3547f197:::191:head 2021-02-24T15:23:24.135 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:7e260936:::192:head 2021-02-24T15:23:24.135 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:1abec7b1:::193:head 2021-02-24T15:23:24.136 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:10fdda93:::194:head 2021-02-24T15:23:24.136 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:15817eea:::195:head 2021-02-24T15:23:24.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:770bab57:::196:head 2021-02-24T15:23:24.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:ed9e13e7:::197:head 2021-02-24T15:23:24.137 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:71471a8f:::198:head 2021-02-24T15:23:24.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: checking for 181:10fb1d02:::199:head 2021-02-24T15:23:24.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8997 ms) 2021-02-24T15:23:24.138 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2021-02-24T15:23:24.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,0 2021-02-24T15:23:24.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: first is 1614180121 2021-02-24T15:23:24.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,0 2021-02-24T15:23:24.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,0 2021-02-24T15:23:24.139 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,1614180123,1614180124,0 2021-02-24T15:23:24.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,1614180123,1614180124,0 2021-02-24T15:23:24.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,1614180123,1614180124,0 2021-02-24T15:23:24.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,1614180123,1614180124,1614180126,1614180127,0 2021-02-24T15:23:24.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,1614180123,1614180124,1614180126,1614180127,0 2021-02-24T15:23:24.140 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,1614180123,1614180124,1614180126,1614180127,0 2021-02-24T15:23:24.141 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,1614180123,1614180124,1614180126,1614180127,1614180129,1614180130,0 2021-02-24T15:23:24.141 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,1614180123,1614180124,1614180126,1614180127,1614180129,1614180130,0 2021-02-24T15:23:24.141 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180121,1614180123,1614180124,1614180126,1614180127,1614180129,1614180130,0 2021-02-24T15:23:24.141 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180124,1614180126,1614180127,1614180129,1614180130,1614180132,1614180133,0 2021-02-24T15:23:24.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: first now 1614180124, trimmed 2021-02-24T15:23:24.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21023 ms) 2021-02-24T15:23:24.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2021-02-24T15:23:24.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: foo0 2021-02-24T15:23:24.143 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: verifying foo0 is eventually promoted 2021-02-24T15:23:24.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (29007 ms) 2021-02-24T15:23:24.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2021-02-24T15:23:24.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ProxyRead (18026 ms) 2021-02-24T15:23:24.144 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2021-02-24T15:24:00.854 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2021-02-24T15:24:00.854 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2021-02-24T15:24:00.855 INFO:tasks.ceph.mon.c:Restarting daemon 2021-02-24T15:24:00.855 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-02-24T15:24:00.859 INFO:tasks.ceph.mon.c:Started 2021-02-24T15:24:00.859 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:24:00.860 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:24:00.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.991+0000 7ff015630700 1 Processor -- start 2021-02-24T15:24:00.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.991+0000 7ff015630700 1 -- start start 2021-02-24T15:24:00.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.991+0000 7ff015630700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff010097d40 con 0x7ff010099340 2021-02-24T15:24:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.991+0000 7ff015630700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff010063d00 con 0x7ff010062da0 2021-02-24T15:24:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.991+0000 7ff015630700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff010097980 con 0x7ff010063220 2021-02-24T15:24:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.992+0000 7ff00effd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff010099340 0x7ff010097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48052/0 (socket says 172.21.15.152:48052) 2021-02-24T15:24:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.992+0000 7ff00f7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff010063220 0x7ff010133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36528/0 (socket says 172.21.15.152:36528) 2021-02-24T15:24:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.992+0000 7ff00effd700 1 -- 172.21.15.152:0/2072995865 learned_addr learned my addr 172.21.15.152:0/2072995865 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:00.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00effd700 1 -- 172.21.15.152:0/2072995865 >> v1:172.21.15.152:6789/0 conn(0x7ff010099340 legacy=0x7ff010097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:00.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00f7fe700 1 -- 172.21.15.152:0/2072995865 >> v1:172.21.15.152:6790/0 conn(0x7ff010063220 legacy=0x7ff010133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:00.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00e7fc700 1 -- 172.21.15.152:0/2072995865 >> v1:172.21.15.181:6789/0 conn(0x7ff010062da0 legacy=0x7ff01012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:00.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00dffb700 1 -- 172.21.15.152:0/2072995865 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008178968 0 0) 0x7ff010063d00 con 0x7ff010062da0 2021-02-24T15:24:00.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00dffb700 1 -- 172.21.15.152:0/2072995865 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feffc003230 con 0x7ff010062da0 2021-02-24T15:24:00.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00dffb700 1 -- 172.21.15.152:0/2072995865 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2943772905 0 0) 0x7feffc003230 con 0x7ff010062da0 2021-02-24T15:24:00.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00dffb700 1 -- 172.21.15.152:0/2072995865 >> v1:172.21.15.152:6790/0 conn(0x7ff010063220 legacy=0x7ff010133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:00.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00dffb700 1 -- 172.21.15.152:0/2072995865 >> v1:172.21.15.152:6789/0 conn(0x7ff010099340 legacy=0x7ff010097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:00.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00dffb700 1 -- 172.21.15.152:0/2072995865 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01008fac0 con 0x7ff010062da0 2021-02-24T15:24:00.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.994+0000 7ff00dffb700 1 -- 172.21.15.152:0/2072995865 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff000001a40 con 0x7ff010062da0 2021-02-24T15:24:00.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.995+0000 7ff00dffb700 1 -- 172.21.15.152:0/2072995865 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff000001d30 con 0x7ff010062da0 2021-02-24T15:24:00.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.995+0000 7ff00dffb700 1 -- 172.21.15.152:0/2072995865 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff0000020a0 con 0x7ff010062da0 2021-02-24T15:24:01.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.995+0000 7ff015630700 1 -- 172.21.15.152:0/2072995865 >> v1:172.21.15.181:6789/0 conn(0x7ff010062da0 legacy=0x7ff01012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.995+0000 7ff015630700 1 -- 172.21.15.152:0/2072995865 shutdown_connections 2021-02-24T15:24:01.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.995+0000 7ff015630700 1 -- 172.21.15.152:0/2072995865 >> 172.21.15.152:0/2072995865 conn(0x7ff01009dcc0 msgr2=0x7ff01009e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:01.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.995+0000 7ff015630700 1 -- 172.21.15.152:0/2072995865 shutdown_connections 2021-02-24T15:24:01.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.995+0000 7ff015630700 1 -- 172.21.15.152:0/2072995865 wait complete. 2021-02-24T15:24:01.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.997+0000 7ff015630700 1 librados: starting msgr at 2021-02-24T15:24:01.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.997+0000 7ff015630700 1 librados: starting objecter 2021-02-24T15:24:01.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.997+0000 7ff015630700 1 Processor -- start 2021-02-24T15:24:01.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.997+0000 7ff015630700 1 -- start start 2021-02-24T15:24:01.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.997+0000 7ff015630700 1 librados: setting wanted keys 2021-02-24T15:24:01.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.997+0000 7ff015630700 1 librados: calling monclient init 2021-02-24T15:24:01.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.998+0000 7ff015630700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff010128120 con 0x7ff010099340 2021-02-24T15:24:01.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.998+0000 7ff015630700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff010094eb0 con 0x7ff010062da0 2021-02-24T15:24:01.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.998+0000 7ff015630700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff010095150 con 0x7ff010063220 2021-02-24T15:24:01.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.998+0000 7ff00f7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff010099340 0x7ff0101421b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48060/0 (socket says 172.21.15.152:48060) 2021-02-24T15:24:01.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:00.998+0000 7ff00f7fe700 1 -- 172.21.15.152:0/318293092 learned_addr learned my addr 172.21.15.152:0/318293092 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:01.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7ff00f7fe700 1 -- 172.21.15.152:0/318293092 >> v1:172.21.15.152:6789/0 conn(0x7ff010099340 legacy=0x7ff0101421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7feff6ffd700 10 client.?.objecter ms_handle_connect 0x7ff010099340 2021-02-24T15:24:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7feff6ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7feff6ffd700 10 client.?.objecter ms_handle_connect 0x7ff010062da0 2021-02-24T15:24:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7ff00effd700 1 -- 172.21.15.152:0/318293092 >> v1:172.21.15.181:6789/0 conn(0x7ff010062da0 legacy=0x7ff010139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7feff6ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704924965 0 0) 0x7ff010094eb0 con 0x7ff010062da0 2021-02-24T15:24:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff0004bd0 con 0x7ff010062da0 2021-02-24T15:24:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847098154 0 0) 0x7ff010128120 con 0x7ff010099340 2021-02-24T15:24:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.000+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff010094eb0 con 0x7ff010099340 2021-02-24T15:24:01.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2511010550 0 0) 0x7feff0004bd0 con 0x7ff010062da0 2021-02-24T15:24:01.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff010128120 con 0x7ff010062da0 2021-02-24T15:24:01.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff004001b10 con 0x7ff010062da0 2021-02-24T15:24:01.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3356606125 0 0) 0x7ff010094eb0 con 0x7ff010099340 2021-02-24T15:24:01.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7feff0004bd0 con 0x7ff010099340 2021-02-24T15:24:01.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff008001f50 con 0x7ff010099340 2021-02-24T15:24:01.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 10 client.?.objecter ms_handle_connect 0x7ff010063220 2021-02-24T15:24:01.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7ff00e7fc700 1 -- 172.21.15.152:0/318293092 >> v1:172.21.15.152:6790/0 conn(0x7ff010063220 legacy=0x7ff010096600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2435186556 0 0) 0x7ff010128120 con 0x7ff010062da0 2021-02-24T15:24:01.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 >> v1:172.21.15.152:6790/0 conn(0x7ff010063220 legacy=0x7ff010096600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 >> v1:172.21.15.152:6789/0 conn(0x7ff010099340 legacy=0x7ff0101421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010092fe0 con 0x7ff010062da0 2021-02-24T15:24:01.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3407739833 0 0) 0x7feff0004bd0 con 0x7ff010099340 2021-02-24T15:24:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01013a570 con 0x7ff010062da0 2021-02-24T15:24:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7ff015630700 10 client.55756.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01013a820 con 0x7ff010062da0 2021-02-24T15:24:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7ff015630700 1 librados: init done 2021-02-24T15:24:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff004004860 con 0x7ff010062da0 2021-02-24T15:24:01.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.001+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff004004b70 con 0x7ff010062da0 2021-02-24T15:24:01.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.002+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff004004d50 con 0x7ff010062da0 2021-02-24T15:24:01.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.002+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7ff00403af10 con 0x7ff010062da0 2021-02-24T15:24:01.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.002+0000 7feff6ffd700 10 client.55756.objecter ms_dispatch 0x7ff010001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.002+0000 7feff6ffd700 3 client.55756.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.002+0000 7feff6ffd700 3 client.55756.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.002+0000 7feff6ffd700 20 client.55756.objecter dump_active .. 0 homeless 2021-02-24T15:24:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.002+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff010058400 con 0x7ff010062da0 2021-02-24T15:24:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.004+0000 7feff6ffd700 10 client.55756.objecter ms_handle_connect 0x7feff0031680 2021-02-24T15:24:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.007+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7ff004012670 con 0x7ff010062da0 2021-02-24T15:24:01.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.247+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff010044c90 con 0x7ff010062da0 2021-02-24T15:24:01.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.247+0000 7feff6ffd700 1 -- 172.21.15.152:0/318293092 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 1988029083) 0x7ff004012260 con 0x7ff010062da0 2021-02-24T15:24:01.249 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:24:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.249+0000 7ff015630700 10 librados: watch_flush enter 2021-02-24T15:24:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.249+0000 7ff015630700 10 librados: watch_flush exit 2021-02-24T15:24:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.249+0000 7ff015630700 20 client.55756.objecter shutdown clearing up homeless session... 2021-02-24T15:24:01.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.249+0000 7ff015630700 10 client.55756.objecter successfully canceled tick 2021-02-24T15:24:01.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.249+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 >> v1:172.21.15.181:6812/33484 conn(0x7feff0031680 legacy=0x7feff0033b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.249+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 >> v1:172.21.15.181:6789/0 conn(0x7ff010062da0 legacy=0x7ff010139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.250+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 shutdown_connections 2021-02-24T15:24:01.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.250+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 >> 172.21.15.152:0/318293092 conn(0x7ff01009dcc0 msgr2=0x7ff01009c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:01.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.250+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 shutdown_connections 2021-02-24T15:24:01.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.250+0000 7ff015630700 1 -- 172.21.15.152:0/318293092 wait complete. 2021-02-24T15:24:01.253 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.250+0000 7ff015630700 1 librados: shutdown 2021-02-24T15:24:01.262 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:24:01.262 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:24:01.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.379+0000 7f0402f8c700 1 Processor -- start 2021-02-24T15:24:01.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.379+0000 7f0402f8c700 1 -- start start 2021-02-24T15:24:01.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.379+0000 7f0402f8c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc068080 con 0x7f03fc12ed20 2021-02-24T15:24:01.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.379+0000 7f0402f8c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc093610 con 0x7f03fc0926a0 2021-02-24T15:24:01.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.379+0000 7f0402f8c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc0938b0 con 0x7f03fc0955c0 2021-02-24T15:24:01.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.380+0000 7f0401529700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f03fc12ed20 0x7f03fc131110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48066/0 (socket says 172.21.15.152:48066) 2021-02-24T15:24:01.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.380+0000 7f0400d28700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f03fc0955c0 0x7f03fc128e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36542/0 (socket says 172.21.15.152:36542) 2021-02-24T15:24:01.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.380+0000 7f0401529700 1 -- 172.21.15.152:0/3499972383 learned_addr learned my addr 172.21.15.152:0/3499972383 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:01.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f0400d28700 1 -- 172.21.15.152:0/3499972383 >> v1:172.21.15.152:6790/0 conn(0x7f03fc0955c0 legacy=0x7f03fc128e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f0401529700 1 -- 172.21.15.152:0/3499972383 >> v1:172.21.15.152:6789/0 conn(0x7f03fc12ed20 legacy=0x7f03fc131110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962743967 0 0) 0x7f03fc068080 con 0x7f03fc12ed20 2021-02-24T15:24:01.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fbfff700 1 -- 172.21.15.152:0/3499972383 >> v1:172.21.15.181:6789/0 conn(0x7f03fc0926a0 legacy=0x7f03fc067970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e0003230 con 0x7f03fc12ed20 2021-02-24T15:24:01.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622548474 0 0) 0x7f03fc093610 con 0x7f03fc0926a0 2021-02-24T15:24:01.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03fc068080 con 0x7f03fc0926a0 2021-02-24T15:24:01.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 879062755 0 0) 0x7f03fc068080 con 0x7f03fc0926a0 2021-02-24T15:24:01.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 >> v1:172.21.15.152:6790/0 conn(0x7f03fc0955c0 legacy=0x7f03fc128e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 >> v1:172.21.15.152:6789/0 conn(0x7f03fc12ed20 legacy=0x7f03fc131110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc093b50 con 0x7f03fc0926a0 2021-02-24T15:24:01.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.382+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03e8001980 con 0x7f03fc0926a0 2021-02-24T15:24:01.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.383+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 <== mon.1 v1:172.21.15.181:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f03e8001c90 con 0x7f03fc0926a0 2021-02-24T15:24:01.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.383+0000 7f03fb7fe700 1 -- 172.21.15.152:0/3499972383 <== mon.1 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03e8002060 con 0x7f03fc0926a0 2021-02-24T15:24:01.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.383+0000 7f0402f8c700 1 -- 172.21.15.152:0/3499972383 >> v1:172.21.15.181:6789/0 conn(0x7f03fc0926a0 legacy=0x7f03fc067970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.383+0000 7f0402f8c700 1 -- 172.21.15.152:0/3499972383 shutdown_connections 2021-02-24T15:24:01.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.383+0000 7f0402f8c700 1 -- 172.21.15.152:0/3499972383 >> 172.21.15.152:0/3499972383 conn(0x7f03fc0999a0 msgr2=0x7f03fc099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:01.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.383+0000 7f0402f8c700 1 -- 172.21.15.152:0/3499972383 shutdown_connections 2021-02-24T15:24:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.383+0000 7f0402f8c700 1 -- 172.21.15.152:0/3499972383 wait complete. 2021-02-24T15:24:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.384+0000 7f0402f8c700 1 librados: starting msgr at 2021-02-24T15:24:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.384+0000 7f0402f8c700 1 librados: starting objecter 2021-02-24T15:24:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.384+0000 7f0402f8c700 1 Processor -- start 2021-02-24T15:24:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.384+0000 7f0402f8c700 1 -- start start 2021-02-24T15:24:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.384+0000 7f0402f8c700 1 librados: setting wanted keys 2021-02-24T15:24:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.384+0000 7f0402f8c700 1 librados: calling monclient init 2021-02-24T15:24:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.384+0000 7f0402f8c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc092c20 con 0x7f03fc12ed20 2021-02-24T15:24:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.384+0000 7f0402f8c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc12b350 con 0x7f03fc0955c0 2021-02-24T15:24:01.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.384+0000 7f0402f8c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc12b5d0 con 0x7f03fc0926a0 2021-02-24T15:24:01.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.385+0000 7f0400d28700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f03fc0926a0 0x7f03fc137d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36546/0 (socket says 172.21.15.152:36546) 2021-02-24T15:24:01.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.385+0000 7f0400d28700 1 -- 172.21.15.152:0/87505840 learned_addr learned my addr 172.21.15.152:0/87505840 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:01.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.385+0000 7f0401529700 1 --1- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6789/0 conn(0x7f03fc12ed20 0x7f03fc1400b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48074/0 (socket says 172.21.15.152:48074) 2021-02-24T15:24:01.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f0401529700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6789/0 conn(0x7f03fc12ed20 legacy=0x7f03fc1400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f0400d28700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6790/0 conn(0x7f03fc0926a0 legacy=0x7f03fc137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 10 client.?.objecter ms_handle_connect 0x7f03fc12ed20 2021-02-24T15:24:01.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 10 client.?.objecter ms_handle_connect 0x7f03fc0926a0 2021-02-24T15:24:01.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746060668 0 0) 0x7f03fc092c20 con 0x7f03fc12ed20 2021-02-24T15:24:01.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc004bd0 con 0x7f03fc12ed20 2021-02-24T15:24:01.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 10 client.?.objecter ms_handle_connect 0x7f03fc0955c0 2021-02-24T15:24:01.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03fbfff700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.181:6789/0 conn(0x7f03fc0955c0 legacy=0x7f03fc12da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1516010084 0 0) 0x7f03dc004bd0 con 0x7f03fc12ed20 2021-02-24T15:24:01.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03fc092c20 con 0x7f03fc12ed20 2021-02-24T15:24:01.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03f4001f30 con 0x7f03fc12ed20 2021-02-24T15:24:01.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1522593465 0 0) 0x7f03fc092c20 con 0x7f03fc12ed20 2021-02-24T15:24:01.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6790/0 conn(0x7f03fc0926a0 legacy=0x7f03fc137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.181:6789/0 conn(0x7f03fc0955c0 legacy=0x7f03fc12da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc067690 con 0x7f03fc12ed20 2021-02-24T15:24:01.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc138b80 con 0x7f03fc12ed20 2021-02-24T15:24:01.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f0402f8c700 10 client.28152.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:01.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc12e1a0 con 0x7f03fc12ed20 2021-02-24T15:24:01.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f0402f8c700 1 librados: init done 2021-02-24T15:24:01.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f03f4004be0 con 0x7f03fc12ed20 2021-02-24T15:24:01.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.387+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03f4004ef0 con 0x7f03fc12ed20 2021-02-24T15:24:01.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.388+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f03f400d9f0 con 0x7f03fc12ed20 2021-02-24T15:24:01.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.388+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f03d4006550 con 0x7f03d40027f0 2021-02-24T15:24:01.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.388+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f03f403b2c0 con 0x7f03fc12ed20 2021-02-24T15:24:01.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.388+0000 7f03f8ff9700 10 client.28152.objecter ms_dispatch 0x7f03fc001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:01.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.388+0000 7f03f8ff9700 3 client.28152.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:01.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.388+0000 7f03f8ff9700 3 client.28152.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:01.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.388+0000 7f03f8ff9700 20 client.28152.objecter dump_active .. 0 homeless 2021-02-24T15:24:01.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.390+0000 7f03f8ff9700 10 client.28152.objecter ms_handle_connect 0x7f03d40027f0 2021-02-24T15:24:01.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.390+0000 7f03f8ff9700 10 client.28152.objecter resend_mon_ops 2021-02-24T15:24:01.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.390+0000 7f0400d28700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6789/0 conn(0x7f03d40027f0 legacy=0x7f03d4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331893119 0 0) 0x7f03d4006550 con 0x7f03d40027f0 2021-02-24T15:24:01.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03fc092c20 con 0x7f03d40027f0 2021-02-24T15:24:01.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 10 client.28152.objecter ms_handle_connect 0x7f03dc0314c0 2021-02-24T15:24:01.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4001271313 0 0) 0x7f03fc092c20 con 0x7f03d40027f0 2021-02-24T15:24:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03d4006550 con 0x7f03d40027f0 2021-02-24T15:24:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03f0001990 con 0x7f03d40027f0 2021-02-24T15:24:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1672970488 0 0) 0x7f03d4006550 con 0x7f03d40027f0 2021-02-24T15:24:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03d4009df0 con 0x7f03d40027f0 2021-02-24T15:24:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f03f0005520 con 0x7f03d40027f0 2021-02-24T15:24:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6789/0 conn(0x7f03d40027f0 legacy=0x7f03d4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.391+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6789/0 conn(0x7f03d40027f0 legacy=0x7f03d4004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.399+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f03d4009a80 con 0x7f03d4008da0 2021-02-24T15:24:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 10 client.28152.objecter ms_handle_connect 0x7f03d4008da0 2021-02-24T15:24:01.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 10 client.28152.objecter resend_mon_ops 2021-02-24T15:24:01.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f0400d28700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6789/0 conn(0x7f03d4008da0 legacy=0x7f03d4009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639546206 0 0) 0x7f03d4009a80 con 0x7f03d4008da0 2021-02-24T15:24:01.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d4006550 con 0x7f03d4008da0 2021-02-24T15:24:01.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 100423843 0 0) 0x7f03d4006550 con 0x7f03d4008da0 2021-02-24T15:24:01.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03d4009a80 con 0x7f03d4008da0 2021-02-24T15:24:01.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f03f0004930 con 0x7f03d4008da0 2021-02-24T15:24:01.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 957458694 0 0) 0x7f03d4009a80 con 0x7f03d4008da0 2021-02-24T15:24:01.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f03d40086f0 con 0x7f03d4008da0 2021-02-24T15:24:01.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4112 (unknown 0 0 2740756626) 0x7f03f0004c60 con 0x7f03d4008da0 2021-02-24T15:24:01.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6789/0 conn(0x7f03d4008da0 legacy=0x7f03d4009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f03f8ff9700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6789/0 conn(0x7f03d4008da0 legacy=0x7f03d4009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:01.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f0402f8c700 10 librados: watch_flush enter 2021-02-24T15:24:01.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.402+0000 7f0402f8c700 10 librados: watch_flush exit 2021-02-24T15:24:01.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0402f8c700 20 client.28152.objecter shutdown clearing up homeless session... 2021-02-24T15:24:01.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0402f8c700 10 client.28152.objecter successfully canceled tick 2021-02-24T15:24:01.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.181:6812/33484 conn(0x7f03dc0314c0 legacy=0x7f03dc033980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 >> v1:172.21.15.152:6789/0 conn(0x7f03fc12ed20 legacy=0x7f03fc1400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0401529700 1 -- 172.21.15.152:0/87505840 reap_dead start 2021-02-24T15:24:01.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0401529700 1 -- 172.21.15.152:0/87505840 reap_dead start 2021-02-24T15:24:01.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 shutdown_connections 2021-02-24T15:24:01.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 >> 172.21.15.152:0/87505840 conn(0x7f03fc0999a0 msgr2=0x7f03fc131110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:01.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 shutdown_connections 2021-02-24T15:24:01.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0402f8c700 1 -- 172.21.15.152:0/87505840 wait complete. 2021-02-24T15:24:01.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.403+0000 7f0402f8c700 1 librados: shutdown 2021-02-24T15:24:01.414 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:24:01.414 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:01.415 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:01.415 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:24:01.415 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 34, 2021-02-24T15:24:01.415 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:24:01.416 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:24:01.416 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:24:01.416 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:24:01.417 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.417 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:24:01.418 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:01.419 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:24:01.419 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:24:01.420 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:01.421 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:01.421 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:01.421 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:01.422 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:01.422 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:01.422 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:01.422 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:01.423 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:01.423 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.423 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:24:01.423 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:24:01.423 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:01.424 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:01.424 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:01.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:01.424 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:01.425 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:01.425 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:01.425 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:01.426 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:01.426 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.426 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.426 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:24:01.427 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:24:01.427 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:24:01.427 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:24:01.427 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:24:01.427 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:24:01.428 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:01.428 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:01.428 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:24:01.428 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:24:01.428 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:24:01.429 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:24:01.429 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:24:01.429 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:01.429 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:24:01.429 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:01.430 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:01.430 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:01.430 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:01.430 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:01.431 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:01.431 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:01.431 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:01.431 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:01.432 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.432 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:24:01.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.433 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:24:01.433 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.433 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:01.433 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:01.434 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:01.434 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:01.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.435 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:01.435 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:24:01.435 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:01.435 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.435 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.436 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:24:01.436 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:24:01.437 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:01.437 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:01.437 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:01.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.438 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:01.438 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:01.438 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:01.438 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:01.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.439 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:01.439 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:24:01.439 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:01.440 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.440 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.440 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:24:01.441 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:24:01.441 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:01.441 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:01.441 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:01.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.442 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:01.442 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:24:01.444 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:01.444 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.444 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.445 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:24:01.445 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:24:01.445 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:01.446 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:01.446 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:01.446 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.446 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:24:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:24:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:01.448 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:01.448 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:01.448 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:24:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:01.450 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:24:01.450 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.450 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:24:01.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.451 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:01.451 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:01.452 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:24:01.452 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.452 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.453 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:24:01.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.453 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:01.453 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:01.454 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:01.454 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.454 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.455 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:24:01.455 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:24:01.456 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:24:01.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.573+0000 7f219dd4c700 1 Processor -- start 2021-02-24T15:24:01.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.573+0000 7f219dd4c700 1 -- start start 2021-02-24T15:24:01.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.573+0000 7f219dd4c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2198068930 con 0x7f2198097550 2021-02-24T15:24:01.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.573+0000 7f219dd4c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2198068bd0 con 0x7f2198090720 2021-02-24T15:24:01.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.573+0000 7f219dd4c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219808e260 con 0x7f2198090ba0 2021-02-24T15:24:01.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.574+0000 7f21977fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2198097550 0x7f2198127a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48082/0 (socket says 172.21.15.152:48082) 2021-02-24T15:24:01.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.574+0000 7f2197fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2198090ba0 0x7f21981334d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36558/0 (socket says 172.21.15.152:36558) 2021-02-24T15:24:01.577 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.574+0000 7f21977fe700 1 -- 172.21.15.152:0/2349832732 learned_addr learned my addr 172.21.15.152:0/2349832732 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:01.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f2197fff700 1 -- 172.21.15.152:0/2349832732 >> v1:172.21.15.152:6790/0 conn(0x7f2198090ba0 legacy=0x7f21981334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21977fe700 1 -- 172.21.15.152:0/2349832732 >> v1:172.21.15.152:6789/0 conn(0x7f2198097550 legacy=0x7f2198127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355554451 0 0) 0x7f219808e260 con 0x7f2198090ba0 2021-02-24T15:24:01.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2184003230 con 0x7f2198090ba0 2021-02-24T15:24:01.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078055488 0 0) 0x7f2198068930 con 0x7f2198097550 2021-02-24T15:24:01.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f219808e260 con 0x7f2198097550 2021-02-24T15:24:01.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f2196ffd700 1 -- 172.21.15.152:0/2349832732 >> v1:172.21.15.181:6789/0 conn(0x7f2198090720 legacy=0x7f219812fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2360109942 0 0) 0x7f2184003230 con 0x7f2198090ba0 2021-02-24T15:24:01.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 >> v1:172.21.15.181:6789/0 conn(0x7f2198090720 legacy=0x7f219812fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 >> v1:172.21.15.152:6789/0 conn(0x7f2198097550 legacy=0x7f2198127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198067fd0 con 0x7f2198090ba0 2021-02-24T15:24:01.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2190001cb0 con 0x7f2198090ba0 2021-02-24T15:24:01.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2190001fc0 con 0x7f2198090ba0 2021-02-24T15:24:01.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.576+0000 7f21967fc700 1 -- 172.21.15.152:0/2349832732 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2190004a10 con 0x7f2198090ba0 2021-02-24T15:24:01.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.577+0000 7f219dd4c700 1 -- 172.21.15.152:0/2349832732 >> v1:172.21.15.152:6790/0 conn(0x7f2198090ba0 legacy=0x7f21981334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.577+0000 7f219dd4c700 1 -- 172.21.15.152:0/2349832732 shutdown_connections 2021-02-24T15:24:01.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.577+0000 7f219dd4c700 1 -- 172.21.15.152:0/2349832732 >> 172.21.15.152:0/2349832732 conn(0x7f219809ab10 msgr2=0x7f2198096ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:01.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.577+0000 7f219dd4c700 1 -- 172.21.15.152:0/2349832732 shutdown_connections 2021-02-24T15:24:01.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.577+0000 7f219dd4c700 1 -- 172.21.15.152:0/2349832732 wait complete. 2021-02-24T15:24:01.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f219dd4c700 1 librados: starting msgr at 2021-02-24T15:24:01.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f219dd4c700 1 librados: starting objecter 2021-02-24T15:24:01.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f219dd4c700 1 Processor -- start 2021-02-24T15:24:01.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f219dd4c700 1 -- start start 2021-02-24T15:24:01.585 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f219dd4c700 1 librados: setting wanted keys 2021-02-24T15:24:01.585 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f219dd4c700 1 librados: calling monclient init 2021-02-24T15:24:01.589 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f219dd4c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219812aa20 con 0x7f2198097550 2021-02-24T15:24:01.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f219dd4c700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2198068230 con 0x7f2198090ba0 2021-02-24T15:24:01.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f219dd4c700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21981288d0 con 0x7f2198090720 2021-02-24T15:24:01.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f21977fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2198090720 0x7f2198092c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36564/0 (socket says 172.21.15.152:36564) 2021-02-24T15:24:01.590 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.578+0000 7f21977fe700 1 -- 172.21.15.152:0/1180233151 learned_addr learned my addr 172.21.15.152:0/1180233151 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:01.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f21977fe700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6790/0 conn(0x7f2198090720 legacy=0x7f2198092c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f2197fff700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6789/0 conn(0x7f2198097550 legacy=0x7f2198093a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 10 client.?.objecter ms_handle_connect 0x7f2198090720 2021-02-24T15:24:01.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 10 client.?.objecter ms_handle_connect 0x7f2198097550 2021-02-24T15:24:01.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 10 client.?.objecter ms_handle_connect 0x7f2198090ba0 2021-02-24T15:24:01.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f2196ffd700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.181:6789/0 conn(0x7f2198090ba0 legacy=0x7f2198093350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950893052 0 0) 0x7f21981288d0 con 0x7f2198090720 2021-02-24T15:24:01.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2178004bd0 con 0x7f2198090720 2021-02-24T15:24:01.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145080027 0 0) 0x7f219812aa20 con 0x7f2198097550 2021-02-24T15:24:01.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21981288d0 con 0x7f2198097550 2021-02-24T15:24:01.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542881669 0 0) 0x7f2198068230 con 0x7f2198090ba0 2021-02-24T15:24:01.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f219812aa20 con 0x7f2198090ba0 2021-02-24T15:24:01.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2378184043 0 0) 0x7f2178004bd0 con 0x7f2198090720 2021-02-24T15:24:01.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2198068230 con 0x7f2198090720 2021-02-24T15:24:01.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2188001d50 con 0x7f2198090720 2021-02-24T15:24:01.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1733044211 0 0) 0x7f21981288d0 con 0x7f2198097550 2021-02-24T15:24:01.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2178004bd0 con 0x7f2198097550 2021-02-24T15:24:01.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2190001c70 con 0x7f2198097550 2021-02-24T15:24:01.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4136243109 0 0) 0x7f219812aa20 con 0x7f2198090ba0 2021-02-24T15:24:01.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f21981288d0 con 0x7f2198090ba0 2021-02-24T15:24:01.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f218c001aa0 con 0x7f2198090ba0 2021-02-24T15:24:01.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1637747645 0 0) 0x7f2198068230 con 0x7f2198090720 2021-02-24T15:24:01.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.181:6789/0 conn(0x7f2198090ba0 legacy=0x7f2198093350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6789/0 conn(0x7f2198097550 legacy=0x7f2198093a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219808dbe0 con 0x7f2198090720 2021-02-24T15:24:01.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219808de90 con 0x7f2198090720 2021-02-24T15:24:01.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f219dd4c700 10 client.84104.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:01.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f219812afa0 con 0x7f2198090720 2021-02-24T15:24:01.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f219dd4c700 1 librados: init done 2021-02-24T15:24:01.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f21880047e0 con 0x7f2198090720 2021-02-24T15:24:01.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.581+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2188004af0 con 0x7f2198090720 2021-02-24T15:24:01.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.582+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f2188004d50 con 0x7f2198090720 2021-02-24T15:24:01.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.582+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f218803b050 con 0x7f2198090720 2021-02-24T15:24:01.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.582+0000 7f217f7fe700 10 client.84104.objecter ms_dispatch 0x7f2198001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:01.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.582+0000 7f217f7fe700 3 client.84104.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:01.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.582+0000 7f217f7fe700 3 client.84104.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:01.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.582+0000 7f217f7fe700 20 client.84104.objecter dump_active .. 0 homeless 2021-02-24T15:24:01.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.582+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2170006550 con 0x7f21700027f0 2021-02-24T15:24:01.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.584+0000 7f2197fff700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6790/0 conn(0x7f21700027f0 legacy=0x7f2170004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.584+0000 7f217f7fe700 10 client.84104.objecter ms_handle_connect 0x7f21700027f0 2021-02-24T15:24:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.584+0000 7f217f7fe700 10 client.84104.objecter resend_mon_ops 2021-02-24T15:24:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.584+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185462808 0 0) 0x7f2170006550 con 0x7f21700027f0 2021-02-24T15:24:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.584+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2198068230 con 0x7f21700027f0 2021-02-24T15:24:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.585+0000 7f217f7fe700 10 client.84104.objecter ms_handle_connect 0x7f21780317e0 2021-02-24T15:24:01.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.585+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3801962672 0 0) 0x7f2198068230 con 0x7f21700027f0 2021-02-24T15:24:01.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.585+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2170006550 con 0x7f21700027f0 2021-02-24T15:24:01.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.585+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2190004ff0 con 0x7f21700027f0 2021-02-24T15:24:01.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.585+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1889486049 0 0) 0x7f2170006550 con 0x7f21700027f0 2021-02-24T15:24:01.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.585+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2170009df0 con 0x7f21700027f0 2021-02-24T15:24:01.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.585+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f2190005150 con 0x7f21700027f0 2021-02-24T15:24:01.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.585+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6790/0 conn(0x7f21700027f0 legacy=0x7f2170004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.585+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6790/0 conn(0x7f21700027f0 legacy=0x7f2170004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:01.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.593+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2170009a80 con 0x7f2170008da0 2021-02-24T15:24:01.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.595+0000 7f2197fff700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6790/0 conn(0x7f2170008da0 legacy=0x7f2170009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.595+0000 7f217f7fe700 10 client.84104.objecter ms_handle_connect 0x7f2170008da0 2021-02-24T15:24:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.595+0000 7f217f7fe700 10 client.84104.objecter resend_mon_ops 2021-02-24T15:24:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.595+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995693448 0 0) 0x7f2170009a80 con 0x7f2170008da0 2021-02-24T15:24:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.595+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2170006550 con 0x7f2170008da0 2021-02-24T15:24:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1718143880 0 0) 0x7f2170006550 con 0x7f2170008da0 2021-02-24T15:24:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2170009a80 con 0x7f2170008da0 2021-02-24T15:24:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f21900058b0 con 0x7f2170008da0 2021-02-24T15:24:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 956817568 0 0) 0x7f2170009a80 con 0x7f2170008da0 2021-02-24T15:24:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f21700086f0 con 0x7f2170008da0 2021-02-24T15:24:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 1131826128) 0x7f2190006ed0 con 0x7f2170008da0 2021-02-24T15:24:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6790/0 conn(0x7f2170008da0 legacy=0x7f2170009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f217f7fe700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6790/0 conn(0x7f2170008da0 legacy=0x7f2170009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 10 librados: watch_flush enter 2021-02-24T15:24:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 10 librados: watch_flush exit 2021-02-24T15:24:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 20 client.84104.objecter shutdown clearing up homeless session... 2021-02-24T15:24:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 10 client.84104.objecter successfully canceled tick 2021-02-24T15:24:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.181:6812/33484 conn(0x7f21780317e0 legacy=0x7f2178033ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 >> v1:172.21.15.152:6790/0 conn(0x7f2198090720 legacy=0x7f2198092c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f2197fff700 1 -- 172.21.15.152:0/1180233151 reap_dead start 2021-02-24T15:24:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f2197fff700 1 -- 172.21.15.152:0/1180233151 reap_dead start 2021-02-24T15:24:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 shutdown_connections 2021-02-24T15:24:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 >> 172.21.15.152:0/1180233151 conn(0x7f219809ab10 msgr2=0x7f2198126370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 shutdown_connections 2021-02-24T15:24:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.596+0000 7f219dd4c700 1 -- 172.21.15.152:0/1180233151 wait complete. 2021-02-24T15:24:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.597+0000 7f219dd4c700 1 librados: shutdown 2021-02-24T15:24:01.613 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:24:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:24:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 34, 2021-02-24T15:24:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:24:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:24:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:24:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:24:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:24:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:24:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:24:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:24:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:24:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:24:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:24:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:24:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:24:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:24:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:24:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:24:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:24:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:24:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:24:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:24:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:24:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:24:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:24:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:24:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:24:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:24:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:24:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:24:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:24:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:24:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:24:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:24:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:24:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:24:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:24:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:24:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:24:01.652 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:24:01.653 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:24:01.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.769+0000 7f43b3472700 1 Processor -- start 2021-02-24T15:24:01.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.769+0000 7f43b3472700 1 -- start start 2021-02-24T15:24:01.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.770+0000 7f43b3472700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac097d40 con 0x7f43ac099340 2021-02-24T15:24:01.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.770+0000 7f43b3472700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac063d00 con 0x7f43ac062da0 2021-02-24T15:24:01.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.770+0000 7f43b3472700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac097980 con 0x7f43ac063220 2021-02-24T15:24:01.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.770+0000 7f43b120e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f43ac099340 0x7f43ac097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48100/0 (socket says 172.21.15.152:48100) 2021-02-24T15:24:01.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.770+0000 7f43b1a0f700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f43ac063220 0x7f43ac133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36576/0 (socket says 172.21.15.152:36576) 2021-02-24T15:24:01.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.770+0000 7f43b120e700 1 -- 172.21.15.152:0/219958294 learned_addr learned my addr 172.21.15.152:0/219958294 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:01.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.772+0000 7f43b120e700 1 -- 172.21.15.152:0/219958294 >> v1:172.21.15.152:6789/0 conn(0x7f43ac099340 legacy=0x7f43ac097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.772+0000 7f43b1a0f700 1 -- 172.21.15.152:0/219958294 >> v1:172.21.15.152:6790/0 conn(0x7f43ac063220 legacy=0x7f43ac133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.772+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430068758 0 0) 0x7f43ac097d40 con 0x7f43ac099340 2021-02-24T15:24:01.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.772+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4394003230 con 0x7f43ac099340 2021-02-24T15:24:01.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.772+0000 7f43b0a0d700 1 -- 172.21.15.152:0/219958294 >> v1:172.21.15.181:6789/0 conn(0x7f43ac062da0 legacy=0x7f43ac12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.772+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403522938 0 0) 0x7f43ac097980 con 0x7f43ac063220 2021-02-24T15:24:01.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.772+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ac097d40 con 0x7f43ac063220 2021-02-24T15:24:01.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.772+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249331936 0 0) 0x7f43ac063d00 con 0x7f43ac062da0 2021-02-24T15:24:01.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ac097980 con 0x7f43ac062da0 2021-02-24T15:24:01.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3871814599 0 0) 0x7f43ac097d40 con 0x7f43ac063220 2021-02-24T15:24:01.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 >> v1:172.21.15.181:6789/0 conn(0x7f43ac062da0 legacy=0x7f43ac12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 >> v1:172.21.15.152:6789/0 conn(0x7f43ac099340 legacy=0x7f43ac097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac08fac0 con 0x7f43ac063220 2021-02-24T15:24:01.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f43a4001d70 con 0x7f43ac063220 2021-02-24T15:24:01.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f43a4001fe0 con 0x7f43ac063220 2021-02-24T15:24:01.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f439bfff700 1 -- 172.21.15.152:0/219958294 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f43a4004a10 con 0x7f43ac063220 2021-02-24T15:24:01.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f43b3472700 1 -- 172.21.15.152:0/219958294 >> v1:172.21.15.152:6790/0 conn(0x7f43ac063220 legacy=0x7f43ac133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f43b3472700 1 -- 172.21.15.152:0/219958294 shutdown_connections 2021-02-24T15:24:01.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f43b3472700 1 -- 172.21.15.152:0/219958294 >> 172.21.15.152:0/219958294 conn(0x7f43ac09dcc0 msgr2=0x7f43ac09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:01.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f43b3472700 1 -- 172.21.15.152:0/219958294 shutdown_connections 2021-02-24T15:24:01.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.773+0000 7f43b3472700 1 -- 172.21.15.152:0/219958294 wait complete. 2021-02-24T15:24:01.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.774+0000 7f43b3472700 1 librados: starting msgr at 2021-02-24T15:24:01.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.774+0000 7f43b3472700 1 librados: starting objecter 2021-02-24T15:24:01.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.774+0000 7f43b3472700 1 Processor -- start 2021-02-24T15:24:01.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.774+0000 7f43b3472700 1 -- start start 2021-02-24T15:24:01.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.774+0000 7f43b3472700 1 librados: setting wanted keys 2021-02-24T15:24:01.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.774+0000 7f43b3472700 1 librados: calling monclient init 2021-02-24T15:24:01.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.775+0000 7f43b3472700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac096d20 con 0x7f43ac063220 2021-02-24T15:24:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.775+0000 7f43b3472700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac13acd0 con 0x7f43ac099340 2021-02-24T15:24:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.775+0000 7f43b3472700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac094ec0 con 0x7f43ac062da0 2021-02-24T15:24:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.775+0000 7f43b120e700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f43ac062da0 0x7f43ac096610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36582/0 (socket says 172.21.15.152:36582) 2021-02-24T15:24:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.775+0000 7f43b120e700 1 -- 172.21.15.152:0/2818789920 learned_addr learned my addr 172.21.15.152:0/2818789920 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43b120e700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.152:6790/0 conn(0x7f43ac062da0 legacy=0x7f43ac096610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43b0a0d700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.152:6789/0 conn(0x7f43ac063220 legacy=0x7f43ac139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 10 client.?.objecter ms_handle_connect 0x7f43ac062da0 2021-02-24T15:24:01.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 10 client.?.objecter ms_handle_connect 0x7f43ac063220 2021-02-24T15:24:01.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 10 client.?.objecter ms_handle_connect 0x7f43ac099340 2021-02-24T15:24:01.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43b1a0f700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.181:6789/0 conn(0x7f43ac099340 legacy=0x7f43ac1421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235592320 0 0) 0x7f43ac094ec0 con 0x7f43ac062da0 2021-02-24T15:24:01.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f438c004bd0 con 0x7f43ac062da0 2021-02-24T15:24:01.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325885298 0 0) 0x7f43ac096d20 con 0x7f43ac063220 2021-02-24T15:24:01.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ac094ec0 con 0x7f43ac063220 2021-02-24T15:24:01.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1716088535 0 0) 0x7f43ac094ec0 con 0x7f43ac063220 2021-02-24T15:24:01.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f43ac096d20 con 0x7f43ac063220 2021-02-24T15:24:01.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427608432 0 0) 0x7f43ac13acd0 con 0x7f43ac099340 2021-02-24T15:24:01.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ac094ec0 con 0x7f43ac099340 2021-02-24T15:24:01.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3854037012 0 0) 0x7f438c004bd0 con 0x7f43ac062da0 2021-02-24T15:24:01.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f43ac13acd0 con 0x7f43ac062da0 2021-02-24T15:24:01.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f439c001c60 con 0x7f43ac063220 2021-02-24T15:24:01.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f43a8001c60 con 0x7f43ac062da0 2021-02-24T15:24:01.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 367645418 0 0) 0x7f43ac096d20 con 0x7f43ac063220 2021-02-24T15:24:01.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.152:6790/0 conn(0x7f43ac062da0 legacy=0x7f43ac096610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.181:6789/0 conn(0x7f43ac099340 legacy=0x7f43ac1421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.790 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac095160 con 0x7f43ac063220 2021-02-24T15:24:01.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.777+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac13a510 con 0x7f43ac063220 2021-02-24T15:24:01.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43b3472700 10 client.28170.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:01.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac093cb0 con 0x7f43ac063220 2021-02-24T15:24:01.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43b3472700 1 librados: init done 2021-02-24T15:24:01.791 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f439c0021f0 con 0x7f43ac063220 2021-02-24T15:24:01.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f439c002500 con 0x7f43ac063220 2021-02-24T15:24:01.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f439c002660 con 0x7f43ac063220 2021-02-24T15:24:01.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f439c03afc0 con 0x7f43ac063220 2021-02-24T15:24:01.792 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43997fa700 10 client.28170.objecter ms_dispatch 0x7f43ac001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:01.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43997fa700 3 client.28170.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:01.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43997fa700 3 client.28170.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:01.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43997fa700 20 client.28170.objecter dump_active .. 0 homeless 2021-02-24T15:24:01.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.778+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4384006550 con 0x7f43840027f0 2021-02-24T15:24:01.793 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.781+0000 7f43b1a0f700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.181:6789/0 conn(0x7f43840027f0 legacy=0x7f4384004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.781+0000 7f43997fa700 10 client.28170.objecter ms_handle_connect 0x7f43840027f0 2021-02-24T15:24:01.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.781+0000 7f43997fa700 10 client.28170.objecter resend_mon_ops 2021-02-24T15:24:01.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.781+0000 7f43997fa700 10 client.28170.objecter ms_handle_connect 0x7f438c0316f0 2021-02-24T15:24:01.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.781+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939692854 0 0) 0x7f4384006550 con 0x7f43840027f0 2021-02-24T15:24:01.794 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.781+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ac096d20 con 0x7f43840027f0 2021-02-24T15:24:01.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.781+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1192535153 0 0) 0x7f43ac096d20 con 0x7f43840027f0 2021-02-24T15:24:01.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.781+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4384006550 con 0x7f43840027f0 2021-02-24T15:24:01.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.781+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f43a4001b90 con 0x7f43840027f0 2021-02-24T15:24:01.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.782+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 900975505 0 0) 0x7f4384006550 con 0x7f43840027f0 2021-02-24T15:24:01.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.782+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4384009df0 con 0x7f43840027f0 2021-02-24T15:24:01.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.782+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f43a4001db0 con 0x7f43840027f0 2021-02-24T15:24:01.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.782+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.181:6789/0 conn(0x7f43840027f0 legacy=0x7f4384004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.782+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.181:6789/0 conn(0x7f43840027f0 legacy=0x7f4384004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:01.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.790+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4384009a60 con 0x7f4384008d80 2021-02-24T15:24:01.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.792+0000 7f43997fa700 10 client.28170.objecter ms_handle_connect 0x7f4384008d80 2021-02-24T15:24:01.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.792+0000 7f43b1a0f700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.181:6789/0 conn(0x7f4384008d80 legacy=0x7f4384009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.792+0000 7f43997fa700 10 client.28170.objecter resend_mon_ops 2021-02-24T15:24:01.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.792+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490300255 0 0) 0x7f4384009a60 con 0x7f4384008d80 2021-02-24T15:24:01.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.792+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4384006550 con 0x7f4384008d80 2021-02-24T15:24:01.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 182191313 0 0) 0x7f4384006550 con 0x7f4384008d80 2021-02-24T15:24:01.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4384009a60 con 0x7f4384008d80 2021-02-24T15:24:01.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f43a40054c0 con 0x7f4384008d80 2021-02-24T15:24:01.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4207485387 0 0) 0x7f4384009a60 con 0x7f4384008d80 2021-02-24T15:24:01.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f43840086f0 con 0x7f4384008d80 2021-02-24T15:24:01.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3940 (unknown 0 0 2228781827) 0x7f43a40057a0 con 0x7f4384008d80 2021-02-24T15:24:01.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.181:6789/0 conn(0x7f4384008d80 legacy=0x7f4384009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.802 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43997fa700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.181:6789/0 conn(0x7f4384008d80 legacy=0x7f4384009210 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:01.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43b3472700 10 librados: watch_flush enter 2021-02-24T15:24:01.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43b3472700 10 librados: watch_flush exit 2021-02-24T15:24:01.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43b3472700 20 client.28170.objecter shutdown clearing up homeless session... 2021-02-24T15:24:01.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43b3472700 10 client.28170.objecter successfully canceled tick 2021-02-24T15:24:01.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.181:6812/33484 conn(0x7f438c0316f0 legacy=0x7f438c033bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 >> v1:172.21.15.152:6789/0 conn(0x7f43ac063220 legacy=0x7f43ac139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43b1a0f700 1 -- 172.21.15.152:0/2818789920 reap_dead start 2021-02-24T15:24:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.793+0000 7f43b1a0f700 1 -- 172.21.15.152:0/2818789920 reap_dead start 2021-02-24T15:24:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.794+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 shutdown_connections 2021-02-24T15:24:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.794+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 >> 172.21.15.152:0/2818789920 conn(0x7f43ac09dcc0 msgr2=0x7f43ac127110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:01.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.794+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 shutdown_connections 2021-02-24T15:24:01.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.794+0000 7f43b3472700 1 -- 172.21.15.152:0/2818789920 wait complete. 2021-02-24T15:24:01.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.794+0000 7f43b3472700 1 librados: shutdown 2021-02-24T15:24:01.805 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:24:01.805 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:01.806 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:01.806 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:24:01.806 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 34, 2021-02-24T15:24:01.806 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:24:01.807 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:24:01.807 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:24:01.807 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:24:01.807 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.807 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:24:01.808 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:01.808 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:24:01.808 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:24:01.808 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:01.808 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:01.809 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:01.809 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:01.809 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:01.810 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:01.810 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:01.810 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:01.810 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:01.810 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.811 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:24:01.811 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:24:01.811 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:01.811 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:01.811 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:01.812 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:01.812 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:01.812 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:01.812 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:01.812 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:01.813 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:01.813 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.813 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:24:01.814 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:24:01.814 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:24:01.814 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:24:01.814 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:24:01.814 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:24:01.815 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:01.815 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:01.815 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:24:01.815 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:24:01.816 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:24:01.816 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:24:01.816 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:24:01.816 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:01.817 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:24:01.817 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:01.817 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:01.817 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:01.817 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:01.818 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:01.818 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:01.818 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:01.818 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:01.819 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:01.819 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.819 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:24:01.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.819 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:24:01.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.820 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:01.820 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:01.820 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:01.820 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:01.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.821 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:01.821 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:24:01.821 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:01.821 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.822 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.822 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:24:01.822 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:24:01.823 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:01.823 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:01.823 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:01.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.824 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:01.824 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:01.824 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:01.824 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:01.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.825 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:01.825 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:24:01.825 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:01.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.826 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.826 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:24:01.826 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:24:01.826 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:01.827 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:01.827 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:01.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.827 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:01.828 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:01.828 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:01.828 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:01.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.828 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:01.829 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:24:01.829 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:01.829 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.829 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.830 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:24:01.830 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:24:01.830 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:01.830 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:01.831 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:01.831 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.831 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.832 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:24:01.832 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:24:01.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.832 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:01.832 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:01.833 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:01.833 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.833 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.833 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:24:01.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.834 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:01.834 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:01.834 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:24:01.834 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.835 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:01.835 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:24:01.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:01.835 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:01.835 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:01.836 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:01.836 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:01.836 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:01.836 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:01.836 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:24:01.837 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:24:01.838 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2021-02-24T15:24:01.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2021-02-24T15:24:01.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.954+0000 7f3582fa5700 1 Processor -- start 2021-02-24T15:24:01.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.954+0000 7f3582fa5700 1 -- start start 2021-02-24T15:24:01.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.954+0000 7f3582fa5700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c066dd0 con 0x7f357c12d2c0 2021-02-24T15:24:01.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.954+0000 7f3582fa5700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c064370 con 0x7f357c067810 2021-02-24T15:24:01.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.954+0000 7f3582fa5700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c0665f0 con 0x7f357c067430 2021-02-24T15:24:01.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.954+0000 7f3581fa3700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f357c067430 0x7f357c063550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36594/0 (socket says 172.21.15.152:36594) 2021-02-24T15:24:01.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.954+0000 7f35827a4700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f357c12d2c0 0x7f357c12f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48122/0 (socket says 172.21.15.152:48122) 2021-02-24T15:24:01.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.954+0000 7f3581fa3700 1 -- 172.21.15.152:0/1349395184 learned_addr learned my addr 172.21.15.152:0/1349395184 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:01.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3581fa3700 1 -- 172.21.15.152:0/1349395184 >> v1:172.21.15.152:6790/0 conn(0x7f357c067430 legacy=0x7f357c063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f35827a4700 1 -- 172.21.15.152:0/1349395184 >> v1:172.21.15.152:6789/0 conn(0x7f357c12d2c0 legacy=0x7f357c12f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f35817a2700 1 -- 172.21.15.152:0/1349395184 >> v1:172.21.15.181:6789/0 conn(0x7f357c067810 legacy=0x7f357c063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115203888 0 0) 0x7f357c066dd0 con 0x7f357c12d2c0 2021-02-24T15:24:01.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3564003230 con 0x7f357c12d2c0 2021-02-24T15:24:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290514734 0 0) 0x7f357c0665f0 con 0x7f357c067430 2021-02-24T15:24:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f357c066dd0 con 0x7f357c067430 2021-02-24T15:24:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188293003 0 0) 0x7f357c064370 con 0x7f357c067810 2021-02-24T15:24:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f357c0665f0 con 0x7f357c067810 2021-02-24T15:24:01.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3214363005 0 0) 0x7f357c066dd0 con 0x7f357c067430 2021-02-24T15:24:01.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 >> v1:172.21.15.181:6789/0 conn(0x7f357c067810 legacy=0x7f357c063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 >> v1:172.21.15.152:6789/0 conn(0x7f357c12d2c0 legacy=0x7f357c12f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c066890 con 0x7f357c067430 2021-02-24T15:24:01.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3578001930 con 0x7f357c067430 2021-02-24T15:24:01.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3578001c40 con 0x7f357c067430 2021-02-24T15:24:01.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.957+0000 7f3580fa1700 1 -- 172.21.15.152:0/1349395184 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3578004750 con 0x7f357c067430 2021-02-24T15:24:01.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.958+0000 7f3582fa5700 1 -- 172.21.15.152:0/1349395184 >> v1:172.21.15.152:6790/0 conn(0x7f357c067430 legacy=0x7f357c063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.958+0000 7f3582fa5700 1 -- 172.21.15.152:0/1349395184 shutdown_connections 2021-02-24T15:24:01.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.958+0000 7f3582fa5700 1 -- 172.21.15.152:0/1349395184 >> 172.21.15.152:0/1349395184 conn(0x7f357c099650 msgr2=0x7f357c099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:01.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.958+0000 7f3582fa5700 1 -- 172.21.15.152:0/1349395184 shutdown_connections 2021-02-24T15:24:01.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.958+0000 7f3582fa5700 1 -- 172.21.15.152:0/1349395184 wait complete. 2021-02-24T15:24:01.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.958+0000 7f3582fa5700 1 librados: starting msgr at 2021-02-24T15:24:01.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.958+0000 7f3582fa5700 1 librados: starting objecter 2021-02-24T15:24:01.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.958+0000 7f3582fa5700 1 Processor -- start 2021-02-24T15:24:01.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.959+0000 7f3582fa5700 1 -- start start 2021-02-24T15:24:01.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.959+0000 7f3582fa5700 1 librados: setting wanted keys 2021-02-24T15:24:01.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.959+0000 7f3582fa5700 1 librados: calling monclient init 2021-02-24T15:24:01.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.959+0000 7f3582fa5700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c126710 con 0x7f357c067430 2021-02-24T15:24:01.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.959+0000 7f3582fa5700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c1269b0 con 0x7f357c12d2c0 2021-02-24T15:24:01.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.959+0000 7f3582fa5700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c126c50 con 0x7f357c067810 2021-02-24T15:24:01.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.959+0000 7f3581fa3700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f357c067430 0x7f357c121fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48124/0 (socket says 172.21.15.152:48124) 2021-02-24T15:24:01.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.959+0000 7f3581fa3700 1 -- 172.21.15.152:0/3093807351 learned_addr learned my addr 172.21.15.152:0/3093807351 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:01.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3581fa3700 1 -- 172.21.15.152:0/3093807351 >> v1:172.21.15.152:6789/0 conn(0x7f357c067430 legacy=0x7f357c121fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3569ffb700 10 client.?.objecter ms_handle_connect 0x7f357c067430 2021-02-24T15:24:01.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3569ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3569ffb700 10 client.?.objecter ms_handle_connect 0x7f357c067810 2021-02-24T15:24:01.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3569ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f35817a2700 1 -- 172.21.15.152:0/3093807351 >> v1:172.21.15.152:6790/0 conn(0x7f357c067810 legacy=0x7f357c1226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3581fa3700 1 --1- 172.21.15.152:0/3093807351 >> v1:172.21.15.152:6789/0 conn(0x7f357c067430 0x7f357c121fd0 :-1 s=OPENED pgs=9062 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f357c126710 auth_reply(proto 2 0 (0) Success) v1 2021-02-24T15:24:01.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3569ffb700 10 client.?.objecter ms_handle_connect 0x7f357c12d2c0 2021-02-24T15:24:01.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f35827a4700 1 -- 172.21.15.152:0/3093807351 >> v1:172.21.15.181:6789/0 conn(0x7f357c12d2c0 legacy=0x7f357c1423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:01.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3569ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:01.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015829400 0 0) 0x7f357c126c50 con 0x7f357c067810 2021-02-24T15:24:01.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f355c004bd0 con 0x7f357c067810 2021-02-24T15:24:01.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f35817a2700 1 -- 172.21.15.152:0/3093807351 >> v1:172.21.15.152:6790/0 conn(0x7f357c067810 legacy=0x7f357c1226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-24T15:24:01.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f35817a2700 1 -- 172.21.15.152:0/3093807351 >> v1:172.21.15.152:6790/0 conn(0x7f357c067810 legacy=0x7f357c1226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:24:01.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f35817a2700 1 --1- 172.21.15.152:0/3093807351 >> v1:172.21.15.152:6790/0 conn(0x7f357c067810 0x7f357c1226e0 :-1 s=OPENED pgs=8344 cs=1 l=1).handle_message read tag failed 2021-02-24T15:24:01.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.961+0000 7f35817a2700 1 --1- 172.21.15.152:0/3093807351 >> v1:172.21.15.152:6790/0 conn(0x7f357c067810 0x7f357c1226e0 :-1 s=OPENED pgs=8344 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:24:01.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192425268 0 0) 0x7f357c1269b0 con 0x7f357c12d2c0 2021-02-24T15:24:01.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f357c126c50 con 0x7f357c12d2c0 2021-02-24T15:24:01.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3066200612 0 0) 0x7f357c126c50 con 0x7f357c12d2c0 2021-02-24T15:24:01.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f357c1269b0 con 0x7f357c12d2c0 2021-02-24T15:24:01.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3574001d10 con 0x7f357c12d2c0 2021-02-24T15:24:01.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1864386770 0 0) 0x7f357c1269b0 con 0x7f357c12d2c0 2021-02-24T15:24:01.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 >> v1:172.21.15.152:6790/0 conn(0x7f357c067810 legacy=0x7f357c1226e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:01.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 >> v1:172.21.15.152:6789/0 conn(0x7f357c067430 legacy=0x7f357c121fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:01.976 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c124ae0 con 0x7f357c12d2c0 2021-02-24T15:24:01.977 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218935991 0 0) 0x7f357c126710 con 0x7f357c067430 2021-02-24T15:24:01.977 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c124040 con 0x7f357c12d2c0 2021-02-24T15:24:01.977 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3574004be0 con 0x7f357c12d2c0 2021-02-24T15:24:01.977 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3574004ef0 con 0x7f357c12d2c0 2021-02-24T15:24:01.978 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3582fa5700 10 client.55783.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:01.978 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c127600 con 0x7f357c12d2c0 2021-02-24T15:24:01.978 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.962+0000 7f3582fa5700 1 librados: init done 2021-02-24T15:24:01.978 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.963+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f35740050d0 con 0x7f357c12d2c0 2021-02-24T15:24:01.978 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.963+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f357403b320 con 0x7f357c12d2c0 2021-02-24T15:24:01.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.963+0000 7f3569ffb700 10 client.55783.objecter ms_dispatch 0x7f357c001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:01.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.963+0000 7f3569ffb700 3 client.55783.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:01.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.963+0000 7f3569ffb700 3 client.55783.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:01.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.963+0000 7f3569ffb700 20 client.55783.objecter dump_active .. 0 homeless 2021-02-24T15:24:01.979 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.963+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c058400 con 0x7f357c12d2c0 2021-02-24T15:24:01.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.966+0000 7f3569ffb700 10 client.55783.objecter ms_handle_connect 0x7f355c0312b0 2021-02-24T15:24:01.980 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:01.968+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f3574012a80 con 0x7f357c12d2c0 2021-02-24T15:24:02.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.207+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f357c062790 con 0x7f357c12d2c0 2021-02-24T15:24:02.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.209+0000 7f3569ffb700 1 -- 172.21.15.152:0/3093807351 <== mon.1 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (unknown 246732539 0 0) 0x7f3574012670 con 0x7f357c12d2c0 2021-02-24T15:24:02.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 10 librados: watch_flush enter 2021-02-24T15:24:02.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 10 librados: watch_flush exit 2021-02-24T15:24:02.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 20 client.55783.objecter shutdown clearing up homeless session... 2021-02-24T15:24:02.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 10 client.55783.objecter successfully canceled tick 2021-02-24T15:24:02.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 >> v1:172.21.15.181:6812/33484 conn(0x7f355c0312b0 legacy=0x7f355c033770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:02.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 >> v1:172.21.15.181:6789/0 conn(0x7f357c12d2c0 legacy=0x7f357c1423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:02.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 shutdown_connections 2021-02-24T15:24:02.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 >> 172.21.15.152:0/3093807351 conn(0x7f357c099650 msgr2=0x7f357c092450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:02.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 shutdown_connections 2021-02-24T15:24:02.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 1 -- 172.21.15.152:0/3093807351 wait complete. 2021-02-24T15:24:02.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:02.211+0000 7f3582fa5700 1 librados: shutdown 2021-02-24T15:24:02.223 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2021-02-24T15:24:02.889 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.887+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:02.889 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.887+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=5,logm=66} crc {auth=1304167071,config=3140514009,health=2769145776,kv=3860807006,logm=2647521997}) 2021-02-24T15:24:02.890 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.887+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=11,kv=6,logm=66} crc {auth=3682601439,config=3140514009,health=1312581462,kv=2558848642,logm=2839817215}) 2021-02-24T15:24:02.890 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.887+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:02.891 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.887+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=5,logm=66} crc {auth=1304167071,config=3140514009,health=2769145776,kv=3860807006,logm=2647521997}) 2021-02-24T15:24:02.891 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.887+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=15,config=2,health=12,kv=6,logm=65} crc {auth=4283762619,config=3140514009,health=2769145776,kv=2558848643,logm=1207803717}) 2021-02-24T15:24:02.973 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.971+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:02.974 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.971+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1215155043}) 2021-02-24T15:24:02.974 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.971+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2839024980}) 2021-02-24T15:24:02.975 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.971+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:02.975 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.971+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1215155043}) 2021-02-24T15:24:02.975 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:02.971+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=933562148}) 2021-02-24T15:24:03.115 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.114+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.116 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.114+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630977804}) 2021-02-24T15:24:03.116 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.114+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2573130376}) 2021-02-24T15:24:03.116 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.114+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.117 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.114+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630977804}) 2021-02-24T15:24:03.117 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.114+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=576792839}) 2021-02-24T15:24:03.119 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.117+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.119 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.117+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598347578}) 2021-02-24T15:24:03.119 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.117+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1070078428}) 2021-02-24T15:24:03.119 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.117+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.120 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.117+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598347578}) 2021-02-24T15:24:03.120 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.117+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4277281483}) 2021-02-24T15:24:03.123 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.121+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.123 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.121+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4085407406}) 2021-02-24T15:24:03.123 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.121+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=614764735}) 2021-02-24T15:24:03.123 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.121+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.124 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.121+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4085407406}) 2021-02-24T15:24:03.124 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.121+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=713981034}) 2021-02-24T15:24:03.225 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:24:03.226 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:24:03.292 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.291+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.293 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.291+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1678912187}) 2021-02-24T15:24:03.293 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.291+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=542166682}) 2021-02-24T15:24:03.293 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.291+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.293 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.291+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1678912187}) 2021-02-24T15:24:03.294 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.291+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3185851229}) 2021-02-24T15:24:03.296 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.294+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.297 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.294+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=88,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1} crc {logm=2252434861,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172}) 2021-02-24T15:24:03.297 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.294+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=89,mdsmap=3,mgr=7,mgr_command_descs=1} crc {logm=3978156224,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828}) 2021-02-24T15:24:03.297 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.294+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.298 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.294+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=88,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1} crc {logm=2252434861,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172}) 2021-02-24T15:24:03.298 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.295+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=88,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1} crc {logm=2318591317,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172}) 2021-02-24T15:24:03.302 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.296+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.302 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.296+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=8,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=33,osdmap=45} crc {mgrstat=2258433556,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=3261772647,osd_snap=2392665411,osdmap=2675490376}) 2021-02-24T15:24:03.302 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.296+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=8,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=32,osdmap=46} crc {mgrstat=3202930814,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=3261772647,osd_snap=4062238856,osdmap=3721109652}) 2021-02-24T15:24:03.303 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.296+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.303 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.296+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=8,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=33,osdmap=45} crc {mgrstat=2258433556,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=3261772647,osd_snap=2392665411,osdmap=2675490376}) 2021-02-24T15:24:03.303 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.296+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=10,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=35,osdmap=41} crc {mgrstat=2878618682,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=3261772647,osd_snap=1036473955,osdmap=1477638895}) 2021-02-24T15:24:03.304 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.297+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.304 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.297+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4176258052}) 2021-02-24T15:24:03.304 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.297+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3009324987}) 2021-02-24T15:24:03.304 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.297+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.305 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.297+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4176258052}) 2021-02-24T15:24:03.305 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.297+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1936955574}) 2021-02-24T15:24:03.305 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.298+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.306 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.298+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2125287436}) 2021-02-24T15:24:03.306 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.298+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2141351051}) 2021-02-24T15:24:03.306 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.298+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.306 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.298+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2125287436}) 2021-02-24T15:24:03.306 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.298+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3183449166}) 2021-02-24T15:24:03.307 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.300+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.307 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.300+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1710889869}) 2021-02-24T15:24:03.307 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.300+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1151690403}) 2021-02-24T15:24:03.307 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.300+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.307 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.300+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1710889869}) 2021-02-24T15:24:03.308 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.300+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3347639976}) 2021-02-24T15:24:03.309 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.301+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.309 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.302+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=44} crc {osdmap=1756290749}) 2021-02-24T15:24:03.309 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.302+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=40} crc {osdmap=1554279922}) 2021-02-24T15:24:03.309 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.302+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:24:03.310 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.302+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=44} crc {osdmap=1756290749}) 2021-02-24T15:24:03.310 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:24:03.302+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=44} crc {osdmap=144007600}) 2021-02-24T15:24:03.361 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.358+0000 7f8c65680700 1 Processor -- start 2021-02-24T15:24:03.361 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.359+0000 7f8c65680700 1 -- start start 2021-02-24T15:24:03.362 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.359+0000 7f8c65680700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c600922a0 con 0x7f8c600939f0 2021-02-24T15:24:03.362 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.359+0000 7f8c65680700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c60092540 con 0x7f8c6012e1c0 2021-02-24T15:24:03.363 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.359+0000 7f8c65680700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c600927e0 con 0x7f8c600945b0 2021-02-24T15:24:03.363 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.359+0000 7f8c5effd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f8c600945b0 0x7f8c6008fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36608/0 (socket says 172.21.15.152:36608) 2021-02-24T15:24:03.363 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.359+0000 7f8c5effd700 1 -- 172.21.15.152:0/1393965883 learned_addr learned my addr 172.21.15.152:0/1393965883 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:03.364 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.359+0000 7f8c5e7fc700 1 --1- 172.21.15.152:0/1393965883 >> v1:172.21.15.152:6789/0 conn(0x7f8c600939f0 0x7f8c60090130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48132/0 (socket says 172.21.15.152:48132) 2021-02-24T15:24:03.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.361+0000 7f8c5e7fc700 1 -- 172.21.15.152:0/1393965883 >> v1:172.21.15.152:6789/0 conn(0x7f8c600939f0 legacy=0x7f8c60090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5effd700 1 -- 172.21.15.152:0/1393965883 >> v1:172.21.15.152:6790/0 conn(0x7f8c600945b0 legacy=0x7f8c6008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5f7fe700 1 -- 172.21.15.152:0/1393965883 >> v1:172.21.15.181:6789/0 conn(0x7f8c6012e1c0 legacy=0x7f8c601305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589370943 0 0) 0x7f8c600922a0 con 0x7f8c600939f0 2021-02-24T15:24:03.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c4c003230 con 0x7f8c600939f0 2021-02-24T15:24:03.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001829989 0 0) 0x7f8c600927e0 con 0x7f8c600945b0 2021-02-24T15:24:03.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c600922a0 con 0x7f8c600945b0 2021-02-24T15:24:03.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808825717 0 0) 0x7f8c60092540 con 0x7f8c6012e1c0 2021-02-24T15:24:03.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c600927e0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3096215868 0 0) 0x7f8c4c003230 con 0x7f8c600939f0 2021-02-24T15:24:03.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 >> v1:172.21.15.152:6790/0 conn(0x7f8c600945b0 legacy=0x7f8c6008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 >> v1:172.21.15.181:6789/0 conn(0x7f8c6012e1c0 legacy=0x7f8c601305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60092a80 con 0x7f8c600939f0 2021-02-24T15:24:03.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8c540019f0 con 0x7f8c600939f0 2021-02-24T15:24:03.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8c54001ca0 con 0x7f8c600939f0 2021-02-24T15:24:03.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.362+0000 7f8c5dffb700 1 -- 172.21.15.152:0/1393965883 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8c54004690 con 0x7f8c600939f0 2021-02-24T15:24:03.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.363+0000 7f8c65680700 1 -- 172.21.15.152:0/1393965883 >> v1:172.21.15.152:6789/0 conn(0x7f8c600939f0 legacy=0x7f8c60090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.363+0000 7f8c65680700 1 -- 172.21.15.152:0/1393965883 shutdown_connections 2021-02-24T15:24:03.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.363+0000 7f8c65680700 1 -- 172.21.15.152:0/1393965883 >> 172.21.15.152:0/1393965883 conn(0x7f8c600999a0 msgr2=0x7f8c60099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:03.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.363+0000 7f8c65680700 1 -- 172.21.15.152:0/1393965883 shutdown_connections 2021-02-24T15:24:03.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.363+0000 7f8c65680700 1 -- 172.21.15.152:0/1393965883 wait complete. 2021-02-24T15:24:03.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c65680700 1 librados: starting msgr at 2021-02-24T15:24:03.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c65680700 1 librados: starting objecter 2021-02-24T15:24:03.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c65680700 1 Processor -- start 2021-02-24T15:24:03.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c65680700 1 -- start start 2021-02-24T15:24:03.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c65680700 1 librados: setting wanted keys 2021-02-24T15:24:03.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c65680700 1 librados: calling monclient init 2021-02-24T15:24:03.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c65680700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c601342f0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c65680700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c60127e00 con 0x7f8c600945b0 2021-02-24T15:24:03.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c65680700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c60111e60 con 0x7f8c600939f0 2021-02-24T15:24:03.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c5effd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f8c600939f0 0x7f8c60133be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36614/0 (socket says 172.21.15.152:36614) 2021-02-24T15:24:03.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.364+0000 7f8c5effd700 1 -- 172.21.15.152:0/1806979602 learned_addr learned my addr 172.21.15.152:0/1806979602 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:03.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.366+0000 7f8c5f7fe700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6789/0 conn(0x7f8c6012e1c0 legacy=0x7f8c6013ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.366+0000 7f8c46ffd700 10 client.?.objecter ms_handle_connect 0x7f8c6012e1c0 2021-02-24T15:24:03.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.366+0000 7f8c46ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.366+0000 7f8c5effd700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6790/0 conn(0x7f8c600939f0 legacy=0x7f8c60133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.366+0000 7f8c46ffd700 10 client.?.objecter ms_handle_connect 0x7f8c600939f0 2021-02-24T15:24:03.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:03.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945879035 0 0) 0x7f8c601342f0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c40004bd0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 10 client.?.objecter ms_handle_connect 0x7f8c600945b0 2021-02-24T15:24:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c5e7fc700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.181:6789/0 conn(0x7f8c600945b0 legacy=0x7f8c601276f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101627929 0 0) 0x7f8c60111e60 con 0x7f8c600939f0 2021-02-24T15:24:03.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c601342f0 con 0x7f8c600939f0 2021-02-24T15:24:03.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064375010 0 0) 0x7f8c60127e00 con 0x7f8c600945b0 2021-02-24T15:24:03.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c60111e60 con 0x7f8c600945b0 2021-02-24T15:24:03.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3595546760 0 0) 0x7f8c601342f0 con 0x7f8c600939f0 2021-02-24T15:24:03.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c60127e00 con 0x7f8c600939f0 2021-02-24T15:24:03.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8c50001c60 con 0x7f8c600939f0 2021-02-24T15:24:03.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2887497639 0 0) 0x7f8c40004bd0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c601342f0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8c58001fa0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3423533101 0 0) 0x7f8c60127e00 con 0x7f8c600939f0 2021-02-24T15:24:03.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.181:6789/0 conn(0x7f8c600945b0 legacy=0x7f8c601276f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6789/0 conn(0x7f8c6012e1c0 legacy=0x7f8c6013ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60112100 con 0x7f8c600939f0 2021-02-24T15:24:03.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c65680700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c60110c30 con 0x7f8c600939f0 2021-02-24T15:24:03.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c65680700 10 client.84128.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:03.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c65680700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c60066120 con 0x7f8c600939f0 2021-02-24T15:24:03.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c65680700 1 librados: init done 2021-02-24T15:24:03.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c5effd700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6790/0 conn(0x7f8c600939f0 legacy=0x7f8c60133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-24T15:24:03.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c5effd700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6790/0 conn(0x7f8c600939f0 legacy=0x7f8c60133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:24:03.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c5effd700 1 --1- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6790/0 conn(0x7f8c600939f0 0x7f8c60133be0 :-1 s=OPENED pgs=8346 cs=1 l=1).handle_message read tag failed 2021-02-24T15:24:03.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c5effd700 1 --1- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6790/0 conn(0x7f8c600939f0 0x7f8c60133be0 :-1 s=OPENED pgs=8346 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:24:03.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6790/0 conn(0x7f8c600939f0 legacy=0x7f8c60133be0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:03.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8c60127e00 con 0x7f8c6012e1c0 2021-02-24T15:24:03.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8c40004bd0 con 0x7f8c600945b0 2021-02-24T15:24:03.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.367+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f8c40012f30 con 0x7f8c400058d0 2021-02-24T15:24:03.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.369+0000 7f8c46ffd700 10 client.84128.objecter ms_handle_connect 0x7f8c6012e1c0 2021-02-24T15:24:03.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.369+0000 7f8c46ffd700 10 client.84128.objecter resend_mon_ops 2021-02-24T15:24:03.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.369+0000 7f8c5e7fc700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6789/0 conn(0x7f8c6012e1c0 legacy=0x7f8c4000c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c5f7fe700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6790/0 conn(0x7f8c400058d0 legacy=0x7f8c4000f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 10 client.84128.objecter ms_handle_connect 0x7f8c400058d0 2021-02-24T15:24:03.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 10 client.84128.objecter resend_mon_ops 2021-02-24T15:24:03.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 10 client.84128.objecter ms_handle_connect 0x7f8c600945b0 2021-02-24T15:24:03.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c5effd700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.181:6789/0 conn(0x7f8c600945b0 legacy=0x7f8c40005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 10 client.84128.objecter resend_mon_ops 2021-02-24T15:24:03.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111800667 0 0) 0x7f8c60127e00 con 0x7f8c6012e1c0 2021-02-24T15:24:03.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c400130c0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513074454 0 0) 0x7f8c40012f30 con 0x7f8c400058d0 2021-02-24T15:24:03.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c60127e00 con 0x7f8c400058d0 2021-02-24T15:24:03.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786018289 0 0) 0x7f8c40004bd0 con 0x7f8c600945b0 2021-02-24T15:24:03.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c40012f30 con 0x7f8c600945b0 2021-02-24T15:24:03.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 633094433 0 0) 0x7f8c60127e00 con 0x7f8c400058d0 2021-02-24T15:24:03.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c40004bd0 con 0x7f8c400058d0 2021-02-24T15:24:03.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8c58005e00 con 0x7f8c400058d0 2021-02-24T15:24:03.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2136466692 0 0) 0x7f8c400130c0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c60127e00 con 0x7f8c6012e1c0 2021-02-24T15:24:03.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8c540044f0 con 0x7f8c6012e1c0 2021-02-24T15:24:03.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3000944893 0 0) 0x7f8c40012f30 con 0x7f8c600945b0 2021-02-24T15:24:03.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c400130c0 con 0x7f8c600945b0 2021-02-24T15:24:03.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8c50004ed0 con 0x7f8c600945b0 2021-02-24T15:24:03.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3318065293 0 0) 0x7f8c40004bd0 con 0x7f8c400058d0 2021-02-24T15:24:03.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.181:6789/0 conn(0x7f8c600945b0 legacy=0x7f8c40005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6789/0 conn(0x7f8c6012e1c0 legacy=0x7f8c4000c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) v3 -- 0x7f8c40014250 con 0x7f8c400058d0 2021-02-24T15:24:03.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60098900 con 0x7f8c400058d0 2021-02-24T15:24:03.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60127e00 con 0x7f8c400058d0 2021-02-24T15:24:03.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.370+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8c58006320 con 0x7f8c400058d0 2021-02-24T15:24:03.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.371+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f8c58006510 con 0x7f8c400058d0 2021-02-24T15:24:03.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.371+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 7 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f8c5803b630 con 0x7f8c400058d0 2021-02-24T15:24:03.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.371+0000 7f8c46ffd700 10 client.84128.objecter ms_dispatch 0x7f8c60001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:03.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.371+0000 7f8c46ffd700 3 client.84128.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:03.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.371+0000 7f8c46ffd700 3 client.84128.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:03.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.371+0000 7f8c46ffd700 20 client.84128.objecter dump_active .. 0 homeless 2021-02-24T15:24:03.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.374+0000 7f8c46ffd700 10 client.84128.objecter ms_handle_connect 0x7f8c600939f0 2021-02-24T15:24:03.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.375+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f8c58012b60 con 0x7f8c400058d0 2021-02-24T15:24:03.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.378+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f8c58012980 con 0x7f8c400058d0 2021-02-24T15:24:03.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.609+0000 7f8c65680700 1 -- 172.21.15.152:0/1806979602 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8c60110000 con 0x7f8c400058d0 2021-02-24T15:24:03.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.610+0000 7f8c46ffd700 1 -- 172.21.15.152:0/1806979602 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 3270464891) 0x7f8c58012fc0 con 0x7f8c400058d0 2021-02-24T15:24:03.612 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:24:03.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.611+0000 7f8c65680700 10 librados: watch_flush enter 2021-02-24T15:24:03.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.611+0000 7f8c65680700 10 librados: watch_flush exit 2021-02-24T15:24:03.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.611+0000 7f8c65680700 20 client.84128.objecter shutdown clearing up homeless session... 2021-02-24T15:24:03.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.611+0000 7f8c65680700 10 client.84128.objecter successfully canceled tick 2021-02-24T15:24:03.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.612+0000 7f8c65680700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.181:6812/33484 conn(0x7f8c600939f0 legacy=0x7f8c4003f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.612+0000 7f8c65680700 1 -- 172.21.15.152:0/1806979602 >> v1:172.21.15.152:6790/0 conn(0x7f8c400058d0 legacy=0x7f8c4000f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.612+0000 7f8c65680700 1 -- 172.21.15.152:0/1806979602 shutdown_connections 2021-02-24T15:24:03.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.612+0000 7f8c65680700 1 -- 172.21.15.152:0/1806979602 >> 172.21.15.152:0/1806979602 conn(0x7f8c600999a0 msgr2=0x7f8c600977d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:03.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.612+0000 7f8c65680700 1 -- 172.21.15.152:0/1806979602 shutdown_connections 2021-02-24T15:24:03.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.612+0000 7f8c65680700 1 -- 172.21.15.152:0/1806979602 wait complete. 2021-02-24T15:24:03.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.612+0000 7f8c65680700 1 librados: shutdown 2021-02-24T15:24:03.625 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:24:03.625 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-02-24T15:24:03.625 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:24:03.742 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.741+0000 7f5310b4e700 1 Processor -- start 2021-02-24T15:24:03.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.741+0000 7f5310b4e700 1 -- start start 2021-02-24T15:24:03.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.742+0000 7f5310b4e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c062660 con 0x7f530c0966a0 2021-02-24T15:24:03.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.742+0000 7f5310b4e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c063af0 con 0x7f530c095bb0 2021-02-24T15:24:03.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.742+0000 7f5310b4e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c063d90 con 0x7f530c068410 2021-02-24T15:24:03.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.742+0000 7f530ad9d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f530c068410 0x7f530c133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36632/0 (socket says 172.21.15.152:36632) 2021-02-24T15:24:03.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.742+0000 7f530a59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f530c0966a0 0x7f530c096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48152/0 (socket says 172.21.15.152:48152) 2021-02-24T15:24:03.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.742+0000 7f530ad9d700 1 -- 172.21.15.152:0/510807797 learned_addr learned my addr 172.21.15.152:0/510807797 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:03.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530ad9d700 1 -- 172.21.15.152:0/510807797 >> v1:172.21.15.152:6790/0 conn(0x7f530c068410 legacy=0x7f530c133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530a59c700 1 -- 172.21.15.152:0/510807797 >> v1:172.21.15.152:6789/0 conn(0x7f530c0966a0 legacy=0x7f530c096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f5309d9b700 1 -- 172.21.15.152:0/510807797 >> v1:172.21.15.181:6789/0 conn(0x7f530c095bb0 legacy=0x7f530c130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341578585 0 0) 0x7f530c062660 con 0x7f530c0966a0 2021-02-24T15:24:03.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f0003230 con 0x7f530c0966a0 2021-02-24T15:24:03.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034485492 0 0) 0x7f530c063d90 con 0x7f530c068410 2021-02-24T15:24:03.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f530c062660 con 0x7f530c068410 2021-02-24T15:24:03.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221564180 0 0) 0x7f530c063af0 con 0x7f530c095bb0 2021-02-24T15:24:03.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f530c063d90 con 0x7f530c095bb0 2021-02-24T15:24:03.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 691046071 0 0) 0x7f530c062660 con 0x7f530c068410 2021-02-24T15:24:03.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 >> v1:172.21.15.181:6789/0 conn(0x7f530c095bb0 legacy=0x7f530c130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 >> v1:172.21.15.152:6789/0 conn(0x7f530c0966a0 legacy=0x7f530c096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c064030 con 0x7f530c068410 2021-02-24T15:24:03.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.744+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5304001d70 con 0x7f530c068410 2021-02-24T15:24:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.745+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5304002050 con 0x7f530c068410 2021-02-24T15:24:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.745+0000 7f530959a700 1 -- 172.21.15.152:0/510807797 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5304004ad0 con 0x7f530c068410 2021-02-24T15:24:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.745+0000 7f5310b4e700 1 -- 172.21.15.152:0/510807797 >> v1:172.21.15.152:6790/0 conn(0x7f530c068410 legacy=0x7f530c133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.745+0000 7f5310b4e700 1 -- 172.21.15.152:0/510807797 shutdown_connections 2021-02-24T15:24:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.745+0000 7f5310b4e700 1 -- 172.21.15.152:0/510807797 >> 172.21.15.152:0/510807797 conn(0x7f530c09ba40 msgr2=0x7f530c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:03.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.745+0000 7f5310b4e700 1 -- 172.21.15.152:0/510807797 shutdown_connections 2021-02-24T15:24:03.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.745+0000 7f5310b4e700 1 -- 172.21.15.152:0/510807797 wait complete. 2021-02-24T15:24:03.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f5310b4e700 1 librados: starting msgr at 2021-02-24T15:24:03.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f5310b4e700 1 librados: starting objecter 2021-02-24T15:24:03.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f5310b4e700 1 Processor -- start 2021-02-24T15:24:03.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f5310b4e700 1 -- start start 2021-02-24T15:24:03.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f5310b4e700 1 librados: setting wanted keys 2021-02-24T15:24:03.754 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f5310b4e700 1 librados: calling monclient init 2021-02-24T15:24:03.758 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f5310b4e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c063010 con 0x7f530c068410 2021-02-24T15:24:03.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f5310b4e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c11ac40 con 0x7f530c0966a0 2021-02-24T15:24:03.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f5310b4e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c067580 con 0x7f530c095bb0 2021-02-24T15:24:03.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f530a59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f530c068410 0x7f530c13a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48158/0 (socket says 172.21.15.152:48158) 2021-02-24T15:24:03.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.746+0000 7f530a59c700 1 -- 172.21.15.152:0/1021916407 learned_addr learned my addr 172.21.15.152:0/1021916407 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f530a59c700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6789/0 conn(0x7f530c068410 legacy=0x7f530c13a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f5309d9b700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6790/0 conn(0x7f530c095bb0 legacy=0x7f530c133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 10 client.?.objecter ms_handle_connect 0x7f530c068410 2021-02-24T15:24:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 10 client.?.objecter ms_handle_connect 0x7f530c095bb0 2021-02-24T15:24:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193097201 0 0) 0x7f530c063010 con 0x7f530c068410 2021-02-24T15:24:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e8004bd0 con 0x7f530c068410 2021-02-24T15:24:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742444339 0 0) 0x7f530c067580 con 0x7f530c095bb0 2021-02-24T15:24:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f530c063010 con 0x7f530c095bb0 2021-02-24T15:24:03.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 10 client.?.objecter ms_handle_connect 0x7f530c0966a0 2021-02-24T15:24:03.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f530ad9d700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.181:6789/0 conn(0x7f530c0966a0 legacy=0x7f530c142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:03.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3925636167 0 0) 0x7f530c063010 con 0x7f530c095bb0 2021-02-24T15:24:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f530c067580 con 0x7f530c095bb0 2021-02-24T15:24:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5300001be0 con 0x7f530c095bb0 2021-02-24T15:24:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1461830713 0 0) 0x7f52e8004bd0 con 0x7f530c068410 2021-02-24T15:24:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f530c063010 con 0x7f530c068410 2021-02-24T15:24:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52fc001c60 con 0x7f530c068410 2021-02-24T15:24:03.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2001595819 0 0) 0x7f530c067580 con 0x7f530c095bb0 2021-02-24T15:24:03.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.181:6789/0 conn(0x7f530c0966a0 legacy=0x7f530c142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6789/0 conn(0x7f530c068410 legacy=0x7f530c13a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c134440 con 0x7f530c095bb0 2021-02-24T15:24:03.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c11a240 con 0x7f530c095bb0 2021-02-24T15:24:03.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f5310b4e700 10 client.84134.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:03.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c118c00 con 0x7f530c095bb0 2021-02-24T15:24:03.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f5310b4e700 1 librados: init done 2021-02-24T15:24:03.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5300002230 con 0x7f530c095bb0 2021-02-24T15:24:03.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.749+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f5300002540 con 0x7f530c095bb0 2021-02-24T15:24:03.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.750+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f5300002720 con 0x7f530c095bb0 2021-02-24T15:24:03.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.750+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f52ec006550 con 0x7f52ec0027f0 2021-02-24T15:24:03.766 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.750+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f530003b000 con 0x7f530c095bb0 2021-02-24T15:24:03.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.750+0000 7f52fa7fc700 10 client.84134.objecter ms_dispatch 0x7f530c001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:03.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.750+0000 7f52fa7fc700 3 client.84134.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:03.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.750+0000 7f52fa7fc700 3 client.84134.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:03.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.750+0000 7f52fa7fc700 20 client.84134.objecter dump_active .. 0 homeless 2021-02-24T15:24:03.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.752+0000 7f52fa7fc700 10 client.84134.objecter ms_handle_connect 0x7f52ec0027f0 2021-02-24T15:24:03.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.752+0000 7f52fa7fc700 10 client.84134.objecter resend_mon_ops 2021-02-24T15:24:03.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.752+0000 7f530a59c700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6789/0 conn(0x7f52ec0027f0 legacy=0x7f52ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.752+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086162819 0 0) 0x7f52ec006550 con 0x7f52ec0027f0 2021-02-24T15:24:03.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.752+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f530c067580 con 0x7f52ec0027f0 2021-02-24T15:24:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.752+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4268270782 0 0) 0x7f530c067580 con 0x7f52ec0027f0 2021-02-24T15:24:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.752+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52ec006550 con 0x7f52ec0027f0 2021-02-24T15:24:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.752+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52fc004930 con 0x7f52ec0027f0 2021-02-24T15:24:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.753+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2038885838 0 0) 0x7f52ec006550 con 0x7f52ec0027f0 2021-02-24T15:24:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.753+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52ec009df0 con 0x7f52ec0027f0 2021-02-24T15:24:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.753+0000 7f52fa7fc700 10 client.84134.objecter ms_handle_connect 0x7f52e8031570 2021-02-24T15:24:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.753+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f52fc004d00 con 0x7f52ec0027f0 2021-02-24T15:24:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.753+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6789/0 conn(0x7f52ec0027f0 legacy=0x7f52ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.753+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6789/0 conn(0x7f52ec0027f0 legacy=0x7f52ec004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:03.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.761+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f52ec007520 con 0x7f52ec0068c0 2021-02-24T15:24:03.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f530a59c700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6789/0 conn(0x7f52ec0068c0 legacy=0x7f52ec006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 10 client.84134.objecter ms_handle_connect 0x7f52ec0068c0 2021-02-24T15:24:03.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 10 client.84134.objecter resend_mon_ops 2021-02-24T15:24:03.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528615513 0 0) 0x7f52ec007520 con 0x7f52ec0068c0 2021-02-24T15:24:03.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ec006550 con 0x7f52ec0068c0 2021-02-24T15:24:03.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 269295137 0 0) 0x7f52ec006550 con 0x7f52ec0068c0 2021-02-24T15:24:03.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52ec007520 con 0x7f52ec0068c0 2021-02-24T15:24:03.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f52fc005400 con 0x7f52ec0068c0 2021-02-24T15:24:03.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1967046887 0 0) 0x7f52ec007520 con 0x7f52ec0068c0 2021-02-24T15:24:03.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f52ec008720 con 0x7f52ec0068c0 2021-02-24T15:24:03.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4112 (unknown 0 0 714969060) 0x7f52fc006730 con 0x7f52ec0068c0 2021-02-24T15:24:03.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6789/0 conn(0x7f52ec0068c0 legacy=0x7f52ec006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f52fa7fc700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6789/0 conn(0x7f52ec0068c0 legacy=0x7f52ec006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:03.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 10 librados: watch_flush enter 2021-02-24T15:24:03.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 10 librados: watch_flush exit 2021-02-24T15:24:03.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 20 client.84134.objecter shutdown clearing up homeless session... 2021-02-24T15:24:03.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 10 client.84134.objecter successfully canceled tick 2021-02-24T15:24:03.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.181:6812/33484 conn(0x7f52e8031570 legacy=0x7f52e8033a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 >> v1:172.21.15.152:6790/0 conn(0x7f530c095bb0 legacy=0x7f530c133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f530ad9d700 1 -- 172.21.15.152:0/1021916407 reap_dead start 2021-02-24T15:24:03.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f530ad9d700 1 -- 172.21.15.152:0/1021916407 reap_dead start 2021-02-24T15:24:03.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 shutdown_connections 2021-02-24T15:24:03.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 >> 172.21.15.152:0/1021916407 conn(0x7f530c09ba40 msgr2=0x7f530c09a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:03.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 shutdown_connections 2021-02-24T15:24:03.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 1 -- 172.21.15.152:0/1021916407 wait complete. 2021-02-24T15:24:03.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.764+0000 7f5310b4e700 1 librados: shutdown 2021-02-24T15:24:03.781 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:24:03.781 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:03.781 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:03.781 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:24:03.782 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 34, 2021-02-24T15:24:03.782 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:24:03.782 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:24:03.783 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:24:03.783 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:24:03.783 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:03.783 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 2, 2021-02-24T15:24:03.784 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:03.784 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:24:03.784 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:24:03.784 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:03.784 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:03.785 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:03.785 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:03.785 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:03.785 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:03.785 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:03.786 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:03.786 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:03.786 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:03.786 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:24:03.787 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:24:03.787 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:03.787 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:03.787 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:03.787 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:03.788 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:03.788 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:03.788 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:03.788 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:03.788 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:03.789 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:03.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.789 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:24:03.789 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:24:03.790 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:24:03.790 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:24:03.790 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:24:03.790 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:24:03.791 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:03.791 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:03.791 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:24:03.791 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:24:03.792 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:24:03.792 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:24:03.792 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:24:03.792 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:03.792 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:24:03.793 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:03.793 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:03.793 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:03.794 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:03.794 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:03.794 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:03.794 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:03.794 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:03.795 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:03.795 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:03.795 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:24:03.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.795 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:24:03.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.796 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:03.796 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:03.796 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:03.797 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:03.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.797 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:03.797 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:24:03.797 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:03.798 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.798 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:03.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.798 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:24:03.798 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:24:03.799 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:03.799 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:03.799 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:03.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.800 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:03.800 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:03.800 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:03.800 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:03.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.801 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:03.801 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:24:03.801 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:03.801 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.802 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:03.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.802 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:24:03.802 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:24:03.803 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:03.803 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:03.803 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:03.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.804 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:03.804 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:03.804 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:03.804 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:03.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.805 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:03.805 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:24:03.805 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:03.805 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.805 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:03.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.806 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:24:03.806 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:24:03.806 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:03.807 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:03.807 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:03.807 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.807 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:03.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.808 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:24:03.808 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:24:03.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.808 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:03.809 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:03.809 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:03.809 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.809 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:03.810 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:24:03.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.810 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:03.810 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:03.811 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:24:03.811 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.811 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:03.812 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:24:03.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.812 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:03.812 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:03.812 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:24:03.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.813 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:03.813 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:24:03.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.813 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:03.815 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:03.815 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:03.816 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.816 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:03.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.817 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:24:03.817 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:24:03.819 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:24:03.936 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.935+0000 7f31a5295700 1 Processor -- start 2021-02-24T15:24:03.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.935+0000 7f31a5295700 1 -- start start 2021-02-24T15:24:03.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.936+0000 7f31a5295700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a0097d40 con 0x7f31a0063220 2021-02-24T15:24:03.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.936+0000 7f31a5295700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a0063d00 con 0x7f31a0099340 2021-02-24T15:24:03.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.936+0000 7f31a5295700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a0097980 con 0x7f31a0062da0 2021-02-24T15:24:03.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.936+0000 7f319f7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f31a0063220 0x7f31a0133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48174/0 (socket says 172.21.15.152:48174) 2021-02-24T15:24:03.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.936+0000 7f319e7fc700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f31a0062da0 0x7f31a012fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36646/0 (socket says 172.21.15.152:36646) 2021-02-24T15:24:03.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.936+0000 7f319f7fe700 1 -- 172.21.15.152:0/1119959404 learned_addr learned my addr 172.21.15.152:0/1119959404 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:03.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319f7fe700 1 -- 172.21.15.152:0/1119959404 >> v1:172.21.15.152:6789/0 conn(0x7f31a0063220 legacy=0x7f31a0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319e7fc700 1 -- 172.21.15.152:0/1119959404 >> v1:172.21.15.152:6790/0 conn(0x7f31a0062da0 legacy=0x7f31a012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319effd700 1 -- 172.21.15.152:0/1119959404 >> v1:172.21.15.181:6789/0 conn(0x7f31a0099340 legacy=0x7f31a0097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226805665 0 0) 0x7f31a0097d40 con 0x7f31a0063220 2021-02-24T15:24:03.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f318c003230 con 0x7f31a0063220 2021-02-24T15:24:03.942 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632782659 0 0) 0x7f31a0097980 con 0x7f31a0062da0 2021-02-24T15:24:03.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a0097d40 con 0x7f31a0062da0 2021-02-24T15:24:03.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621016575 0 0) 0x7f31a0063d00 con 0x7f31a0099340 2021-02-24T15:24:03.943 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a0097980 con 0x7f31a0099340 2021-02-24T15:24:03.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3797584998 0 0) 0x7f318c003230 con 0x7f31a0063220 2021-02-24T15:24:03.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 >> v1:172.21.15.152:6790/0 conn(0x7f31a0062da0 legacy=0x7f31a012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 >> v1:172.21.15.181:6789/0 conn(0x7f31a0099340 legacy=0x7f31a0097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.944 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a008fac0 con 0x7f31a0063220 2021-02-24T15:24:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.938+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3198001d70 con 0x7f31a0063220 2021-02-24T15:24:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.939+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3198002020 con 0x7f31a0063220 2021-02-24T15:24:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.939+0000 7f319dffb700 1 -- 172.21.15.152:0/1119959404 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3198004ad0 con 0x7f31a0063220 2021-02-24T15:24:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.939+0000 7f31a5295700 1 -- 172.21.15.152:0/1119959404 >> v1:172.21.15.152:6789/0 conn(0x7f31a0063220 legacy=0x7f31a0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.945 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.939+0000 7f31a5295700 1 -- 172.21.15.152:0/1119959404 shutdown_connections 2021-02-24T15:24:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.939+0000 7f31a5295700 1 -- 172.21.15.152:0/1119959404 >> 172.21.15.152:0/1119959404 conn(0x7f31a009dcc0 msgr2=0x7f31a009e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.939+0000 7f31a5295700 1 -- 172.21.15.152:0/1119959404 shutdown_connections 2021-02-24T15:24:03.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.939+0000 7f31a5295700 1 -- 172.21.15.152:0/1119959404 wait complete. 2021-02-24T15:24:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.940+0000 7f31a5295700 1 librados: starting msgr at 2021-02-24T15:24:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.940+0000 7f31a5295700 1 librados: starting objecter 2021-02-24T15:24:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.940+0000 7f31a5295700 1 Processor -- start 2021-02-24T15:24:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.940+0000 7f31a5295700 1 -- start start 2021-02-24T15:24:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.940+0000 7f31a5295700 1 librados: setting wanted keys 2021-02-24T15:24:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.940+0000 7f31a5295700 1 librados: calling monclient init 2021-02-24T15:24:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.940+0000 7f31a5295700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a0128180 con 0x7f31a0099340 2021-02-24T15:24:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.940+0000 7f31a5295700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a013adf0 con 0x7f31a0062da0 2021-02-24T15:24:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.940+0000 7f31a5295700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a00923b0 con 0x7f31a0063220 2021-02-24T15:24:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.941+0000 7f319f7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f31a0099340 0x7f31a0142290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48180/0 (socket says 172.21.15.152:48180) 2021-02-24T15:24:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.941+0000 7f319f7fe700 1 -- 172.21.15.152:0/2180855835 learned_addr learned my addr 172.21.15.152:0/2180855835 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.941+0000 7f319e7fc700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f31a0063220 0x7f31a0096890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36654/0 (socket says 172.21.15.152:36654) 2021-02-24T15:24:03.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f319f7fe700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6789/0 conn(0x7f31a0099340 legacy=0x7f31a0142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 10 client.?.objecter ms_handle_connect 0x7f31a0099340 2021-02-24T15:24:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 10 client.?.objecter ms_handle_connect 0x7f31a0063220 2021-02-24T15:24:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:03.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f319e7fc700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6790/0 conn(0x7f31a0063220 legacy=0x7f31a0096890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956293648 0 0) 0x7f31a0128180 con 0x7f31a0099340 2021-02-24T15:24:03.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f319e7fc700 1 --1- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6790/0 conn(0x7f31a0063220 0x7f31a0096890 :-1 s=OPENED pgs=8351 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f31a00923b0 auth_reply(proto 2 0 (0) Success) v1 2021-02-24T15:24:03.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3180004bd0 con 0x7f31a0099340 2021-02-24T15:24:03.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 10 client.?.objecter ms_handle_connect 0x7f31a0062da0 2021-02-24T15:24:03.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f319effd700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.181:6789/0 conn(0x7f31a0062da0 legacy=0x7f31a013a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:03.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3949809437 0 0) 0x7f3180004bd0 con 0x7f31a0099340 2021-02-24T15:24:03.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31a0128180 con 0x7f31a0099340 2021-02-24T15:24:03.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3198004a10 con 0x7f31a0099340 2021-02-24T15:24:03.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532499960 0 0) 0x7f31a013adf0 con 0x7f31a0062da0 2021-02-24T15:24:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3180004bd0 con 0x7f31a0062da0 2021-02-24T15:24:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4227795948 0 0) 0x7f31a0128180 con 0x7f31a0099340 2021-02-24T15:24:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6790/0 conn(0x7f31a0063220 legacy=0x7f31a0096890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.181:6789/0 conn(0x7f31a0062da0 legacy=0x7f31a013a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0091540 con 0x7f31a0099340 2021-02-24T15:24:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940593895 0 0) 0x7f31a00923b0 con 0x7f31a0063220 2021-02-24T15:24:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a013a7f0 con 0x7f31a0099340 2021-02-24T15:24:03.960 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f31a5295700 10 client.28200.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:03.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a0096fa0 con 0x7f31a0099340 2021-02-24T15:24:03.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f31a5295700 1 librados: init done 2021-02-24T15:24:03.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f31980050f0 con 0x7f31a0099340 2021-02-24T15:24:03.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.943+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3198005400 con 0x7f31a0099340 2021-02-24T15:24:03.961 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.944+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3178006550 con 0x7f31780027f0 2021-02-24T15:24:03.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.944+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f319800df00 con 0x7f31a0099340 2021-02-24T15:24:03.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.944+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f319803b530 con 0x7f31a0099340 2021-02-24T15:24:03.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.944+0000 7f3186ffd700 10 client.28200.objecter ms_dispatch 0x7f31a0001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:03.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.944+0000 7f3186ffd700 3 client.28200.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:03.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.944+0000 7f3186ffd700 3 client.28200.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:03.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.944+0000 7f3186ffd700 20 client.28200.objecter dump_active .. 0 homeless 2021-02-24T15:24:03.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.946+0000 7f319effd700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6790/0 conn(0x7f31780027f0 legacy=0x7f3178004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.946+0000 7f3186ffd700 10 client.28200.objecter ms_handle_connect 0x7f31780027f0 2021-02-24T15:24:03.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.946+0000 7f3186ffd700 10 client.28200.objecter resend_mon_ops 2021-02-24T15:24:03.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.946+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611931075 0 0) 0x7f3178006550 con 0x7f31780027f0 2021-02-24T15:24:03.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.946+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a00923b0 con 0x7f31780027f0 2021-02-24T15:24:03.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.947+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3001432699 0 0) 0x7f31a00923b0 con 0x7f31780027f0 2021-02-24T15:24:03.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.947+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3178006550 con 0x7f31780027f0 2021-02-24T15:24:03.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.947+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3190001ab0 con 0x7f31780027f0 2021-02-24T15:24:03.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.947+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2977006658 0 0) 0x7f3178006550 con 0x7f31780027f0 2021-02-24T15:24:03.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.947+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3178009df0 con 0x7f31780027f0 2021-02-24T15:24:03.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.947+0000 7f3186ffd700 10 client.28200.objecter ms_handle_connect 0x7f3180031430 2021-02-24T15:24:03.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.947+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f31900054d0 con 0x7f31780027f0 2021-02-24T15:24:03.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.947+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6790/0 conn(0x7f31780027f0 legacy=0x7f3178004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.947+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6790/0 conn(0x7f31780027f0 legacy=0x7f3178004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.955+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3178007520 con 0x7f31780068c0 2021-02-24T15:24:03.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.957+0000 7f319effd700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6790/0 conn(0x7f31780068c0 legacy=0x7f3178006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.957+0000 7f3186ffd700 10 client.28200.objecter ms_handle_connect 0x7f31780068c0 2021-02-24T15:24:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.957+0000 7f3186ffd700 10 client.28200.objecter resend_mon_ops 2021-02-24T15:24:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.957+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900589358 0 0) 0x7f3178007520 con 0x7f31780068c0 2021-02-24T15:24:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.957+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3178006550 con 0x7f31780068c0 2021-02-24T15:24:03.969 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.957+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1017844979 0 0) 0x7f3178006550 con 0x7f31780068c0 2021-02-24T15:24:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.957+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3178007520 con 0x7f31780068c0 2021-02-24T15:24:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.957+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f31900023c0 con 0x7f31780068c0 2021-02-24T15:24:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.957+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1074746080 0 0) 0x7f3178007520 con 0x7f31780068c0 2021-02-24T15:24:03.970 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3178008720 con 0x7f31780068c0 2021-02-24T15:24:03.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 2261049512) 0x7f3190002720 con 0x7f31780068c0 2021-02-24T15:24:03.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6790/0 conn(0x7f31780068c0 legacy=0x7f3178006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f3186ffd700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6790/0 conn(0x7f31780068c0 legacy=0x7f3178006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:03.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 10 librados: watch_flush enter 2021-02-24T15:24:03.971 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 10 librados: watch_flush exit 2021-02-24T15:24:03.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 20 client.28200.objecter shutdown clearing up homeless session... 2021-02-24T15:24:03.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 10 client.28200.objecter successfully canceled tick 2021-02-24T15:24:03.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.181:6812/33484 conn(0x7f3180031430 legacy=0x7f31800338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 >> v1:172.21.15.152:6789/0 conn(0x7f31a0099340 legacy=0x7f31a0142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:03.972 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f319f7fe700 1 -- 172.21.15.152:0/2180855835 reap_dead start 2021-02-24T15:24:03.973 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f319f7fe700 1 -- 172.21.15.152:0/2180855835 reap_dead start 2021-02-24T15:24:03.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 shutdown_connections 2021-02-24T15:24:03.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 >> 172.21.15.152:0/2180855835 conn(0x7f31a009dcc0 msgr2=0x7f31a009c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:03.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 shutdown_connections 2021-02-24T15:24:03.974 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 1 -- 172.21.15.152:0/2180855835 wait complete. 2021-02-24T15:24:03.975 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:03.958+0000 7f31a5295700 1 librados: shutdown 2021-02-24T15:24:03.975 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:24:03.975 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:03.975 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:03.976 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:24:03.976 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 34, 2021-02-24T15:24:03.976 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:24:03.976 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:24:03.977 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:24:03.977 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:24:03.977 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:03.977 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 2, 2021-02-24T15:24:03.978 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:03.978 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:24:03.978 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:24:03.978 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:03.979 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:03.979 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:03.979 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:03.979 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:03.979 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:03.980 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:03.980 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:03.980 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:03.980 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:03.980 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:24:03.981 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:24:03.981 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:03.981 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:03.981 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:03.982 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:03.982 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:03.982 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:03.982 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:03.982 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:03.983 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:03.983 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:03.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.983 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:24:03.983 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:24:03.984 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:24:03.984 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:24:03.984 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:24:03.985 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:24:03.985 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:03.985 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:03.985 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:24:03.985 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:24:03.986 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:24:03.986 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:24:03.986 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:24:03.986 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:03.987 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:24:03.987 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:03.987 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:03.987 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:03.987 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:03.988 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:03.988 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:03.988 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:03.988 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:03.989 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:03.989 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:03.989 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:24:03.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.989 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:24:03.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.990 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:03.990 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:03.990 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:03.990 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:03.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.991 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:03.991 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:24:03.991 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:03.991 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.992 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:03.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.992 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:24:03.993 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:24:03.993 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:03.993 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:03.993 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:03.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.994 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:03.994 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:03.994 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:03.995 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:03.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.995 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:03.995 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:24:03.995 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:03.996 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:03.996 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:03.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.996 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:24:03.997 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:24:03.997 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:03.997 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:03.997 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:03.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:03.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.998 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:03.998 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:03.998 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:03.999 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:03.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:03.999 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:03.999 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:24:04.000 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:04.000 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.000 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:04.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.000 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:24:04.001 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:24:04.001 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:04.001 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:04.001 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:04.001 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.002 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:04.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.002 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:24:04.002 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:24:04.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.003 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:04.003 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:04.003 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:04.003 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.003 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:04.004 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:24:04.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.004 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:04.004 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:04.004 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:04.005 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.005 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:04.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.005 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:24:04.006 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:24:04.007 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:24:04.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.124+0000 7f9dc76a6700 1 Processor -- start 2021-02-24T15:24:04.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.125+0000 7f9dc76a6700 1 -- start start 2021-02-24T15:24:04.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.125+0000 7f9dc76a6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc0097d40 con 0x7f9dc0063220 2021-02-24T15:24:04.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.125+0000 7f9dc76a6700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc0063d00 con 0x7f9dc0062da0 2021-02-24T15:24:04.128 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.125+0000 7f9dc76a6700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc0097980 con 0x7f9dc0099340 2021-02-24T15:24:04.128 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.125+0000 7f9dc5442700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f9dc0099340 0x7f9dc0097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36664/0 (socket says 172.21.15.152:36664) 2021-02-24T15:24:04.128 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.125+0000 7f9dc5c43700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9dc0063220 0x7f9dc0133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48192/0 (socket says 172.21.15.152:48192) 2021-02-24T15:24:04.128 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.125+0000 7f9dc5442700 1 -- 172.21.15.152:0/3869249935 learned_addr learned my addr 172.21.15.152:0/3869249935 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:04.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9dc5c43700 1 -- 172.21.15.152:0/3869249935 >> v1:172.21.15.152:6789/0 conn(0x7f9dc0063220 legacy=0x7f9dc0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:04.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9dc4c41700 1 -- 172.21.15.152:0/3869249935 >> v1:172.21.15.181:6789/0 conn(0x7f9dc0062da0 legacy=0x7f9dc012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:04.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9dc5442700 1 -- 172.21.15.152:0/3869249935 >> v1:172.21.15.152:6790/0 conn(0x7f9dc0099340 legacy=0x7f9dc0097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:04.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9daffff700 1 -- 172.21.15.152:0/3869249935 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219982092 0 0) 0x7f9dc0097d40 con 0x7f9dc0063220 2021-02-24T15:24:04.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9daffff700 1 -- 172.21.15.152:0/3869249935 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da8003230 con 0x7f9dc0063220 2021-02-24T15:24:04.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9daffff700 1 -- 172.21.15.152:0/3869249935 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2883775655 0 0) 0x7f9da8003230 con 0x7f9dc0063220 2021-02-24T15:24:04.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9daffff700 1 -- 172.21.15.152:0/3869249935 >> v1:172.21.15.152:6790/0 conn(0x7f9dc0099340 legacy=0x7f9dc0097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:04.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9daffff700 1 -- 172.21.15.152:0/3869249935 >> v1:172.21.15.181:6789/0 conn(0x7f9dc0062da0 legacy=0x7f9dc012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:04.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9daffff700 1 -- 172.21.15.152:0/3869249935 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc008fac0 con 0x7f9dc0063220 2021-02-24T15:24:04.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9daffff700 1 -- 172.21.15.152:0/3869249935 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9db8001cb0 con 0x7f9dc0063220 2021-02-24T15:24:04.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9daffff700 1 -- 172.21.15.152:0/3869249935 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9db8001fc0 con 0x7f9dc0063220 2021-02-24T15:24:04.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.128+0000 7f9daffff700 1 -- 172.21.15.152:0/3869249935 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9db8004a10 con 0x7f9dc0063220 2021-02-24T15:24:04.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.129+0000 7f9dc76a6700 1 -- 172.21.15.152:0/3869249935 >> v1:172.21.15.152:6789/0 conn(0x7f9dc0063220 legacy=0x7f9dc0133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:04.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.129+0000 7f9dc76a6700 1 -- 172.21.15.152:0/3869249935 shutdown_connections 2021-02-24T15:24:04.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.129+0000 7f9dc76a6700 1 -- 172.21.15.152:0/3869249935 >> 172.21.15.152:0/3869249935 conn(0x7f9dc009dcc0 msgr2=0x7f9dc009e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:04.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.129+0000 7f9dc76a6700 1 -- 172.21.15.152:0/3869249935 shutdown_connections 2021-02-24T15:24:04.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.129+0000 7f9dc76a6700 1 -- 172.21.15.152:0/3869249935 wait complete. 2021-02-24T15:24:04.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.130+0000 7f9dc76a6700 1 librados: starting msgr at 2021-02-24T15:24:04.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.130+0000 7f9dc76a6700 1 librados: starting objecter 2021-02-24T15:24:04.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.130+0000 7f9dc76a6700 1 Processor -- start 2021-02-24T15:24:04.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.130+0000 7f9dc76a6700 1 -- start start 2021-02-24T15:24:04.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.130+0000 7f9dc76a6700 1 librados: setting wanted keys 2021-02-24T15:24:04.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.130+0000 7f9dc76a6700 1 librados: calling monclient init 2021-02-24T15:24:04.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.130+0000 7f9dc76a6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc01281c0 con 0x7f9dc0063220 2021-02-24T15:24:04.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.130+0000 7f9dc76a6700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc013a800 con 0x7f9dc0099340 2021-02-24T15:24:04.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.130+0000 7f9dc76a6700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc0095130 con 0x7f9dc0062da0 2021-02-24T15:24:04.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.131+0000 7f9dc4c41700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9dc0063220 0x7f9dc0096880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48194/0 (socket says 172.21.15.152:48194) 2021-02-24T15:24:04.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.131+0000 7f9dc4c41700 1 -- 172.21.15.152:0/2599124932 learned_addr learned my addr 172.21.15.152:0/2599124932 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:04.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.133+0000 7f9dc5442700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.152:6790/0 conn(0x7f9dc0062da0 legacy=0x7f9dc013a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:04.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.133+0000 7f9dc4c41700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.152:6789/0 conn(0x7f9dc0063220 legacy=0x7f9dc0096880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:04.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.133+0000 7f9dc5c43700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.181:6789/0 conn(0x7f9dc0099340 legacy=0x7f9dc0142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:04.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.136+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 DispatchQueue::entry inject delay of 0.002000 2021-02-24T15:24:04.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 10 client.?.objecter ms_handle_connect 0x7f9dc0062da0 2021-02-24T15:24:04.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:04.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 10 client.?.objecter ms_handle_connect 0x7f9dc0063220 2021-02-24T15:24:04.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:04.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 10 client.?.objecter ms_handle_connect 0x7f9dc0099340 2021-02-24T15:24:04.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:04.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844714081 0 0) 0x7f9dc0095130 con 0x7f9dc0062da0 2021-02-24T15:24:04.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da0004bd0 con 0x7f9dc0062da0 2021-02-24T15:24:04.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035679132 0 0) 0x7f9dc01281c0 con 0x7f9dc0063220 2021-02-24T15:24:04.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc0095130 con 0x7f9dc0063220 2021-02-24T15:24:04.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375372381 0 0) 0x7f9dc008fac0 con 0x7f9dc0099340 2021-02-24T15:24:04.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc01281c0 con 0x7f9dc0099340 2021-02-24T15:24:04.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2831465826 0 0) 0x7f9dc0095130 con 0x7f9dc0063220 2021-02-24T15:24:04.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9dc008fac0 con 0x7f9dc0063220 2021-02-24T15:24:04.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9db0001b30 con 0x7f9dc0063220 2021-02-24T15:24:04.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2524188558 0 0) 0x7f9da0004bd0 con 0x7f9dc0062da0 2021-02-24T15:24:04.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9dc0095130 con 0x7f9dc0062da0 2021-02-24T15:24:04.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9dbc001b10 con 0x7f9dc0062da0 2021-02-24T15:24:04.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3707452170 0 0) 0x7f9dc01281c0 con 0x7f9dc0099340 2021-02-24T15:24:04.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9da0004bd0 con 0x7f9dc0099340 2021-02-24T15:24:04.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9db8001660 con 0x7f9dc0099340 2021-02-24T15:24:04.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1950918705 0 0) 0x7f9dc008fac0 con 0x7f9dc0063220 2021-02-24T15:24:04.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.152:6790/0 conn(0x7f9dc0062da0 legacy=0x7f9dc013a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:04.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.181:6789/0 conn(0x7f9dc0099340 legacy=0x7f9dc0142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:04.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00953d0 con 0x7f9dc0063220 2021-02-24T15:24:04.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc0097070 con 0x7f9dc0063220 2021-02-24T15:24:04.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dc76a6700 10 client.28206.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:04.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc0093d40 con 0x7f9dc0063220 2021-02-24T15:24:04.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.138+0000 7f9dc76a6700 1 librados: init done 2021-02-24T15:24:04.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.139+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9db0002170 con 0x7f9dc0063220 2021-02-24T15:24:04.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.139+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9db0002480 con 0x7f9dc0063220 2021-02-24T15:24:04.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.139+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f9db00025e0 con 0x7f9dc0063220 2021-02-24T15:24:04.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.139+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f9d98006550 con 0x7f9d980027f0 2021-02-24T15:24:04.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.139+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f9db003adf0 con 0x7f9dc0063220 2021-02-24T15:24:04.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.139+0000 7f9dad7fa700 10 client.28206.objecter ms_dispatch 0x7f9dc0001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:04.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.139+0000 7f9dad7fa700 3 client.28206.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:04.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.139+0000 7f9dad7fa700 3 client.28206.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:04.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.140+0000 7f9dad7fa700 20 client.28206.objecter dump_active .. 0 homeless 2021-02-24T15:24:04.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 10 client.28206.objecter ms_handle_connect 0x7f9d980027f0 2021-02-24T15:24:04.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dc5442700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.181:6789/0 conn(0x7f9d980027f0 legacy=0x7f9d98004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:04.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 10 client.28206.objecter resend_mon_ops 2021-02-24T15:24:04.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322485346 0 0) 0x7f9d98006550 con 0x7f9d980027f0 2021-02-24T15:24:04.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc008fac0 con 0x7f9d980027f0 2021-02-24T15:24:04.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 10 client.28206.objecter ms_handle_connect 0x7f9da0031a00 2021-02-24T15:24:04.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3888552631 0 0) 0x7f9dc008fac0 con 0x7f9d980027f0 2021-02-24T15:24:04.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9d98006550 con 0x7f9d980027f0 2021-02-24T15:24:04.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9dbc004970 con 0x7f9d980027f0 2021-02-24T15:24:04.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2394838030 0 0) 0x7f9d98006550 con 0x7f9d980027f0 2021-02-24T15:24:04.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.142+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d98009df0 con 0x7f9d980027f0 2021-02-24T15:24:04.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.143+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f9dbc004bd0 con 0x7f9d980027f0 2021-02-24T15:24:04.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.143+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.181:6789/0 conn(0x7f9d980027f0 legacy=0x7f9d98004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:04.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.143+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.181:6789/0 conn(0x7f9d980027f0 legacy=0x7f9d98004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:04.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.151+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f9d98007520 con 0x7f9d980068c0 2021-02-24T15:24:04.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dc5442700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.181:6789/0 conn(0x7f9d980068c0 legacy=0x7f9d98006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:04.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dad7fa700 10 client.28206.objecter ms_handle_connect 0x7f9d980068c0 2021-02-24T15:24:04.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dad7fa700 10 client.28206.objecter resend_mon_ops 2021-02-24T15:24:04.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141796420 0 0) 0x7f9d98007520 con 0x7f9d980068c0 2021-02-24T15:24:04.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d98006550 con 0x7f9d980068c0 2021-02-24T15:24:04.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4006799008 0 0) 0x7f9d98006550 con 0x7f9d980068c0 2021-02-24T15:24:04.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9d98007520 con 0x7f9d980068c0 2021-02-24T15:24:04.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9dbc005360 con 0x7f9d980068c0 2021-02-24T15:24:04.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 390429352 0 0) 0x7f9d98007520 con 0x7f9d980068c0 2021-02-24T15:24:04.163 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.154+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9d98008720 con 0x7f9d980068c0 2021-02-24T15:24:04.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3940 (unknown 0 0 456792035) 0x7f9dbc0055e0 con 0x7f9d980068c0 2021-02-24T15:24:04.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.181:6789/0 conn(0x7f9d980068c0 legacy=0x7f9d98006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:04.164 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dad7fa700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.181:6789/0 conn(0x7f9d980068c0 legacy=0x7f9d98006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:04.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 10 librados: watch_flush enter 2021-02-24T15:24:04.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 10 librados: watch_flush exit 2021-02-24T15:24:04.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 20 client.28206.objecter shutdown clearing up homeless session... 2021-02-24T15:24:04.165 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 10 client.28206.objecter successfully canceled tick 2021-02-24T15:24:04.166 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.181:6812/33484 conn(0x7f9da0031a00 legacy=0x7f9da0033ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:04.166 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 >> v1:172.21.15.152:6789/0 conn(0x7f9dc0063220 legacy=0x7f9dc0096880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:04.166 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc5c43700 1 -- 172.21.15.152:0/2599124932 reap_dead start 2021-02-24T15:24:04.166 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc5c43700 1 -- 172.21.15.152:0/2599124932 reap_dead start 2021-02-24T15:24:04.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 shutdown_connections 2021-02-24T15:24:04.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 >> 172.21.15.152:0/2599124932 conn(0x7f9dc009dcc0 msgr2=0x7f9dc009c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:04.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 shutdown_connections 2021-02-24T15:24:04.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 1 -- 172.21.15.152:0/2599124932 wait complete. 2021-02-24T15:24:04.167 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:04.155+0000 7f9dc76a6700 1 librados: shutdown 2021-02-24T15:24:04.168 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:24:04.168 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:04.168 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:04.168 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:24:04.169 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 34, 2021-02-24T15:24:04.169 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:24:04.169 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:24:04.169 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:24:04.170 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:24:04.170 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:04.170 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:24:04.170 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:04.171 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:24:04.171 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:24:04.171 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:04.171 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:04.171 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:04.172 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:04.172 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:04.172 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:04.172 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:04.173 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:04.173 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:04.173 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:04.173 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:24:04.174 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:24:04.174 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:04.174 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:04.175 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:04.175 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:04.175 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:04.175 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:04.175 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:04.176 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:04.176 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:04.176 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:04.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.177 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:24:04.177 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:24:04.177 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:24:04.179 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:24:04.179 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:24:04.179 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:24:04.179 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:04.179 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:04.180 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:24:04.180 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:24:04.180 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:24:04.181 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:24:04.181 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:24:04.181 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:04.181 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:24:04.182 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:04.182 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:04.182 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:04.182 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:04.182 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:04.183 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:04.183 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:04.183 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:04.183 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:04.183 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:04.184 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:24:04.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.184 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:24:04.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.184 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:04.185 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:04.185 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:04.185 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:04.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.186 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:04.186 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:24:04.186 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:04.187 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.187 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:04.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.187 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:24:04.188 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:24:04.188 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:04.188 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:04.188 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:04.188 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.189 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:04.189 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:04.189 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:04.189 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:04.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.190 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:04.190 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:24:04.191 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:04.191 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.191 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:04.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.192 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:24:04.192 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:24:04.192 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:04.193 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:04.193 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:04.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.193 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:04.194 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:04.194 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:04.194 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:04.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.195 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:04.195 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:24:04.195 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:04.195 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.195 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:04.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.196 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:24:04.196 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:24:04.196 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:04.197 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:04.197 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:04.197 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.197 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:04.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.198 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:24:04.198 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:24:04.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.199 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:04.199 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:04.199 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:04.199 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.200 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:04.200 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:24:04.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.201 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:04.201 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:04.202 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:24:04.202 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.202 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:04.202 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:24:04.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:04.203 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:04.203 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:04.204 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:04.205 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:04.205 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:04.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:04.205 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:24:04.206 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:24:04.207 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2021-02-24T15:24:04.208 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2021-02-24T15:24:04.208 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2021-02-24T15:24:04.208 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2021-02-24T15:24:04.208 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-02-24T15:24:04.209 INFO:teuthology.orchestra.run:waiting for 300 2021-02-24T15:24:04.224 INFO:tasks.ceph.mon.b:Stopped 2021-02-24T15:24:04.224 INFO:tasks.mon_thrash:Sending STOP to mon a 2021-02-24T15:24:04.225 INFO:tasks.ceph.mon.a:Sent signal 19 2021-02-24T15:24:04.225 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2021-02-24T15:24:19.226 INFO:tasks.mon_thrash:Sending CONT to mon a 2021-02-24T15:24:19.227 INFO:tasks.ceph.mon.a:Sent signal 18 2021-02-24T15:24:19.227 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2021-02-24T15:24:19.228 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:24:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.355+0000 7f60de4da700 1 Processor -- start 2021-02-24T15:24:19.356 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.355+0000 7f60de4da700 1 -- start start 2021-02-24T15:24:19.356 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.355+0000 7f60de4da700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d8062660 con 0x7f60d8095bb0 2021-02-24T15:24:19.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.356+0000 7f60de4da700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d8063af0 con 0x7f60d8068410 2021-02-24T15:24:19.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.356+0000 7f60de4da700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d8063d90 con 0x7f60d80966a0 2021-02-24T15:24:19.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.356+0000 7f60d7fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f60d80966a0 0x7f60d8096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36704/0 (socket says 172.21.15.152:36704) 2021-02-24T15:24:19.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.356+0000 7f60d77fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f60d8095bb0 0x7f60d8130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48232/0 (socket says 172.21.15.152:48232) 2021-02-24T15:24:19.358 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.356+0000 7f60d7fff700 1 -- 172.21.15.152:0/3742434786 learned_addr learned my addr 172.21.15.152:0/3742434786 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:19.358 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.356+0000 7f60dca77700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60d8133990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:19.359 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.358+0000 7f60d7fff700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.152:6790/0 conn(0x7f60d80966a0 legacy=0x7f60d8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:19.359 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.358+0000 7f60d77fe700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.152:6789/0 conn(0x7f60d8095bb0 legacy=0x7f60d8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:19.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.557+0000 7f60dca77700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60d8133990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:19.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:19.958+0000 7f60dca77700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60d8133990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:20.759+0000 7f60dca77700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60d8133990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:22.356 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.356+0000 7f60d5ffb700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.152:6790/0 conn(0x7f60d80966a0 legacy=0x7f60d8096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:22.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.356+0000 7f60d5ffb700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60d8133990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:24:22.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.356+0000 7f60d5ffb700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.152:6789/0 conn(0x7f60d8095bb0 legacy=0x7f60d8130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:22.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.356+0000 7f60d5ffb700 1 -- 172.21.15.152:0/3742434786 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d8064030 con 0x7f60b8007130 2021-02-24T15:24:22.357 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.356+0000 7f60d5ffb700 1 -- 172.21.15.152:0/3742434786 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d8063af0 con 0x7f60d8068410 2021-02-24T15:24:22.358 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.356+0000 7f60d5ffb700 1 -- 172.21.15.152:0/3742434786 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b80106e0 con 0x7f60b80034a0 2021-02-24T15:24:22.358 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.356+0000 7f60dca77700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60b800ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:22.358 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.358+0000 7f60d7fff700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.152:6790/0 conn(0x7f60b80034a0 legacy=0x7f60b80058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:22.359 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.358+0000 7f60d77fe700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.152:6789/0 conn(0x7f60b8007130 legacy=0x7f60b80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:22.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.557+0000 7f60dca77700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60b800ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:22.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:22.958+0000 7f60dca77700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60b800ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:23.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:23.759+0000 7f60dca77700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60b800ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:24.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.242+0000 7f60d6ffd700 1 -- 172.21.15.152:0/3742434786 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913177210 0 0) 0x7f60b80106e0 con 0x7f60b80034a0 2021-02-24T15:24:24.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.242+0000 7f60d6ffd700 1 -- 172.21.15.152:0/3742434786 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c4003230 con 0x7f60b80034a0 2021-02-24T15:24:24.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.243+0000 7f60d6ffd700 1 -- 172.21.15.152:0/3742434786 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3761419576 0 0) 0x7f60c4003230 con 0x7f60b80034a0 2021-02-24T15:24:24.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.243+0000 7f60d6ffd700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60b800ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:24:24.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.243+0000 7f60d6ffd700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.152:6789/0 conn(0x7f60b8007130 legacy=0x7f60b80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.243+0000 7f60d6ffd700 1 -- 172.21.15.152:0/3742434786 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b80118f0 con 0x7f60b80034a0 2021-02-24T15:24:24.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.243+0000 7f60d6ffd700 1 -- 172.21.15.152:0/3742434786 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f60c8001880 con 0x7f60b80034a0 2021-02-24T15:24:24.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.243+0000 7f60d6ffd700 1 -- 172.21.15.152:0/3742434786 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f60c8001b60 con 0x7f60b80034a0 2021-02-24T15:24:24.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.243+0000 7f60d6ffd700 1 -- 172.21.15.152:0/3742434786 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f60c80045b0 con 0x7f60b80034a0 2021-02-24T15:24:24.247 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.244+0000 7f60de4da700 1 -- 172.21.15.152:0/3742434786 >> v1:172.21.15.152:6790/0 conn(0x7f60b80034a0 legacy=0x7f60b80058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.247 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.244+0000 7f60de4da700 1 -- 172.21.15.152:0/3742434786 shutdown_connections 2021-02-24T15:24:24.247 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.244+0000 7f60de4da700 1 -- 172.21.15.152:0/3742434786 >> 172.21.15.152:0/3742434786 conn(0x7f60d809ba40 msgr2=0x7f60d809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:24.247 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.244+0000 7f60de4da700 1 -- 172.21.15.152:0/3742434786 shutdown_connections 2021-02-24T15:24:24.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.244+0000 7f60de4da700 1 -- 172.21.15.152:0/3742434786 wait complete. 2021-02-24T15:24:24.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.245+0000 7f60de4da700 1 librados: starting msgr at 2021-02-24T15:24:24.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.245+0000 7f60de4da700 1 librados: starting objecter 2021-02-24T15:24:24.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.245+0000 7f60de4da700 1 Processor -- start 2021-02-24T15:24:24.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.245+0000 7f60de4da700 1 -- start start 2021-02-24T15:24:24.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.245+0000 7f60de4da700 1 librados: setting wanted keys 2021-02-24T15:24:24.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.245+0000 7f60de4da700 1 librados: calling monclient init 2021-02-24T15:24:24.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.246+0000 7f60de4da700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d8063010 con 0x7f60b80034a0 2021-02-24T15:24:24.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.246+0000 7f60de4da700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d811b110 con 0x7f60d8068410 2021-02-24T15:24:24.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.246+0000 7f60de4da700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d809a710 con 0x7f60b8007130 2021-02-24T15:24:24.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.246+0000 7f60dca77700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60d8142610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:24.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.246+0000 7f60d77fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f60b8007130 0x7f60d8134200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36738/0 (socket says 172.21.15.152:36738) 2021-02-24T15:24:24.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.246+0000 7f60d7fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f60b80034a0 0x7f60d813a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48260/0 (socket says 172.21.15.152:48260) 2021-02-24T15:24:24.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.246+0000 7f60d77fe700 1 -- 172.21.15.152:0/2153097740 learned_addr learned my addr 172.21.15.152:0/2153097740 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:24.254 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.248+0000 7f60d7fff700 1 -- 172.21.15.152:0/2153097740 >> v1:172.21.15.152:6789/0 conn(0x7f60b80034a0 legacy=0x7f60d813a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.248+0000 7f60bffff700 10 client.?.objecter ms_handle_connect 0x7f60b80034a0 2021-02-24T15:24:24.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.248+0000 7f60bffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:24.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.248+0000 7f60d77fe700 1 -- 172.21.15.152:0/2153097740 >> v1:172.21.15.152:6790/0 conn(0x7f60b8007130 legacy=0x7f60d8134200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.255 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.248+0000 7f60bffff700 10 client.?.objecter ms_handle_connect 0x7f60b8007130 2021-02-24T15:24:24.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.248+0000 7f60bffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:24.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.249+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848873823 0 0) 0x7f60d8063010 con 0x7f60b80034a0 2021-02-24T15:24:24.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.249+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b800a890 con 0x7f60b80034a0 2021-02-24T15:24:24.256 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204055380 0 0) 0x7f60d809a710 con 0x7f60b8007130 2021-02-24T15:24:24.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d8063010 con 0x7f60b8007130 2021-02-24T15:24:24.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 531988869 0 0) 0x7f60d8063010 con 0x7f60b8007130 2021-02-24T15:24:24.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f60d809a710 con 0x7f60b8007130 2021-02-24T15:24:24.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f60cc0019d0 con 0x7f60b8007130 2021-02-24T15:24:24.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3890096645 0 0) 0x7f60b800a890 con 0x7f60b80034a0 2021-02-24T15:24:24.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f60d8063010 con 0x7f60b80034a0 2021-02-24T15:24:24.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f60c80016a0 con 0x7f60b80034a0 2021-02-24T15:24:24.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2820799603 0 0) 0x7f60d809a710 con 0x7f60b8007130 2021-02-24T15:24:24.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 >> v1:172.21.15.181:6789/0 conn(0x7f60d8068410 legacy=0x7f60d8142610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:24:24.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 >> v1:172.21.15.152:6789/0 conn(0x7f60b80034a0 legacy=0x7f60d813a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d8134910 con 0x7f60b8007130 2021-02-24T15:24:24.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d811a710 con 0x7f60b8007130 2021-02-24T15:24:24.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60de4da700 10 client.84155.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:24.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d81190d0 con 0x7f60b8007130 2021-02-24T15:24:24.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60de4da700 1 librados: init done 2021-02-24T15:24:24.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f60cc001b30 con 0x7f60b8007130 2021-02-24T15:24:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.251+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f60cc004a00 con 0x7f60b8007130 2021-02-24T15:24:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.252+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f60cc004be0 con 0x7f60b8007130 2021-02-24T15:24:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.252+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f60cc03ad70 con 0x7f60b8007130 2021-02-24T15:24:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.252+0000 7f60bffff700 10 client.84155.objecter ms_dispatch 0x7f60d8001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.252+0000 7f60bffff700 3 client.84155.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.252+0000 7f60bffff700 3 client.84155.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.252+0000 7f60bffff700 20 client.84155.objecter dump_active .. 0 homeless 2021-02-24T15:24:24.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.252+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b4004d60 con 0x7f60b8007130 2021-02-24T15:24:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.255+0000 7f60bffff700 10 client.84155.objecter ms_handle_connect 0x7f60b8032290 2021-02-24T15:24:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.257+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f60cc005340 con 0x7f60b8007130 2021-02-24T15:24:24.495 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.494+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f60b4005590 con 0x7f60b8007130 2021-02-24T15:24:24.495 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.494+0000 7f60bffff700 1 -- 172.21.15.152:0/2153097740 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1336 (unknown 254746657 0 856558315) 0x7f60cc0120c0 con 0x7f60b8007130 2021-02-24T15:24:24.495 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":38,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:24:24.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 10 librados: watch_flush enter 2021-02-24T15:24:24.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 10 librados: watch_flush exit 2021-02-24T15:24:24.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 20 client.84155.objecter shutdown clearing up homeless session... 2021-02-24T15:24:24.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 10 client.84155.objecter successfully canceled tick 2021-02-24T15:24:24.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 >> v1:172.21.15.181:6812/33484 conn(0x7f60b8032290 legacy=0x7f60b8034750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 >> v1:172.21.15.152:6790/0 conn(0x7f60b8007130 legacy=0x7f60d8134200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 shutdown_connections 2021-02-24T15:24:24.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 >> 172.21.15.152:0/2153097740 conn(0x7f60d809ba40 msgr2=0x7f60d8094360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:24.499 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 shutdown_connections 2021-02-24T15:24:24.499 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 1 -- 172.21.15.152:0/2153097740 wait complete. 2021-02-24T15:24:24.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.496+0000 7f60de4da700 1 librados: shutdown 2021-02-24T15:24:24.509 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2021-02-24T15:24:24.510 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:24:24.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.628+0000 7f863047a700 1 Processor -- start 2021-02-24T15:24:24.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.628+0000 7f863047a700 1 -- start start 2021-02-24T15:24:24.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.628+0000 7f863047a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8628062660 con 0x7f86280966a0 2021-02-24T15:24:24.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.628+0000 7f863047a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8628063af0 con 0x7f8628095bb0 2021-02-24T15:24:24.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.628+0000 7f863047a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8628063d90 con 0x7f8628068410 2021-02-24T15:24:24.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.629+0000 7f862e216700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f86280966a0 0x7f8628096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48268/0 (socket says 172.21.15.152:48268) 2021-02-24T15:24:24.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.629+0000 7f862e216700 1 -- 172.21.15.152:0/4230064829 learned_addr learned my addr 172.21.15.152:0/4230064829 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:24.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.629+0000 7f862ea17700 1 --1- 172.21.15.152:0/4230064829 >> v1:172.21.15.152:6790/0 conn(0x7f8628068410 0x7f8628133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36748/0 (socket says 172.21.15.152:36748) 2021-02-24T15:24:24.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.629+0000 7f862da15700 1 -- 172.21.15.152:0/4230064829 >> v1:172.21.15.181:6789/0 conn(0x7f8628095bb0 legacy=0x7f8628130260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:24.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862e216700 1 -- 172.21.15.152:0/4230064829 >> v1:172.21.15.152:6789/0 conn(0x7f86280966a0 legacy=0x7f8628096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862ea17700 1 -- 172.21.15.152:0/4230064829 >> v1:172.21.15.152:6790/0 conn(0x7f8628068410 legacy=0x7f8628133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292214879 0 0) 0x7f8628063d90 con 0x7f8628068410 2021-02-24T15:24:24.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8610003230 con 0x7f8628068410 2021-02-24T15:24:24.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701570424 0 0) 0x7f8628062660 con 0x7f86280966a0 2021-02-24T15:24:24.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8628063d90 con 0x7f86280966a0 2021-02-24T15:24:24.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3760802693 0 0) 0x7f8610003230 con 0x7f8628068410 2021-02-24T15:24:24.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 >> v1:172.21.15.181:6789/0 conn(0x7f8628095bb0 legacy=0x7f8628130260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:24:24.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 >> v1:172.21.15.152:6789/0 conn(0x7f86280966a0 legacy=0x7f8628096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628064030 con 0x7f8628068410 2021-02-24T15:24:24.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8620001cb0 con 0x7f8628068410 2021-02-24T15:24:24.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8620001fc0 con 0x7f8628068410 2021-02-24T15:24:24.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.631+0000 7f862d214700 1 -- 172.21.15.152:0/4230064829 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8620004a10 con 0x7f8628068410 2021-02-24T15:24:24.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.632+0000 7f863047a700 1 -- 172.21.15.152:0/4230064829 >> v1:172.21.15.152:6790/0 conn(0x7f8628068410 legacy=0x7f8628133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.632+0000 7f863047a700 1 -- 172.21.15.152:0/4230064829 shutdown_connections 2021-02-24T15:24:24.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.632+0000 7f863047a700 1 -- 172.21.15.152:0/4230064829 >> 172.21.15.152:0/4230064829 conn(0x7f862809ba40 msgr2=0x7f862809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:24.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.632+0000 7f863047a700 1 -- 172.21.15.152:0/4230064829 shutdown_connections 2021-02-24T15:24:24.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.632+0000 7f863047a700 1 -- 172.21.15.152:0/4230064829 wait complete. 2021-02-24T15:24:24.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.632+0000 7f863047a700 1 librados: starting msgr at 2021-02-24T15:24:24.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.632+0000 7f863047a700 1 librados: starting objecter 2021-02-24T15:24:24.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f863047a700 1 Processor -- start 2021-02-24T15:24:24.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f863047a700 1 -- start start 2021-02-24T15:24:24.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f863047a700 1 librados: setting wanted keys 2021-02-24T15:24:24.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f863047a700 1 librados: calling monclient init 2021-02-24T15:24:24.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f863047a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8628063010 con 0x7f8628068410 2021-02-24T15:24:24.643 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f863047a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8628067390 con 0x7f86280966a0 2021-02-24T15:24:24.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f863047a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8628134620 con 0x7f8628095bb0 2021-02-24T15:24:24.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f862e216700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8628068410 0x7f862813a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48274/0 (socket says 172.21.15.152:48274) 2021-02-24T15:24:24.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f862e216700 1 -- 172.21.15.152:0/3530477324 learned_addr learned my addr 172.21.15.152:0/3530477324 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:24.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.633+0000 7f862ea17700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.181:6789/0 conn(0x7f86280966a0 legacy=0x7f8628142320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:24.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f862da15700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6790/0 conn(0x7f8628095bb0 legacy=0x7f8628133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f86167fc700 10 client.?.objecter ms_handle_connect 0x7f8628095bb0 2021-02-24T15:24:24.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f86167fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:24.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f86167fc700 10 client.?.objecter ms_handle_connect 0x7f8628068410 2021-02-24T15:24:24.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f86167fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:24.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f862e216700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6789/0 conn(0x7f8628068410 legacy=0x7f862813a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383413077 0 0) 0x7f8628134620 con 0x7f8628095bb0 2021-02-24T15:24:24.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8608004bd0 con 0x7f8628095bb0 2021-02-24T15:24:24.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211599878 0 0) 0x7f8628063010 con 0x7f8628068410 2021-02-24T15:24:24.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.635+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8628134620 con 0x7f8628068410 2021-02-24T15:24:24.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3346556873 0 0) 0x7f8608004bd0 con 0x7f8628095bb0 2021-02-24T15:24:24.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8628063010 con 0x7f8628095bb0 2021-02-24T15:24:24.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8624004130 con 0x7f8628095bb0 2021-02-24T15:24:24.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3892913225 0 0) 0x7f8628134620 con 0x7f8628068410 2021-02-24T15:24:24.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8608004bd0 con 0x7f8628068410 2021-02-24T15:24:24.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8618001c60 con 0x7f8628068410 2021-02-24T15:24:24.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 191273579 0 0) 0x7f8628063010 con 0x7f8628095bb0 2021-02-24T15:24:24.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.181:6789/0 conn(0x7f86280966a0 legacy=0x7f8628142320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:24:24.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6789/0 conn(0x7f8628068410 legacy=0x7f862813a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628118fb0 con 0x7f8628095bb0 2021-02-24T15:24:24.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862811b950 con 0x7f8628095bb0 2021-02-24T15:24:24.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8624004390 con 0x7f8628095bb0 2021-02-24T15:24:24.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8624004500 con 0x7f8628095bb0 2021-02-24T15:24:24.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f863047a700 10 client.84161.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:24.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f862811a420 con 0x7f8628095bb0 2021-02-24T15:24:24.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.636+0000 7f863047a700 1 librados: init done 2021-02-24T15:24:24.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.637+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f8624004720 con 0x7f8628095bb0 2021-02-24T15:24:24.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.637+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f862811ae80 con 0x7f86280579e0 2021-02-24T15:24:24.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.637+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f862403ad50 con 0x7f8628095bb0 2021-02-24T15:24:24.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.637+0000 7f86167fc700 10 client.84161.objecter ms_dispatch 0x7f8628001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:24.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.637+0000 7f86167fc700 3 client.84161.objecter handle_osd_map got epochs [331,331] > 0 2021-02-24T15:24:24.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.637+0000 7f86167fc700 3 client.84161.objecter handle_osd_map decoding full epoch 331 2021-02-24T15:24:24.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.637+0000 7f86167fc700 20 client.84161.objecter dump_active .. 0 homeless 2021-02-24T15:24:24.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f86167fc700 10 client.84161.objecter ms_handle_connect 0x7f86280579e0 2021-02-24T15:24:24.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f86167fc700 10 client.84161.objecter resend_mon_ops 2021-02-24T15:24:24.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f862e216700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6789/0 conn(0x7f86280579e0 legacy=0x7f86281137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343340261 0 0) 0x7f86180048a0 con 0x7f86280579e0 2021-02-24T15:24:24.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8628063010 con 0x7f86280579e0 2021-02-24T15:24:24.658 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4005873413 0 0) 0x7f8628063010 con 0x7f86280579e0 2021-02-24T15:24:24.658 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f86180048a0 con 0x7f86280579e0 2021-02-24T15:24:24.658 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f8618004cd0 con 0x7f86280579e0 2021-02-24T15:24:24.658 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2385055429 0 0) 0x7f86180048a0 con 0x7f86280579e0 2021-02-24T15:24:24.658 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.639+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8628067a80 con 0x7f86280579e0 2021-02-24T15:24:24.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.640+0000 7f86167fc700 10 client.84161.objecter ms_handle_connect 0x7f8608031450 2021-02-24T15:24:24.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.640+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f86180051c0 con 0x7f86280579e0 2021-02-24T15:24:24.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.640+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6789/0 conn(0x7f86280579e0 legacy=0x7f86281137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.640+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6789/0 conn(0x7f86280579e0 legacy=0x7f86281137c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:24.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.648+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f862811ae80 con 0x7f8628057dc0 2021-02-24T15:24:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f862e216700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6789/0 conn(0x7f8628057dc0 legacy=0x7f8628147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 10 client.84161.objecter ms_handle_connect 0x7f8628057dc0 2021-02-24T15:24:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 10 client.84161.objecter resend_mon_ops 2021-02-24T15:24:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371228940 0 0) 0x7f86180054a0 con 0x7f8628057dc0 2021-02-24T15:24:24.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86180048a0 con 0x7f8628057dc0 2021-02-24T15:24:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 222688198 0 0) 0x7f86180048a0 con 0x7f8628057dc0 2021-02-24T15:24:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f86180054a0 con 0x7f8628057dc0 2021-02-24T15:24:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f86180058d0 con 0x7f8628057dc0 2021-02-24T15:24:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2739621162 0 0) 0x7f86180054a0 con 0x7f8628057dc0 2021-02-24T15:24:24.668 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f862809c1c0 con 0x7f8628057dc0 2021-02-24T15:24:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4101 (unknown 0 0 290847905) 0x7f8618005b80 con 0x7f8628057dc0 2021-02-24T15:24:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.650+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6789/0 conn(0x7f8628057dc0 legacy=0x7f8628147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f86167fc700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6789/0 conn(0x7f8628057dc0 legacy=0x7f8628147a60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:24.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 10 librados: watch_flush enter 2021-02-24T15:24:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 10 librados: watch_flush exit 2021-02-24T15:24:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 20 client.84161.objecter shutdown clearing up homeless session... 2021-02-24T15:24:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 10 client.84161.objecter successfully canceled tick 2021-02-24T15:24:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.181:6812/33484 conn(0x7f8608031450 legacy=0x7f8608033910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 >> v1:172.21.15.152:6790/0 conn(0x7f8628095bb0 legacy=0x7f8628133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f862ea17700 1 -- 172.21.15.152:0/3530477324 reap_dead start 2021-02-24T15:24:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f862ea17700 1 -- 172.21.15.152:0/3530477324 reap_dead start 2021-02-24T15:24:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 shutdown_connections 2021-02-24T15:24:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 >> 172.21.15.152:0/3530477324 conn(0x7f862809ba40 msgr2=0x7f86281120a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:24.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 shutdown_connections 2021-02-24T15:24:24.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 1 -- 172.21.15.152:0/3530477324 wait complete. 2021-02-24T15:24:24.672 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.651+0000 7f863047a700 1 librados: shutdown 2021-02-24T15:24:24.672 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:24:24.672 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:24.673 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:24.673 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:24:24.673 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 38, 2021-02-24T15:24:24.673 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:24:24.674 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:24:24.674 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:24:24.674 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.674 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:24:24.674 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:24.675 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:24:24.675 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:24:24.675 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:24.675 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:24.676 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:24.676 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:24.676 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:24.677 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:24.677 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:24.677 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:24.677 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:24.677 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.678 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:24:24.678 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:24:24.678 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:24.678 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:24.679 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:24.679 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:24.679 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:24.679 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:24.679 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:24.680 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:24.680 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:24.680 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.680 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:24:24.681 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:24:24.681 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:24:24.681 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:24:24.681 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:24:24.682 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:24:24.682 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:24.682 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:24.682 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:24:24.682 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:24:24.683 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:24:24.683 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:24:24.683 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:24:24.683 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:24.683 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:24:24.684 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:24.684 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:24.684 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:24.684 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:24.684 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:24.685 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:24.685 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:24.685 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:24.685 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:24.685 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.686 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:24:24.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.686 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:24:24.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.687 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:24.687 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:24.687 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:24.688 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:24.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.688 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:24.688 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:24:24.689 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:24.689 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.689 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.689 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:24:24.690 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:24:24.690 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:24.690 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:24.690 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:24.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.691 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:24.691 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:24.691 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:24.691 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:24.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.692 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:24.692 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:24:24.692 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:24.692 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.693 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.693 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:24:24.693 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:24:24.694 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:24.694 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:24.694 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:24.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.695 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:24.695 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:24.695 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:24.695 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:24.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.696 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:24.697 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:24:24.697 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:24.697 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.697 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.698 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:24:24.698 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:24:24.698 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:24.698 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:24.699 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:24.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.699 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.700 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:24:24.700 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:24:24.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.700 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:24.700 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:24.701 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:24.701 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.701 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.701 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:24:24.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.702 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:24.702 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:24.702 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:24:24.702 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.703 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.703 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:24:24.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.703 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:24.703 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:24.704 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:24:24.704 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.704 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.704 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:24:24.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.705 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:24.705 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:24.705 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:24.706 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.706 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.706 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:24:24.714 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:24:24.714 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:24:24.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.833+0000 7f78e311d700 1 Processor -- start 2021-02-24T15:24:24.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.833+0000 7f78e311d700 1 -- start start 2021-02-24T15:24:24.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.834+0000 7f78e311d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78dc097d40 con 0x7f78dc099340 2021-02-24T15:24:24.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.834+0000 7f78e311d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78dc063d00 con 0x7f78dc062da0 2021-02-24T15:24:24.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.834+0000 7f78e311d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78dc097980 con 0x7f78dc063220 2021-02-24T15:24:24.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.834+0000 7f78e0eb9700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f78dc099340 0x7f78dc097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48288/0 (socket says 172.21.15.152:48288) 2021-02-24T15:24:24.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.834+0000 7f78e16ba700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f78dc063220 0x7f78dc133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36764/0 (socket says 172.21.15.152:36764) 2021-02-24T15:24:24.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.834+0000 7f78dbfff700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f78dc062da0 legacy=0x7f78dc12fd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:24.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.834+0000 7f78e0eb9700 1 -- 172.21.15.152:0/813767962 learned_addr learned my addr 172.21.15.152:0/813767962 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:24.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.836+0000 7f78e16ba700 1 -- 172.21.15.152:0/813767962 >> v1:172.21.15.152:6790/0 conn(0x7f78dc063220 legacy=0x7f78dc133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.836+0000 7f78e0eb9700 1 -- 172.21.15.152:0/813767962 >> v1:172.21.15.152:6789/0 conn(0x7f78dc099340 legacy=0x7f78dc097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.836+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185366915 0 0) 0x7f78dc097980 con 0x7f78dc063220 2021-02-24T15:24:24.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.836+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c0003230 con 0x7f78dc063220 2021-02-24T15:24:24.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.836+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074651712 0 0) 0x7f78dc097d40 con 0x7f78dc099340 2021-02-24T15:24:24.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.836+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78dc097980 con 0x7f78dc099340 2021-02-24T15:24:24.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1217557811 0 0) 0x7f78c0003230 con 0x7f78dc063220 2021-02-24T15:24:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 >> v1:172.21.15.181:6789/0 conn(0x7f78dc062da0 legacy=0x7f78dc12fd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:24:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 >> v1:172.21.15.152:6789/0 conn(0x7f78dc099340 legacy=0x7f78dc097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc08fac0 con 0x7f78dc063220 2021-02-24T15:24:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f78d4001d70 con 0x7f78dc063220 2021-02-24T15:24:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f78d4002020 con 0x7f78dc063220 2021-02-24T15:24:24.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78db7fe700 1 -- 172.21.15.152:0/813767962 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f78d4004a10 con 0x7f78dc063220 2021-02-24T15:24:24.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78e311d700 1 -- 172.21.15.152:0/813767962 >> v1:172.21.15.152:6790/0 conn(0x7f78dc063220 legacy=0x7f78dc133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78e311d700 1 -- 172.21.15.152:0/813767962 shutdown_connections 2021-02-24T15:24:24.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78e311d700 1 -- 172.21.15.152:0/813767962 >> 172.21.15.152:0/813767962 conn(0x7f78dc09dcc0 msgr2=0x7f78dc09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:24.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78e311d700 1 -- 172.21.15.152:0/813767962 shutdown_connections 2021-02-24T15:24:24.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.837+0000 7f78e311d700 1 -- 172.21.15.152:0/813767962 wait complete. 2021-02-24T15:24:24.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.838+0000 7f78e311d700 1 librados: starting msgr at 2021-02-24T15:24:24.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.838+0000 7f78e311d700 1 librados: starting objecter 2021-02-24T15:24:24.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.838+0000 7f78e311d700 1 Processor -- start 2021-02-24T15:24:24.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.838+0000 7f78e311d700 1 -- start start 2021-02-24T15:24:24.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.838+0000 7f78e311d700 1 librados: setting wanted keys 2021-02-24T15:24:24.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.838+0000 7f78e311d700 1 librados: calling monclient init 2021-02-24T15:24:24.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.839+0000 7f78e311d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78dc13ab10 con 0x7f78dc063220 2021-02-24T15:24:24.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.839+0000 7f78e311d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78dc12c470 con 0x7f78dc062da0 2021-02-24T15:24:24.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.839+0000 7f78e311d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78dc12b9c0 con 0x7f78dc099340 2021-02-24T15:24:24.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.839+0000 7f78e16ba700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f78dc099340 0x7f78dc142620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36772/0 (socket says 172.21.15.152:36772) 2021-02-24T15:24:24.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.839+0000 7f78dbfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f78dc063220 0x7f78dc13eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48294/0 (socket says 172.21.15.152:48294) 2021-02-24T15:24:24.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.839+0000 7f78e16ba700 1 -- 172.21.15.152:0/1257080293 learned_addr learned my addr 172.21.15.152:0/1257080293 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:24:24.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.839+0000 7f78e0eb9700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.181:6789/0 conn(0x7f78dc062da0 legacy=0x7f78dc133980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:24:24.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.839+0000 7f78dbfff700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6789/0 conn(0x7f78dc063220 legacy=0x7f78dc13eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send send error: (32) Broken pipe 2021-02-24T15:24:24.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.839+0000 7f78dbfff700 1 --1- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6789/0 conn(0x7f78dc063220 0x7f78dc13eef0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-02-24T15:24:24.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78e16ba700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6790/0 conn(0x7f78dc099340 legacy=0x7f78dc142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 10 client.?.objecter ms_handle_connect 0x7f78dc099340 2021-02-24T15:24:24.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:24:24.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156432258 0 0) 0x7f78dc12b9c0 con 0x7f78dc099340 2021-02-24T15:24:24.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78bc004bd0 con 0x7f78dc099340 2021-02-24T15:24:24.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3812775065 0 0) 0x7f78bc004bd0 con 0x7f78dc099340 2021-02-24T15:24:24.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78dc12b9c0 con 0x7f78dc099340 2021-02-24T15:24:24.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f78d4004a10 con 0x7f78dc099340 2021-02-24T15:24:24.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 217586521 0 0) 0x7f78dc12b9c0 con 0x7f78dc099340 2021-02-24T15:24:24.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.181:6789/0 conn(0x7f78dc062da0 legacy=0x7f78dc133980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:24:24.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6789/0 conn(0x7f78dc063220 legacy=0x7f78dc13eef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:24.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc12ae00 con 0x7f78dc099340 2021-02-24T15:24:24.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78dc135170 con 0x7f78dc099340 2021-02-24T15:24:24.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78e311d700 10 client.84167.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:24:24.852 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f78dc1298b0 con 0x7f78dc099340 2021-02-24T15:24:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78e311d700 1 librados: init done 2021-02-24T15:24:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78e16ba700 1 --1- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6790/0 conn(0x7f78dc099340 0x7f78dc142620 :-1 s=OPENED pgs=8373 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f78d4005140 config(0 keys) v1 2021-02-24T15:24:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.841+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f78d4005140 con 0x7f78dc099340 2021-02-24T15:24:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.842+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f78d40052b0 con 0x7f78dc099340 2021-02-24T15:24:24.853 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.842+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f78d4005490 con 0x7f78dc099340 2021-02-24T15:24:24.854 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.842+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f78b4006550 con 0x7f78b40027f0 2021-02-24T15:24:24.854 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.844+0000 7f78d8ff9700 10 client.84167.objecter ms_handle_connect 0x7f78b40027f0 2021-02-24T15:24:24.854 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.844+0000 7f78d8ff9700 10 client.84167.objecter resend_mon_ops 2021-02-24T15:24:24.854 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.844+0000 7f78dbfff700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6790/0 conn(0x7f78b40027f0 legacy=0x7f78b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.855 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.845+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649145637 0 0) 0x7f78b4006550 con 0x7f78b40027f0 2021-02-24T15:24:24.855 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.845+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78dc12b9c0 con 0x7f78b40027f0 2021-02-24T15:24:24.855 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.845+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1553220440 0 0) 0x7f78dc12b9c0 con 0x7f78b40027f0 2021-02-24T15:24:24.855 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.845+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78b4006550 con 0x7f78b40027f0 2021-02-24T15:24:24.855 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.845+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f78c8004f50 con 0x7f78b40027f0 2021-02-24T15:24:24.856 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.845+0000 7f78d8ff9700 10 client.84167.objecter ms_handle_connect 0x7f78bc031200 2021-02-24T15:24:24.856 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.845+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4161353288 0 0) 0x7f78b4006550 con 0x7f78b40027f0 2021-02-24T15:24:24.856 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.845+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78b4009df0 con 0x7f78b40027f0 2021-02-24T15:24:24.856 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.846+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f78c8005370 con 0x7f78b40027f0 2021-02-24T15:24:24.856 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.846+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6790/0 conn(0x7f78b40027f0 legacy=0x7f78b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.857 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.846+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6790/0 conn(0x7f78b40027f0 legacy=0x7f78b4004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:24.859 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.853+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f78b40087d0 con 0x7f78b4008d80 2021-02-24T15:24:24.859 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 10 client.84167.objecter ms_handle_connect 0x7f78b4008d80 2021-02-24T15:24:24.860 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 10 client.84167.objecter resend_mon_ops 2021-02-24T15:24:24.860 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78dbfff700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6790/0 conn(0x7f78b4008d80 legacy=0x7f78b4009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:24:24.860 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837526869 0 0) 0x7f78b40087d0 con 0x7f78b4008d80 2021-02-24T15:24:24.860 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b4006550 con 0x7f78b4008d80 2021-02-24T15:24:24.861 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 474640393 0 0) 0x7f78b4006550 con 0x7f78b4008d80 2021-02-24T15:24:24.861 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78b40087d0 con 0x7f78b4008d80 2021-02-24T15:24:24.861 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f78c8005b10 con 0x7f78b4008d80 2021-02-24T15:24:24.861 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1269535183 0 0) 0x7f78b40087d0 con 0x7f78b4008d80 2021-02-24T15:24:24.862 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f78b4009920 con 0x7f78b4008d80 2021-02-24T15:24:24.862 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3929 (unknown 0 0 756548017) 0x7f78c8007dc0 con 0x7f78b4008d80 2021-02-24T15:24:24.862 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6790/0 conn(0x7f78b4008d80 legacy=0x7f78b4009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.862 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.856+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6790/0 conn(0x7f78b4008d80 legacy=0x7f78b4009210 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:24:24.863 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 10 librados: watch_flush enter 2021-02-24T15:24:24.863 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 10 librados: watch_flush exit 2021-02-24T15:24:24.863 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 20 client.84167.objecter shutdown clearing up homeless session... 2021-02-24T15:24:24.863 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 10 client.84167.objecter successfully canceled tick 2021-02-24T15:24:24.863 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.181:6812/33484 conn(0x7f78bc031200 legacy=0x7f78bc0336c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.864 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 >> v1:172.21.15.152:6790/0 conn(0x7f78dc099340 legacy=0x7f78dc142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:24:24.864 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e16ba700 1 -- 172.21.15.152:0/1257080293 reap_dead start 2021-02-24T15:24:24.864 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e16ba700 1 -- 172.21.15.152:0/1257080293 reap_dead start 2021-02-24T15:24:24.864 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78d8ff9700 1 -- 172.21.15.152:0/1257080293 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(331..331 src has 66..331) v4 ==== 5317+0+0 (unknown 3517997758 0 0) 0x7f78d403b660 con 0x7f78dc099340 2021-02-24T15:24:24.864 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78d8ff9700 10 client.84167.objecter ms_dispatch 0x7f78dc001510 osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:24.865 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78d8ff9700 10 librados: disconnected, discarding osd_map(331..331 src has 66..331) v4 2021-02-24T15:24:24.865 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 shutdown_connections 2021-02-24T15:24:24.865 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 >> 172.21.15.152:0/1257080293 conn(0x7f78dc09dcc0 msgr2=0x7f78dc09c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:24:24.865 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 shutdown_connections 2021-02-24T15:24:24.866 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 1 -- 172.21.15.152:0/1257080293 wait complete. 2021-02-24T15:24:24.866 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:24:24.857+0000 7f78e311d700 1 librados: shutdown 2021-02-24T15:24:24.866 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:24:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:24:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 38, 2021-02-24T15:24:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:24:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:24:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:24:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:24:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:24:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:24:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:24:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:24:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:24:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:24:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:24:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:24:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:24:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:24:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:24:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:24:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:24:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:24:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:24:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:24:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:24:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:24:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:24:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:24:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:24:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:24:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:24:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:24:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:24:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:24:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:24:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:24:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:24:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:24:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:24:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:24:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:24:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:24:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:24:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:24:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:24:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:24:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:24:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:24:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:24:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:24:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:24:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:24:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:24:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:24:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:24:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:24:24.892 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:24:24.892 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:24:24.892 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:24:24.892 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.892 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.893 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.893 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:24:24.893 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:24:24.893 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.894 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:24.894 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:24.894 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:24:24.894 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.894 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.895 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:24:24.895 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.895 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:24.895 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:24.895 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:24:24.896 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.896 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:24:24.896 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:24:24.896 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:24:24.896 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:24:24.897 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:24:24.897 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:24:24.897 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:24:24.897 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:24:24.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:24:24.898 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:24:24.898 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:24:24.899 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-02-24T15:25:46.350 INFO:tasks.ceph.osd.3.smithi181.stderr:2021-02-24T15:25:46.349+0000 7f67ffba9700 -1 snap_mapper.add_oid found existing snaps mapped on 57:db2d0b61:test-rados-api-smithi181-36860-74::foo:25, removing 2021-02-24T15:25:46.351 INFO:tasks.ceph.osd.4.smithi181.stderr:2021-02-24T15:25:46.349+0000 7f1c23b22700 -1 snap_mapper.add_oid found existing snaps mapped on 57:db2d0b61:test-rados-api-smithi181-36860-74::foo:25, removing 2021-02-24T15:25:54.900 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2021-02-24T15:25:54.900 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2021-02-24T15:25:54.900 INFO:tasks.ceph.mon.b:Restarting daemon 2021-02-24T15:25:54.901 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-02-24T15:25:54.905 INFO:tasks.ceph.mon.b:Started 2021-02-24T15:25:54.905 INFO:tasks.mon_thrash:Sending STOP to mon a 2021-02-24T15:25:54.906 INFO:tasks.ceph.mon.a:Sent signal 19 2021-02-24T15:25:54.906 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2021-02-24T15:26:09.907 INFO:tasks.mon_thrash:Sending CONT to mon a 2021-02-24T15:26:09.909 INFO:tasks.ceph.mon.a:Sent signal 18 2021-02-24T15:26:09.909 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:26:09.909 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:26:10.047 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.047+0000 7fd76b027700 1 Processor -- start 2021-02-24T15:26:10.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.047+0000 7fd76b027700 1 -- start start 2021-02-24T15:26:10.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.048+0000 7fd76b027700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7640922a0 con 0x7fd7640945b0 2021-02-24T15:26:10.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.048+0000 7fd76b027700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd764092540 con 0x7fd7640939f0 2021-02-24T15:26:10.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.048+0000 7fd76b027700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7640927e0 con 0x7fd76412e1c0 2021-02-24T15:26:10.049 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.048+0000 7fd7695c4700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fd76412e1c0 0x7fd7641305b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36880/0 (socket says 172.21.15.152:36880) 2021-02-24T15:26:10.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.048+0000 7fd768dc3700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd7640945b0 0x7fd76408fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48400/0 (socket says 172.21.15.152:48400) 2021-02-24T15:26:10.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.048+0000 7fd7695c4700 1 -- 172.21.15.152:0/568271205 learned_addr learned my addr 172.21.15.152:0/568271205 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:10.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.050+0000 7fd7695c4700 1 -- 172.21.15.152:0/568271205 >> v1:172.21.15.152:6790/0 conn(0x7fd76412e1c0 legacy=0x7fd7641305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.050+0000 7fd768dc3700 1 -- 172.21.15.152:0/568271205 >> v1:172.21.15.152:6789/0 conn(0x7fd7640945b0 legacy=0x7fd76408fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.050+0000 7fd763fff700 1 -- 172.21.15.152:0/568271205 >> v1:172.21.15.181:6789/0 conn(0x7fd7640939f0 legacy=0x7fd764090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.050+0000 7fd7637fe700 1 -- 172.21.15.152:0/568271205 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174934351 0 0) 0x7fd7640922a0 con 0x7fd7640945b0 2021-02-24T15:26:10.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd7637fe700 1 -- 172.21.15.152:0/568271205 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd748003230 con 0x7fd7640945b0 2021-02-24T15:26:10.053 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd7637fe700 1 -- 172.21.15.152:0/568271205 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 674416986 0 0) 0x7fd748003230 con 0x7fd7640945b0 2021-02-24T15:26:10.053 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd7637fe700 1 -- 172.21.15.152:0/568271205 >> v1:172.21.15.152:6790/0 conn(0x7fd76412e1c0 legacy=0x7fd7641305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.053 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd7637fe700 1 -- 172.21.15.152:0/568271205 >> v1:172.21.15.181:6789/0 conn(0x7fd7640939f0 legacy=0x7fd764090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.053 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd7637fe700 1 -- 172.21.15.152:0/568271205 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764092a80 con 0x7fd7640945b0 2021-02-24T15:26:10.054 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd7637fe700 1 -- 172.21.15.152:0/568271205 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd758001930 con 0x7fd7640945b0 2021-02-24T15:26:10.054 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd7637fe700 1 -- 172.21.15.152:0/568271205 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd758001c40 con 0x7fd7640945b0 2021-02-24T15:26:10.054 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd7637fe700 1 -- 172.21.15.152:0/568271205 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd758004690 con 0x7fd7640945b0 2021-02-24T15:26:10.055 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd76b027700 1 -- 172.21.15.152:0/568271205 >> v1:172.21.15.152:6789/0 conn(0x7fd7640945b0 legacy=0x7fd76408fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.055 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd76b027700 1 -- 172.21.15.152:0/568271205 shutdown_connections 2021-02-24T15:26:10.055 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd76b027700 1 -- 172.21.15.152:0/568271205 >> 172.21.15.152:0/568271205 conn(0x7fd7640999a0 msgr2=0x7fd764099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:10.055 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd76b027700 1 -- 172.21.15.152:0/568271205 shutdown_connections 2021-02-24T15:26:10.056 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.051+0000 7fd76b027700 1 -- 172.21.15.152:0/568271205 wait complete. 2021-02-24T15:26:10.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.052+0000 7fd76b027700 1 librados: starting msgr at 2021-02-24T15:26:10.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.052+0000 7fd76b027700 1 librados: starting objecter 2021-02-24T15:26:10.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.052+0000 7fd76b027700 1 Processor -- start 2021-02-24T15:26:10.059 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.052+0000 7fd76b027700 1 -- start start 2021-02-24T15:26:10.060 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.052+0000 7fd76b027700 1 librados: setting wanted keys 2021-02-24T15:26:10.060 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.052+0000 7fd76b027700 1 librados: calling monclient init 2021-02-24T15:26:10.060 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.053+0000 7fd76b027700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd764066f70 con 0x7fd76412e1c0 2021-02-24T15:26:10.060 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.053+0000 7fd76b027700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd764063e60 con 0x7fd7640945b0 2021-02-24T15:26:10.061 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.053+0000 7fd76b027700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd764066a90 con 0x7fd7640939f0 2021-02-24T15:26:10.061 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.053+0000 7fd768dc3700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fd7640939f0 0x7fd764063040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36882/0 (socket says 172.21.15.152:36882) 2021-02-24T15:26:10.061 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.053+0000 7fd768dc3700 1 -- 172.21.15.152:0/1585589884 learned_addr learned my addr 172.21.15.152:0/1585589884 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:10.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd768dc3700 1 -- 172.21.15.152:0/1585589884 >> v1:172.21.15.152:6790/0 conn(0x7fd7640939f0 legacy=0x7fd764063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd760ff9700 10 client.?.objecter ms_handle_connect 0x7fd7640939f0 2021-02-24T15:26:10.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd760ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd760ff9700 10 client.?.objecter ms_handle_connect 0x7fd76412e1c0 2021-02-24T15:26:10.062 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd760ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd7695c4700 1 -- 172.21.15.152:0/1585589884 >> v1:172.21.15.152:6789/0 conn(0x7fd76412e1c0 legacy=0x7fd7641426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381757639 0 0) 0x7fd764066f70 con 0x7fd76412e1c0 2021-02-24T15:26:10.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd744004bd0 con 0x7fd76412e1c0 2021-02-24T15:26:10.063 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd760ff9700 10 client.?.objecter ms_handle_connect 0x7fd7640945b0 2021-02-24T15:26:10.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd760ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.055+0000 7fd763fff700 1 -- 172.21.15.152:0/1585589884 >> v1:172.21.15.181:6789/0 conn(0x7fd7640945b0 legacy=0x7fd764063750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2803828003 0 0) 0x7fd744004bd0 con 0x7fd76412e1c0 2021-02-24T15:26:10.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd764066f70 con 0x7fd76412e1c0 2021-02-24T15:26:10.064 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd75c001e90 con 0x7fd76412e1c0 2021-02-24T15:26:10.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259210598 0 0) 0x7fd764063e60 con 0x7fd7640945b0 2021-02-24T15:26:10.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd744004bd0 con 0x7fd7640945b0 2021-02-24T15:26:10.065 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 589681036 0 0) 0x7fd764066f70 con 0x7fd76412e1c0 2021-02-24T15:26:10.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 >> v1:172.21.15.152:6790/0 conn(0x7fd7640939f0 legacy=0x7fd764063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 >> v1:172.21.15.181:6789/0 conn(0x7fd7640945b0 legacy=0x7fd764063750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7641144f0 con 0x7fd76412e1c0 2021-02-24T15:26:10.066 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764114870 con 0x7fd76412e1c0 2021-02-24T15:26:10.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd76b027700 10 client.28230.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:10.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd764126f80 con 0x7fd76412e1c0 2021-02-24T15:26:10.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd76b027700 1 librados: init done 2021-02-24T15:26:10.067 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd75c004c20 con 0x7fd76412e1c0 2021-02-24T15:26:10.068 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd75c004f30 con 0x7fd76412e1c0 2021-02-24T15:26:10.068 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.056+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fd75c005110 con 0x7fd76412e1c0 2021-02-24T15:26:10.068 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.057+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(371..371 src has 66..371) v4 ==== 5261+0+0 (unknown 22602347 0 0) 0x7fd75c03b2d0 con 0x7fd76412e1c0 2021-02-24T15:26:10.068 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.057+0000 7fd760ff9700 10 client.28230.objecter ms_dispatch 0x7fd764001510 osd_map(371..371 src has 66..371) v4 2021-02-24T15:26:10.069 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.057+0000 7fd760ff9700 3 client.28230.objecter handle_osd_map got epochs [371,371] > 0 2021-02-24T15:26:10.069 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.057+0000 7fd760ff9700 3 client.28230.objecter handle_osd_map decoding full epoch 371 2021-02-24T15:26:10.069 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.057+0000 7fd760ff9700 20 client.28230.objecter dump_active .. 0 homeless 2021-02-24T15:26:10.069 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.057+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c004d60 con 0x7fd76412e1c0 2021-02-24T15:26:10.070 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.059+0000 7fd760ff9700 10 client.28230.objecter ms_handle_connect 0x7fd744031550 2021-02-24T15:26:10.070 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.061+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fd75c012a60 con 0x7fd76412e1c0 2021-02-24T15:26:10.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.301+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd73c005590 con 0x7fd76412e1c0 2021-02-24T15:26:10.301 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.301+0000 7fd760ff9700 1 -- 172.21.15.152:0/1585589884 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 2539801432) 0x7fd75c012650 con 0x7fd76412e1c0 2021-02-24T15:26:10.302 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:26:10.303 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.302+0000 7fd76b027700 10 librados: watch_flush enter 2021-02-24T15:26:10.303 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 10 librados: watch_flush exit 2021-02-24T15:26:10.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 20 client.28230.objecter shutdown clearing up homeless session... 2021-02-24T15:26:10.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 10 client.28230.objecter successfully canceled tick 2021-02-24T15:26:10.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 >> v1:172.21.15.181:6812/33484 conn(0x7fd744031550 legacy=0x7fd744033a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 >> v1:172.21.15.152:6789/0 conn(0x7fd76412e1c0 legacy=0x7fd7641426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.304 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 shutdown_connections 2021-02-24T15:26:10.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 >> 172.21.15.152:0/1585589884 conn(0x7fd7640999a0 msgr2=0x7fd764094de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:10.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 shutdown_connections 2021-02-24T15:26:10.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 1 -- 172.21.15.152:0/1585589884 wait complete. 2021-02-24T15:26:10.305 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.303+0000 7fd76b027700 1 librados: shutdown 2021-02-24T15:26:10.314 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:26:10.315 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:26:10.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.434+0000 7f3ba17c0700 1 Processor -- start 2021-02-24T15:26:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.434+0000 7f3ba17c0700 1 -- start start 2021-02-24T15:26:10.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.435+0000 7f3ba17c0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c12b0d0 con 0x7f3b9c067e70 2021-02-24T15:26:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.435+0000 7f3ba17c0700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c098a60 con 0x7f3b9c0679c0 2021-02-24T15:26:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.435+0000 7f3ba17c0700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c09a0b0 con 0x7f3b9c0613c0 2021-02-24T15:26:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.435+0000 7f3b9affd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f3b9c0613c0 0x7f3b9c12a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36890/0 (socket says 172.21.15.152:36890) 2021-02-24T15:26:10.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.435+0000 7f3b9b7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3b9c067e70 0x7f3b9c133410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48418/0 (socket says 172.21.15.152:48418) 2021-02-24T15:26:10.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.435+0000 7f3b9affd700 1 -- 172.21.15.152:0/1982868609 learned_addr learned my addr 172.21.15.152:0/1982868609 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:10.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9b7fe700 1 -- 172.21.15.152:0/1982868609 >> v1:172.21.15.152:6789/0 conn(0x7f3b9c067e70 legacy=0x7f3b9c133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9affd700 1 -- 172.21.15.152:0/1982868609 >> v1:172.21.15.152:6790/0 conn(0x7f3b9c0613c0 legacy=0x7f3b9c12a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656196041 0 0) 0x7f3b9c12b0d0 con 0x7f3b9c067e70 2021-02-24T15:26:10.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b7c003230 con 0x7f3b9c067e70 2021-02-24T15:26:10.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368614040 0 0) 0x7f3b9c09a0b0 con 0x7f3b9c0613c0 2021-02-24T15:26:10.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b9c12b0d0 con 0x7f3b9c0613c0 2021-02-24T15:26:10.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b93fff700 1 -- 172.21.15.152:0/1982868609 >> v1:172.21.15.181:6789/0 conn(0x7f3b9c0679c0 legacy=0x7f3b9c12fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4259725843 0 0) 0x7f3b9c12b0d0 con 0x7f3b9c0613c0 2021-02-24T15:26:10.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 >> v1:172.21.15.181:6789/0 conn(0x7f3b9c0679c0 legacy=0x7f3b9c12fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 >> v1:172.21.15.152:6789/0 conn(0x7f3b9c067e70 legacy=0x7f3b9c133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c09a350 con 0x7f3b9c0613c0 2021-02-24T15:26:10.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3b8c001970 con 0x7f3b9c0613c0 2021-02-24T15:26:10.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.437+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3b8c001c80 con 0x7f3b9c0613c0 2021-02-24T15:26:10.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.438+0000 7f3b9a7fc700 1 -- 172.21.15.152:0/1982868609 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3b8c004750 con 0x7f3b9c0613c0 2021-02-24T15:26:10.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.438+0000 7f3ba17c0700 1 -- 172.21.15.152:0/1982868609 >> v1:172.21.15.152:6790/0 conn(0x7f3b9c0613c0 legacy=0x7f3b9c12a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.438+0000 7f3ba17c0700 1 -- 172.21.15.152:0/1982868609 shutdown_connections 2021-02-24T15:26:10.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.438+0000 7f3ba17c0700 1 -- 172.21.15.152:0/1982868609 >> 172.21.15.152:0/1982868609 conn(0x7f3b9c09a940 msgr2=0x7f3b9c09ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:10.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.438+0000 7f3ba17c0700 1 -- 172.21.15.152:0/1982868609 shutdown_connections 2021-02-24T15:26:10.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.438+0000 7f3ba17c0700 1 -- 172.21.15.152:0/1982868609 wait complete. 2021-02-24T15:26:10.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3ba17c0700 1 librados: starting msgr at 2021-02-24T15:26:10.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3ba17c0700 1 librados: starting objecter 2021-02-24T15:26:10.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3ba17c0700 1 Processor -- start 2021-02-24T15:26:10.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3ba17c0700 1 -- start start 2021-02-24T15:26:10.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3ba17c0700 1 librados: setting wanted keys 2021-02-24T15:26:10.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3ba17c0700 1 librados: calling monclient init 2021-02-24T15:26:10.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3ba17c0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c122030 con 0x7f3b9c0613c0 2021-02-24T15:26:10.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3ba17c0700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c1209c0 con 0x7f3b9c067e70 2021-02-24T15:26:10.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3ba17c0700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c124c00 con 0x7f3b9c0679c0 2021-02-24T15:26:10.450 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3b93fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f3b9c0679c0 0x7f3b9c139ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36898/0 (socket says 172.21.15.152:36898) 2021-02-24T15:26:10.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3b9affd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3b9c0613c0 0x7f3b9c1244f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48420/0 (socket says 172.21.15.152:48420) 2021-02-24T15:26:10.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.439+0000 7f3b93fff700 1 -- 172.21.15.152:0/231501174 learned_addr learned my addr 172.21.15.152:0/231501174 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:10.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.441+0000 7f3b9affd700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6789/0 conn(0x7f3b9c0613c0 legacy=0x7f3b9c1244f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.451 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.441+0000 7f3b92ffd700 10 client.?.objecter ms_handle_connect 0x7f3b9c0613c0 2021-02-24T15:26:10.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.441+0000 7f3b93fff700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6790/0 conn(0x7f3b9c0679c0 legacy=0x7f3b9c139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.441+0000 7f3b92ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.452 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.441+0000 7f3b92ffd700 10 client.?.objecter ms_handle_connect 0x7f3b9c0679c0 2021-02-24T15:26:10.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.441+0000 7f3b92ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b9affd700 1 --1- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6789/0 conn(0x7f3b9c0613c0 0x7f3b9c1244f0 :-1 s=OPENED pgs=9113 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f3b9c122030 auth_reply(proto 2 0 (0) Success) v1 2021-02-24T15:26:10.453 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669714254 0 0) 0x7f3b9c124c00 con 0x7f3b9c0679c0 2021-02-24T15:26:10.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b80004bd0 con 0x7f3b9c0679c0 2021-02-24T15:26:10.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b9b7fe700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.181:6789/0 conn(0x7f3b9c067e70 legacy=0x7f3b9c142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 10 client.?.objecter ms_handle_connect 0x7f3b9c067e70 2021-02-24T15:26:10.454 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2338798829 0 0) 0x7f3b80004bd0 con 0x7f3b9c0679c0 2021-02-24T15:26:10.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b9c124c00 con 0x7f3b9c0679c0 2021-02-24T15:26:10.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3b84001cc0 con 0x7f3b9c0679c0 2021-02-24T15:26:10.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163608338 0 0) 0x7f3b9c1209c0 con 0x7f3b9c067e70 2021-02-24T15:26:10.455 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b80004bd0 con 0x7f3b9c067e70 2021-02-24T15:26:10.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2310542241 0 0) 0x7f3b9c124c00 con 0x7f3b9c0679c0 2021-02-24T15:26:10.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.181:6789/0 conn(0x7f3b9c067e70 legacy=0x7f3b9c142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6789/0 conn(0x7f3b9c0613c0 legacy=0x7f3b9c1244f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c124d90 con 0x7f3b9c0679c0 2021-02-24T15:26:10.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590937877 0 0) 0x7f3b9c122030 con 0x7f3b9c0613c0 2021-02-24T15:26:10.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c124fe0 con 0x7f3b9c0679c0 2021-02-24T15:26:10.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3ba17c0700 10 client.84179.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:10.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c13a7f0 con 0x7f3b9c0679c0 2021-02-24T15:26:10.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3ba17c0700 1 librados: init done 2021-02-24T15:26:10.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3b840024e0 con 0x7f3b9c0679c0 2021-02-24T15:26:10.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.442+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3b840027f0 con 0x7f3b9c0679c0 2021-02-24T15:26:10.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.443+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f3b84002a00 con 0x7f3b9c0679c0 2021-02-24T15:26:10.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.443+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3b74006550 con 0x7f3b740027f0 2021-02-24T15:26:10.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.443+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(372..372 src has 66..372) v4 ==== 5290+0+0 (unknown 2340595407 0 0) 0x7f3b8403b150 con 0x7f3b9c0679c0 2021-02-24T15:26:10.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.443+0000 7f3b92ffd700 10 client.84179.objecter ms_dispatch 0x7f3b9c001510 osd_map(372..372 src has 66..372) v4 2021-02-24T15:26:10.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.443+0000 7f3b92ffd700 3 client.84179.objecter handle_osd_map got epochs [372,372] > 0 2021-02-24T15:26:10.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.443+0000 7f3b92ffd700 3 client.84179.objecter handle_osd_map decoding full epoch 372 2021-02-24T15:26:10.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.443+0000 7f3b92ffd700 20 client.84179.objecter dump_active .. 0 homeless 2021-02-24T15:26:10.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.445+0000 7f3b9affd700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6789/0 conn(0x7f3b740027f0 legacy=0x7f3b74004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.460 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.445+0000 7f3b92ffd700 10 client.84179.objecter ms_handle_connect 0x7f3b740027f0 2021-02-24T15:26:10.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.445+0000 7f3b92ffd700 10 client.84179.objecter resend_mon_ops 2021-02-24T15:26:10.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.445+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270158795 0 0) 0x7f3b74006550 con 0x7f3b740027f0 2021-02-24T15:26:10.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.445+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b9c122030 con 0x7f3b740027f0 2021-02-24T15:26:10.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.445+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1969982048 0 0) 0x7f3b9c122030 con 0x7f3b740027f0 2021-02-24T15:26:10.461 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.446+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b74006550 con 0x7f3b740027f0 2021-02-24T15:26:10.462 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.446+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3b8c001300 con 0x7f3b740027f0 2021-02-24T15:26:10.462 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.446+0000 7f3b92ffd700 10 client.84179.objecter ms_handle_connect 0x7f3b80031330 2021-02-24T15:26:10.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.446+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4282067970 0 0) 0x7f3b74006550 con 0x7f3b740027f0 2021-02-24T15:26:10.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.446+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b74009df0 con 0x7f3b740027f0 2021-02-24T15:26:10.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.446+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f3b8c001780 con 0x7f3b740027f0 2021-02-24T15:26:10.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.446+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6789/0 conn(0x7f3b740027f0 legacy=0x7f3b74004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.446+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6789/0 conn(0x7f3b740027f0 legacy=0x7f3b74004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:10.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.454+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f3b74009a60 con 0x7f3b74008d80 2021-02-24T15:26:10.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.456+0000 7f3b9affd700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6789/0 conn(0x7f3b74008d80 legacy=0x7f3b74009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.456+0000 7f3b92ffd700 10 client.84179.objecter ms_handle_connect 0x7f3b74008d80 2021-02-24T15:26:10.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.456+0000 7f3b92ffd700 10 client.84179.objecter resend_mon_ops 2021-02-24T15:26:10.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.456+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472192364 0 0) 0x7f3b74009a60 con 0x7f3b74008d80 2021-02-24T15:26:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.456+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b74006550 con 0x7f3b74008d80 2021-02-24T15:26:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.456+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3693453316 0 0) 0x7f3b74006550 con 0x7f3b74008d80 2021-02-24T15:26:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.456+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b74009a60 con 0x7f3b74008d80 2021-02-24T15:26:10.468 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.456+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3b8c004e50 con 0x7f3b74008d80 2021-02-24T15:26:10.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1554929152 0 0) 0x7f3b74009a60 con 0x7f3b74008d80 2021-02-24T15:26:10.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3b740086f0 con 0x7f3b74008d80 2021-02-24T15:26:10.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4112 (unknown 0 0 4204583189) 0x7f3b8c005170 con 0x7f3b74008d80 2021-02-24T15:26:10.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6789/0 conn(0x7f3b74008d80 legacy=0x7f3b74009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3b92ffd700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6789/0 conn(0x7f3b74008d80 legacy=0x7f3b74009210 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:10.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 10 librados: watch_flush enter 2021-02-24T15:26:10.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 10 librados: watch_flush exit 2021-02-24T15:26:10.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 20 client.84179.objecter shutdown clearing up homeless session... 2021-02-24T15:26:10.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 10 client.84179.objecter successfully canceled tick 2021-02-24T15:26:10.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.181:6812/33484 conn(0x7f3b80031330 legacy=0x7f3b800337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 >> v1:172.21.15.152:6790/0 conn(0x7f3b9c0679c0 legacy=0x7f3b9c139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3b9b7fe700 1 -- 172.21.15.152:0/231501174 reap_dead start 2021-02-24T15:26:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3b9b7fe700 1 -- 172.21.15.152:0/231501174 reap_dead start 2021-02-24T15:26:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 shutdown_connections 2021-02-24T15:26:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 >> 172.21.15.152:0/231501174 conn(0x7f3b9c09a940 msgr2=0x7f3b9c097310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 shutdown_connections 2021-02-24T15:26:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 1 -- 172.21.15.152:0/231501174 wait complete. 2021-02-24T15:26:10.474 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.457+0000 7f3ba17c0700 1 librados: shutdown 2021-02-24T15:26:10.475 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:26:10.476 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:10.476 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:10.477 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:26:10.477 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 46, 2021-02-24T15:26:10.477 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:26:10.478 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:26:10.478 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:26:10.478 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:26:10.478 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.479 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:26:10.479 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:10.479 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:26:10.479 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:26:10.480 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:10.480 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:10.480 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:10.481 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:10.481 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:10.481 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:10.481 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:10.481 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:10.482 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:10.482 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.482 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:26:10.482 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:26:10.483 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:10.483 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:10.483 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:10.483 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:10.483 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:10.484 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:10.484 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:10.484 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:10.484 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:10.484 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.485 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:26:10.485 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:26:10.485 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:26:10.485 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:26:10.486 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:26:10.486 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:26:10.486 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:10.486 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:10.486 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:26:10.487 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:26:10.487 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:26:10.488 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:26:10.488 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:26:10.488 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:10.488 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:26:10.489 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:10.489 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:10.489 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:10.489 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:10.489 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:10.490 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:10.490 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:10.490 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:10.490 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:10.490 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.491 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:26:10.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.491 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:26:10.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.491 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:10.492 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:10.492 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:10.492 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:10.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.493 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:10.493 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:26:10.493 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:10.493 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.494 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.494 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:26:10.494 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:26:10.495 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:10.495 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:10.495 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:10.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.496 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:10.496 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:10.496 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:10.496 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:10.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.497 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:10.497 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:26:10.498 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:10.498 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.498 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.499 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:26:10.499 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:26:10.499 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:10.500 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:10.500 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:10.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.500 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:10.501 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:10.501 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:10.501 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:10.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.502 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:10.502 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:26:10.502 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:10.502 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.503 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.503 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:26:10.503 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:26:10.503 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:10.504 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:10.504 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:10.504 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.504 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.505 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:26:10.505 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:26:10.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.505 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:10.506 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:10.506 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:10.506 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.506 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.507 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:26:10.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.507 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:10.508 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:10.508 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:26:10.508 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.508 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.508 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:26:10.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.509 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:10.509 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:10.509 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:26:10.510 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.510 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.510 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:26:10.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.510 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:10.511 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:10.511 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:10.511 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.511 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.512 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:26:10.512 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:26:10.513 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:26:10.632 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.632+0000 7f21bdb47700 1 Processor -- start 2021-02-24T15:26:10.633 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.632+0000 7f21bdb47700 1 -- start start 2021-02-24T15:26:10.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.633+0000 7f21bdb47700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8092e60 con 0x7f21b8095930 2021-02-24T15:26:10.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.633+0000 7f21bdb47700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8091f30 con 0x7f21b8091110 2021-02-24T15:26:10.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.633+0000 7f21bdb47700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b80921d0 con 0x7f21b8094e40 2021-02-24T15:26:10.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.633+0000 7f21b77fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f21b8094e40 0x7f21b8092750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36908/0 (socket says 172.21.15.152:36908) 2021-02-24T15:26:10.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.633+0000 7f21b77fe700 1 -- 172.21.15.152:0/68972929 learned_addr learned my addr 172.21.15.152:0/68972929 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:10.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.635+0000 7f21b77fe700 1 -- 172.21.15.152:0/68972929 >> v1:172.21.15.152:6790/0 conn(0x7f21b8094e40 legacy=0x7f21b8092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.635+0000 7f21b7fff700 1 -- 172.21.15.152:0/68972929 >> v1:172.21.15.152:6789/0 conn(0x7f21b8095930 legacy=0x7f21b812f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.635+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307873072 0 0) 0x7f21b80921d0 con 0x7f21b8094e40 2021-02-24T15:26:10.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.635+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a4003230 con 0x7f21b8094e40 2021-02-24T15:26:10.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.635+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639984283 0 0) 0x7f21b8092e60 con 0x7f21b8095930 2021-02-24T15:26:10.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.635+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b80921d0 con 0x7f21b8095930 2021-02-24T15:26:10.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.635+0000 7f21b6ffd700 1 -- 172.21.15.152:0/68972929 >> v1:172.21.15.181:6789/0 conn(0x7f21b8091110 legacy=0x7f21b8095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1521302429 0 0) 0x7f21a4003230 con 0x7f21b8094e40 2021-02-24T15:26:10.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 >> v1:172.21.15.181:6789/0 conn(0x7f21b8091110 legacy=0x7f21b8095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 >> v1:172.21.15.152:6789/0 conn(0x7f21b8095930 legacy=0x7f21b812f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8091590 con 0x7f21b8094e40 2021-02-24T15:26:10.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f21a8001930 con 0x7f21b8094e40 2021-02-24T15:26:10.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f21a8001c40 con 0x7f21b8094e40 2021-02-24T15:26:10.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21b67fc700 1 -- 172.21.15.152:0/68972929 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f21a8004750 con 0x7f21b8094e40 2021-02-24T15:26:10.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21bdb47700 1 -- 172.21.15.152:0/68972929 >> v1:172.21.15.152:6790/0 conn(0x7f21b8094e40 legacy=0x7f21b8092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21bdb47700 1 -- 172.21.15.152:0/68972929 shutdown_connections 2021-02-24T15:26:10.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21bdb47700 1 -- 172.21.15.152:0/68972929 >> 172.21.15.152:0/68972929 conn(0x7f21b80999a0 msgr2=0x7f21b8099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:10.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21bdb47700 1 -- 172.21.15.152:0/68972929 shutdown_connections 2021-02-24T15:26:10.640 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.636+0000 7f21bdb47700 1 -- 172.21.15.152:0/68972929 wait complete. 2021-02-24T15:26:10.644 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.637+0000 7f21bdb47700 1 librados: starting msgr at 2021-02-24T15:26:10.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.637+0000 7f21bdb47700 1 librados: starting objecter 2021-02-24T15:26:10.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.637+0000 7f21bdb47700 1 Processor -- start 2021-02-24T15:26:10.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.637+0000 7f21bdb47700 1 -- start start 2021-02-24T15:26:10.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.637+0000 7f21bdb47700 1 librados: setting wanted keys 2021-02-24T15:26:10.645 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.637+0000 7f21bdb47700 1 librados: calling monclient init 2021-02-24T15:26:10.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.638+0000 7f21bdb47700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8098500 con 0x7f21b8095930 2021-02-24T15:26:10.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.638+0000 7f21bdb47700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b813a7c0 con 0x7f21b8091110 2021-02-24T15:26:10.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.638+0000 7f21bdb47700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8067a50 con 0x7f21b8094e40 2021-02-24T15:26:10.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.638+0000 7f21b6ffd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f21b8094e40 0x7f21b8134060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36916/0 (socket says 172.21.15.152:36916) 2021-02-24T15:26:10.646 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.638+0000 7f21b6ffd700 1 -- 172.21.15.152:0/3663925411 learned_addr learned my addr 172.21.15.152:0/3663925411 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:10.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f21b6ffd700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6790/0 conn(0x7f21b8094e40 legacy=0x7f21b8134060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f21b7fff700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6789/0 conn(0x7f21b8095930 legacy=0x7f21b8142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 10 client.?.objecter ms_handle_connect 0x7f21b8094e40 2021-02-24T15:26:10.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.647 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 10 client.?.objecter ms_handle_connect 0x7f21b8095930 2021-02-24T15:26:10.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54112291 0 0) 0x7f21b8067a50 con 0x7f21b8094e40 2021-02-24T15:26:10.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2198004bd0 con 0x7f21b8094e40 2021-02-24T15:26:10.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 10 client.?.objecter ms_handle_connect 0x7f21b8091110 2021-02-24T15:26:10.648 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f21b77fe700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.181:6789/0 conn(0x7f21b8091110 legacy=0x7f21b813a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917742536 0 0) 0x7f21b8098500 con 0x7f21b8095930 2021-02-24T15:26:10.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b8067a50 con 0x7f21b8095930 2021-02-24T15:26:10.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2863470306 0 0) 0x7f2198004bd0 con 0x7f21b8094e40 2021-02-24T15:26:10.649 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f21b8098500 con 0x7f21b8094e40 2021-02-24T15:26:10.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f21ac001c00 con 0x7f21b8094e40 2021-02-24T15:26:10.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3730081938 0 0) 0x7f21b8067a50 con 0x7f21b8095930 2021-02-24T15:26:10.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2198004bd0 con 0x7f21b8095930 2021-02-24T15:26:10.650 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f21b0001f80 con 0x7f21b8095930 2021-02-24T15:26:10.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014513293 0 0) 0x7f21b8091590 con 0x7f21b8091110 2021-02-24T15:26:10.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b8067a50 con 0x7f21b8091110 2021-02-24T15:26:10.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1176597241 0 0) 0x7f21b8098500 con 0x7f21b8094e40 2021-02-24T15:26:10.651 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.181:6789/0 conn(0x7f21b8091110 legacy=0x7f21b813a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6789/0 conn(0x7f21b8095930 legacy=0x7f21b8142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b811ba40 con 0x7f21b8094e40 2021-02-24T15:26:10.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b813aef0 con 0x7f21b8094e40 2021-02-24T15:26:10.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f21bdb47700 10 client.84185.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:10.652 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b811a3b0 con 0x7f21b8094e40 2021-02-24T15:26:10.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.640+0000 7f21bdb47700 1 librados: init done 2021-02-24T15:26:10.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.641+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f21ac0022f0 con 0x7f21b8094e40 2021-02-24T15:26:10.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.641+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f21ac002600 con 0x7f21b8094e40 2021-02-24T15:26:10.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.641+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f21ac002760 con 0x7f21b8094e40 2021-02-24T15:26:10.653 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.641+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2190006550 con 0x7f21900027f0 2021-02-24T15:26:10.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.641+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(372..372 src has 66..372) v4 ==== 5290+0+0 (unknown 2340595407 0 0) 0x7f21ac03b000 con 0x7f21b8094e40 2021-02-24T15:26:10.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.641+0000 7f219f7fe700 10 client.84185.objecter ms_dispatch 0x7f21b8001510 osd_map(372..372 src has 66..372) v4 2021-02-24T15:26:10.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.641+0000 7f219f7fe700 3 client.84185.objecter handle_osd_map got epochs [372,372] > 0 2021-02-24T15:26:10.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.641+0000 7f219f7fe700 3 client.84185.objecter handle_osd_map decoding full epoch 372 2021-02-24T15:26:10.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.641+0000 7f219f7fe700 20 client.84185.objecter dump_active .. 0 homeless 2021-02-24T15:26:10.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.643+0000 7f219f7fe700 10 client.84185.objecter ms_handle_connect 0x7f21900027f0 2021-02-24T15:26:10.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.643+0000 7f219f7fe700 10 client.84185.objecter resend_mon_ops 2021-02-24T15:26:10.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.643+0000 7f21b77fe700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6790/0 conn(0x7f21900027f0 legacy=0x7f2190004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498697589 0 0) 0x7f2190006550 con 0x7f21900027f0 2021-02-24T15:26:10.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b8098500 con 0x7f21900027f0 2021-02-24T15:26:10.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1233708139 0 0) 0x7f21b8098500 con 0x7f21900027f0 2021-02-24T15:26:10.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2190006550 con 0x7f21900027f0 2021-02-24T15:26:10.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f21a8004810 con 0x7f21900027f0 2021-02-24T15:26:10.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3659499171 0 0) 0x7f2190006550 con 0x7f21900027f0 2021-02-24T15:26:10.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2190009df0 con 0x7f21900027f0 2021-02-24T15:26:10.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 10 client.84185.objecter ms_handle_connect 0x7f21980317a0 2021-02-24T15:26:10.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f21a8001740 con 0x7f21900027f0 2021-02-24T15:26:10.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6790/0 conn(0x7f21900027f0 legacy=0x7f2190004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.657 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.644+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6790/0 conn(0x7f21900027f0 legacy=0x7f2190004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:10.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.652+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2190009a80 con 0x7f2190008da0 2021-02-24T15:26:10.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.654+0000 7f21b77fe700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6790/0 conn(0x7f2190008da0 legacy=0x7f2190009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.654+0000 7f219f7fe700 10 client.84185.objecter ms_handle_connect 0x7f2190008da0 2021-02-24T15:26:10.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.654+0000 7f219f7fe700 10 client.84185.objecter resend_mon_ops 2021-02-24T15:26:10.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899418655 0 0) 0x7f2190009a80 con 0x7f2190008da0 2021-02-24T15:26:10.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2190006550 con 0x7f2190008da0 2021-02-24T15:26:10.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4195812262 0 0) 0x7f2190006550 con 0x7f2190008da0 2021-02-24T15:26:10.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2190009a80 con 0x7f2190008da0 2021-02-24T15:26:10.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f21a8004ed0 con 0x7f2190008da0 2021-02-24T15:26:10.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2046429124 0 0) 0x7f2190009a80 con 0x7f2190008da0 2021-02-24T15:26:10.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f21900086f0 con 0x7f2190008da0 2021-02-24T15:26:10.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3940 (unknown 0 0 4098100599) 0x7f21a80050b0 con 0x7f2190008da0 2021-02-24T15:26:10.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6790/0 conn(0x7f2190008da0 legacy=0x7f2190009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f219f7fe700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6790/0 conn(0x7f2190008da0 legacy=0x7f2190009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:10.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f21bdb47700 10 librados: watch_flush enter 2021-02-24T15:26:10.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f21bdb47700 10 librados: watch_flush exit 2021-02-24T15:26:10.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f21bdb47700 20 client.84185.objecter shutdown clearing up homeless session... 2021-02-24T15:26:10.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f21bdb47700 10 client.84185.objecter successfully canceled tick 2021-02-24T15:26:10.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.655+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.181:6812/33484 conn(0x7f21980317a0 legacy=0x7f2198033c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.656+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 >> v1:172.21.15.152:6790/0 conn(0x7f21b8094e40 legacy=0x7f21b8134060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.656+0000 7f21b7fff700 1 -- 172.21.15.152:0/3663925411 reap_dead start 2021-02-24T15:26:10.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.656+0000 7f21b7fff700 1 -- 172.21.15.152:0/3663925411 reap_dead start 2021-02-24T15:26:10.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.656+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 shutdown_connections 2021-02-24T15:26:10.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.656+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 >> 172.21.15.152:0/3663925411 conn(0x7f21b80999a0 msgr2=0x7f21b8092670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:10.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.656+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 shutdown_connections 2021-02-24T15:26:10.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.656+0000 7f21bdb47700 1 -- 172.21.15.152:0/3663925411 wait complete. 2021-02-24T15:26:10.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.656+0000 7f21bdb47700 1 librados: shutdown 2021-02-24T15:26:10.666 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:26:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:26:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 46, 2021-02-24T15:26:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:26:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:26:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:26:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:26:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:26:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:26:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:26:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:26:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:26:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:26:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:26:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:26:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:26:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:26:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:26:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:26:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:26:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:26:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:26:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:26:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:26:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:26:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:26:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:26:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:26:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:26:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:26:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:26:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:26:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:26:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:26:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:26:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:26:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:26:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:26:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:26:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:26:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 3 2021-02-24T15:26:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:26:10.695 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:26:10.696 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:26:10.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.814+0000 7fa730c33700 1 Processor -- start 2021-02-24T15:26:10.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.814+0000 7fa730c33700 1 -- start start 2021-02-24T15:26:10.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.815+0000 7fa730c33700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c097d40 con 0x7fa72c099340 2021-02-24T15:26:10.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.815+0000 7fa730c33700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c063d00 con 0x7fa72c062da0 2021-02-24T15:26:10.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.815+0000 7fa730c33700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c097980 con 0x7fa72c063220 2021-02-24T15:26:10.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.815+0000 7fa72ad9d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fa72c063220 0x7fa72c133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36928/0 (socket says 172.21.15.152:36928) 2021-02-24T15:26:10.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.815+0000 7fa72a59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa72c099340 0x7fa72c097270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48450/0 (socket says 172.21.15.152:48450) 2021-02-24T15:26:10.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.815+0000 7fa72ad9d700 1 -- 172.21.15.152:0/1132851587 learned_addr learned my addr 172.21.15.152:0/1132851587 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:10.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.817+0000 7fa72ad9d700 1 -- 172.21.15.152:0/1132851587 >> v1:172.21.15.152:6790/0 conn(0x7fa72c063220 legacy=0x7fa72c133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.817+0000 7fa72a59c700 1 -- 172.21.15.152:0/1132851587 >> v1:172.21.15.152:6789/0 conn(0x7fa72c099340 legacy=0x7fa72c097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa729d9b700 1 -- 172.21.15.152:0/1132851587 >> v1:172.21.15.181:6789/0 conn(0x7fa72c062da0 legacy=0x7fa72c12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840505978 0 0) 0x7fa72c097d40 con 0x7fa72c099340 2021-02-24T15:26:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa710003230 con 0x7fa72c099340 2021-02-24T15:26:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476813132 0 0) 0x7fa72c097980 con 0x7fa72c063220 2021-02-24T15:26:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa72c097d40 con 0x7fa72c063220 2021-02-24T15:26:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 426045037 0 0) 0x7fa72c097d40 con 0x7fa72c063220 2021-02-24T15:26:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 >> v1:172.21.15.181:6789/0 conn(0x7fa72c062da0 legacy=0x7fa72c12fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 >> v1:172.21.15.152:6789/0 conn(0x7fa72c099340 legacy=0x7fa72c097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c08fac0 con 0x7fa72c063220 2021-02-24T15:26:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa724001cb0 con 0x7fa72c063220 2021-02-24T15:26:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa724001fc0 con 0x7fa72c063220 2021-02-24T15:26:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa72959a700 1 -- 172.21.15.152:0/1132851587 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa724004ad0 con 0x7fa72c063220 2021-02-24T15:26:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.818+0000 7fa730c33700 1 -- 172.21.15.152:0/1132851587 >> v1:172.21.15.152:6790/0 conn(0x7fa72c063220 legacy=0x7fa72c133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 -- 172.21.15.152:0/1132851587 shutdown_connections 2021-02-24T15:26:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 -- 172.21.15.152:0/1132851587 >> 172.21.15.152:0/1132851587 conn(0x7fa72c09dcc0 msgr2=0x7fa72c09e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 -- 172.21.15.152:0/1132851587 shutdown_connections 2021-02-24T15:26:10.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 -- 172.21.15.152:0/1132851587 wait complete. 2021-02-24T15:26:10.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 librados: starting msgr at 2021-02-24T15:26:10.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 librados: starting objecter 2021-02-24T15:26:10.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 Processor -- start 2021-02-24T15:26:10.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 -- start start 2021-02-24T15:26:10.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 librados: setting wanted keys 2021-02-24T15:26:10.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.819+0000 7fa730c33700 1 librados: calling monclient init 2021-02-24T15:26:10.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.820+0000 7fa730c33700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c126260 con 0x7fa72c063220 2021-02-24T15:26:10.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.820+0000 7fa730c33700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c094f90 con 0x7fa72c099340 2021-02-24T15:26:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.820+0000 7fa730c33700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c095b50 con 0x7fa72c062da0 2021-02-24T15:26:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.820+0000 7fa72a59c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fa72c062da0 0x7fa72c097000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36932/0 (socket says 172.21.15.152:36932) 2021-02-24T15:26:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.820+0000 7fa72a59c700 1 -- 172.21.15.152:0/2029888199 learned_addr learned my addr 172.21.15.152:0/2029888199 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa729d9b700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.152:6789/0 conn(0x7fa72c063220 legacy=0x7fa72c13f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 10 client.?.objecter ms_handle_connect 0x7fa72c063220 2021-02-24T15:26:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa72a59c700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.152:6790/0 conn(0x7fa72c062da0 legacy=0x7fa72c097000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 10 client.?.objecter ms_handle_connect 0x7fa72c062da0 2021-02-24T15:26:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110735036 0 0) 0x7fa72c126260 con 0x7fa72c063220 2021-02-24T15:26:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa708004bd0 con 0x7fa72c063220 2021-02-24T15:26:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209839453 0 0) 0x7fa72c095b50 con 0x7fa72c062da0 2021-02-24T15:26:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa72c126260 con 0x7fa72c062da0 2021-02-24T15:26:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 10 client.?.objecter ms_handle_connect 0x7fa72c099340 2021-02-24T15:26:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa72ad9d700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.181:6789/0 conn(0x7fa72c099340 legacy=0x7fa72c142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302543079 0 0) 0x7fa72c094f90 con 0x7fa72c099340 2021-02-24T15:26:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa72c095b50 con 0x7fa72c099340 2021-02-24T15:26:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.822+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1396923131 0 0) 0x7fa708004bd0 con 0x7fa72c063220 2021-02-24T15:26:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa72c094f90 con 0x7fa72c063220 2021-02-24T15:26:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa720001ba0 con 0x7fa72c063220 2021-02-24T15:26:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 502397346 0 0) 0x7fa72c126260 con 0x7fa72c062da0 2021-02-24T15:26:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa708004bd0 con 0x7fa72c062da0 2021-02-24T15:26:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa71c0044f0 con 0x7fa72c062da0 2021-02-24T15:26:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2598752185 0 0) 0x7fa72c094f90 con 0x7fa72c063220 2021-02-24T15:26:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.152:6790/0 conn(0x7fa72c062da0 legacy=0x7fa72c097000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.181:6789/0 conn(0x7fa72c099340 legacy=0x7fa72c142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c097710 con 0x7fa72c063220 2021-02-24T15:26:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72c0944c0 con 0x7fa72c063220 2021-02-24T15:26:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa730c33700 10 client.28254.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72c13aad0 con 0x7fa72c063220 2021-02-24T15:26:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa730c33700 1 librados: init done 2021-02-24T15:26:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa720002230 con 0x7fa72c063220 2021-02-24T15:26:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa720002540 con 0x7fa72c063220 2021-02-24T15:26:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.823+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fa720002720 con 0x7fa72c063220 2021-02-24T15:26:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.824+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa70c006550 con 0x7fa70c0027f0 2021-02-24T15:26:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.824+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(372..372 src has 66..372) v4 ==== 5290+0+0 (unknown 2340595407 0 0) 0x7fa72003afa0 con 0x7fa72c063220 2021-02-24T15:26:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.824+0000 7fa71a7fc700 10 client.28254.objecter ms_dispatch 0x7fa72c001510 osd_map(372..372 src has 66..372) v4 2021-02-24T15:26:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.824+0000 7fa71a7fc700 3 client.28254.objecter handle_osd_map got epochs [372,372] > 0 2021-02-24T15:26:10.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.824+0000 7fa71a7fc700 3 client.28254.objecter handle_osd_map decoding full epoch 372 2021-02-24T15:26:10.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.824+0000 7fa71a7fc700 20 client.28254.objecter dump_active .. 0 homeless 2021-02-24T15:26:10.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa72a59c700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.181:6789/0 conn(0x7fa70c0027f0 legacy=0x7fa70c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 10 client.28254.objecter ms_handle_connect 0x7fa70c0027f0 2021-02-24T15:26:10.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 10 client.28254.objecter resend_mon_ops 2021-02-24T15:26:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280501388 0 0) 0x7fa70c006550 con 0x7fa70c0027f0 2021-02-24T15:26:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa72c094f90 con 0x7fa70c0027f0 2021-02-24T15:26:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 10 client.28254.objecter ms_handle_connect 0x7fa7080317a0 2021-02-24T15:26:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1151288634 0 0) 0x7fa72c094f90 con 0x7fa70c0027f0 2021-02-24T15:26:10.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa70c006550 con 0x7fa70c0027f0 2021-02-24T15:26:10.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa71c004a90 con 0x7fa70c0027f0 2021-02-24T15:26:10.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1065891820 0 0) 0x7fa70c006550 con 0x7fa70c0027f0 2021-02-24T15:26:10.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.826+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa70c009df0 con 0x7fa70c0027f0 2021-02-24T15:26:10.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.827+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fa71c004da0 con 0x7fa70c0027f0 2021-02-24T15:26:10.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.827+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.181:6789/0 conn(0x7fa70c0027f0 legacy=0x7fa70c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.827+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.181:6789/0 conn(0x7fa70c0027f0 legacy=0x7fa70c004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:10.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.835+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa70c007520 con 0x7fa70c0068c0 2021-02-24T15:26:10.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.837+0000 7fa72a59c700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.181:6789/0 conn(0x7fa70c0068c0 legacy=0x7fa70c006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:10.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.837+0000 7fa71a7fc700 10 client.28254.objecter ms_handle_connect 0x7fa70c0068c0 2021-02-24T15:26:10.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.837+0000 7fa71a7fc700 10 client.28254.objecter resend_mon_ops 2021-02-24T15:26:10.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.838+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180583804 0 0) 0x7fa70c007520 con 0x7fa70c0068c0 2021-02-24T15:26:10.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.838+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa70c006550 con 0x7fa70c0068c0 2021-02-24T15:26:10.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.838+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1162882746 0 0) 0x7fa70c006550 con 0x7fa70c0068c0 2021-02-24T15:26:10.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.838+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa70c007520 con 0x7fa70c0068c0 2021-02-24T15:26:10.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.838+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa71c005480 con 0x7fa70c0068c0 2021-02-24T15:26:10.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.838+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 106522176 0 0) 0x7fa70c007520 con 0x7fa70c0068c0 2021-02-24T15:26:10.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.838+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa70c008720 con 0x7fa70c0068c0 2021-02-24T15:26:10.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 2846946934) 0x7fa71c006850 con 0x7fa70c0068c0 2021-02-24T15:26:10.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.181:6789/0 conn(0x7fa70c0068c0 legacy=0x7fa70c006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa71a7fc700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.181:6789/0 conn(0x7fa70c0068c0 legacy=0x7fa70c006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:10.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 10 librados: watch_flush enter 2021-02-24T15:26:10.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 10 librados: watch_flush exit 2021-02-24T15:26:10.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 20 client.28254.objecter shutdown clearing up homeless session... 2021-02-24T15:26:10.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 10 client.28254.objecter successfully canceled tick 2021-02-24T15:26:10.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.181:6812/33484 conn(0x7fa7080317a0 legacy=0x7fa708033c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 >> v1:172.21.15.152:6789/0 conn(0x7fa72c063220 legacy=0x7fa72c13f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:10.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa72ad9d700 1 -- 172.21.15.152:0/2029888199 reap_dead start 2021-02-24T15:26:10.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa72ad9d700 1 -- 172.21.15.152:0/2029888199 reap_dead start 2021-02-24T15:26:10.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 shutdown_connections 2021-02-24T15:26:10.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 >> 172.21.15.152:0/2029888199 conn(0x7fa72c09dcc0 msgr2=0x7fa72c09c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:10.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 shutdown_connections 2021-02-24T15:26:10.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 1 -- 172.21.15.152:0/2029888199 wait complete. 2021-02-24T15:26:10.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:10.839+0000 7fa730c33700 1 librados: shutdown 2021-02-24T15:26:10.849 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:26:10.849 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:10.849 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:10.850 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:26:10.850 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 46, 2021-02-24T15:26:10.850 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:26:10.850 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:26:10.850 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:26:10.851 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:26:10.851 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.851 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:26:10.851 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:10.851 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:26:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:26:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:10.854 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:10.854 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.854 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:26:10.854 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:26:10.854 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:10.855 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:10.855 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:10.855 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:10.855 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:10.855 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:10.856 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:10.856 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:10.856 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:10.856 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.857 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:26:10.857 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:26:10.857 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:26:10.857 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:26:10.857 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:26:10.858 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:26:10.858 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:10.858 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:10.858 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:26:10.859 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:26:10.859 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:26:10.859 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:26:10.859 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:26:10.859 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:10.860 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:26:10.860 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:10.860 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:10.860 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:10.860 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:10.861 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:10.861 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:10.861 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:10.861 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:10.862 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:10.862 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.862 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:26:10.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.863 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:26:10.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.863 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:10.863 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:10.864 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:10.864 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:10.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.864 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:10.865 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:26:10.867 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:10.867 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.867 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.868 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:26:10.868 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:26:10.869 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:10.869 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:10.870 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:10.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.870 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:10.870 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:10.871 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:10.872 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:10.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.873 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:10.873 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:26:10.873 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:10.874 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.874 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.874 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:26:10.875 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:26:10.875 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:10.875 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:10.875 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:10.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.876 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:10.876 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:10.876 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:10.876 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:10.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.877 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:10.877 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:26:10.877 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:10.878 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.878 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.878 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:26:10.879 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:26:10.879 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:10.879 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:10.879 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:10.880 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.880 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.880 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:26:10.880 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:26:10.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.881 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:10.881 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:10.881 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:10.881 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.882 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:10.882 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:26:10.882 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:10.882 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:10.883 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:10.883 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:10.883 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:10.883 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:10.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:10.884 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:26:10.884 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:26:10.885 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2021-02-24T15:26:10.886 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2021-02-24T15:26:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.002+0000 7f2cc7136700 1 Processor -- start 2021-02-24T15:26:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.002+0000 7f2cc7136700 1 -- start start 2021-02-24T15:26:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.003+0000 7f2cc7136700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc012b0d0 con 0x7f2cc00679c0 2021-02-24T15:26:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.003+0000 7f2cc7136700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc0098a60 con 0x7f2cc0067e70 2021-02-24T15:26:11.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.003+0000 7f2cc7136700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc009a0b0 con 0x7f2cc00613c0 2021-02-24T15:26:11.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.003+0000 7f2cc4ed2700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2cc00613c0 0x7f2cc012a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36944/0 (socket says 172.21.15.152:36944) 2021-02-24T15:26:11.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.003+0000 7f2cbffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2cc00679c0 0x7f2cc012fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48468/0 (socket says 172.21.15.152:48468) 2021-02-24T15:26:11.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.003+0000 7f2cc4ed2700 1 -- 172.21.15.152:0/2486501075 learned_addr learned my addr 172.21.15.152:0/2486501075 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:11.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.005+0000 7f2cbffff700 1 -- 172.21.15.152:0/2486501075 >> v1:172.21.15.152:6789/0 conn(0x7f2cc00679c0 legacy=0x7f2cc012fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:11.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.005+0000 7f2cc4ed2700 1 -- 172.21.15.152:0/2486501075 >> v1:172.21.15.152:6790/0 conn(0x7f2cc00613c0 legacy=0x7f2cc012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854921103 0 0) 0x7f2cc012b0d0 con 0x7f2cc00679c0 2021-02-24T15:26:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cc56d3700 1 -- 172.21.15.152:0/2486501075 >> v1:172.21.15.181:6789/0 conn(0x7f2cc0067e70 legacy=0x7f2cc0133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca4003230 con 0x7f2cc00679c0 2021-02-24T15:26:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345814018 0 0) 0x7f2cc009a0b0 con 0x7f2cc00613c0 2021-02-24T15:26:11.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc012b0d0 con 0x7f2cc00613c0 2021-02-24T15:26:11.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3176676633 0 0) 0x7f2ca4003230 con 0x7f2cc00679c0 2021-02-24T15:26:11.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 >> v1:172.21.15.152:6790/0 conn(0x7f2cc00613c0 legacy=0x7f2cc012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:11.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 >> v1:172.21.15.181:6789/0 conn(0x7f2cc0067e70 legacy=0x7f2cc0133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:11.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc009a350 con 0x7f2cc00679c0 2021-02-24T15:26:11.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2cac0019f0 con 0x7f2cc00679c0 2021-02-24T15:26:11.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2cac001ca0 con 0x7f2cc00679c0 2021-02-24T15:26:11.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cbf7fe700 1 -- 172.21.15.152:0/2486501075 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2cac004690 con 0x7f2cc00679c0 2021-02-24T15:26:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cc7136700 1 -- 172.21.15.152:0/2486501075 >> v1:172.21.15.152:6789/0 conn(0x7f2cc00679c0 legacy=0x7f2cc012fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cc7136700 1 -- 172.21.15.152:0/2486501075 shutdown_connections 2021-02-24T15:26:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cc7136700 1 -- 172.21.15.152:0/2486501075 >> 172.21.15.152:0/2486501075 conn(0x7f2cc009a940 msgr2=0x7f2cc009ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cc7136700 1 -- 172.21.15.152:0/2486501075 shutdown_connections 2021-02-24T15:26:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.006+0000 7f2cc7136700 1 -- 172.21.15.152:0/2486501075 wait complete. 2021-02-24T15:26:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.007+0000 7f2cc7136700 1 librados: starting msgr at 2021-02-24T15:26:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.007+0000 7f2cc7136700 1 librados: starting objecter 2021-02-24T15:26:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.007+0000 7f2cc7136700 1 Processor -- start 2021-02-24T15:26:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.007+0000 7f2cc7136700 1 -- start start 2021-02-24T15:26:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.007+0000 7f2cc7136700 1 librados: setting wanted keys 2021-02-24T15:26:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.007+0000 7f2cc7136700 1 librados: calling monclient init 2021-02-24T15:26:11.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.008+0000 7f2cc7136700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc013adc0 con 0x7f2cc00679c0 2021-02-24T15:26:11.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.008+0000 7f2cc7136700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc01345f0 con 0x7f2cc0067e70 2021-02-24T15:26:11.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.008+0000 7f2cc7136700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc012f4c0 con 0x7f2cc00613c0 2021-02-24T15:26:11.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.008+0000 7f2cc4ed2700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2cc00613c0 0x7f2cc0133ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36950/0 (socket says 172.21.15.152:36950) 2021-02-24T15:26:11.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.008+0000 7f2cbffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2cc00679c0 0x7f2cc0139ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48476/0 (socket says 172.21.15.152:48476) 2021-02-24T15:26:11.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.008+0000 7f2cc4ed2700 1 -- 172.21.15.152:0/3392147235 learned_addr learned my addr 172.21.15.152:0/3392147235 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:11.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbffff700 1 -- 172.21.15.152:0/3392147235 >> v1:172.21.15.152:6789/0 conn(0x7f2cc00679c0 legacy=0x7f2cc0139ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:11.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 10 client.?.objecter ms_handle_connect 0x7f2cc00679c0 2021-02-24T15:26:11.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cc4ed2700 1 -- 172.21.15.152:0/3392147235 >> v1:172.21.15.152:6790/0 conn(0x7f2cc00613c0 legacy=0x7f2cc0133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:11.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:11.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 10 client.?.objecter ms_handle_connect 0x7f2cc00613c0 2021-02-24T15:26:11.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:11.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 10 client.?.objecter ms_handle_connect 0x7f2cc0067e70 2021-02-24T15:26:11.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:11.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cc56d3700 1 -- 172.21.15.152:0/3392147235 >> v1:172.21.15.181:6789/0 conn(0x7f2cc0067e70 legacy=0x7f2cc0142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:11.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689965854 0 0) 0x7f2cc013adc0 con 0x7f2cc00679c0 2021-02-24T15:26:11.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca0004bd0 con 0x7f2cc00679c0 2021-02-24T15:26:11.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317024625 0 0) 0x7f2cc012f4c0 con 0x7f2cc00613c0 2021-02-24T15:26:11.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.010+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc013adc0 con 0x7f2cc00613c0 2021-02-24T15:26:11.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091423756 0 0) 0x7f2cc01345f0 con 0x7f2cc0067e70 2021-02-24T15:26:11.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc012f4c0 con 0x7f2cc0067e70 2021-02-24T15:26:11.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 439584197 0 0) 0x7f2ca0004bd0 con 0x7f2cc00679c0 2021-02-24T15:26:11.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2cc01345f0 con 0x7f2cc00679c0 2021-02-24T15:26:11.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2cac004690 con 0x7f2cc00679c0 2021-02-24T15:26:11.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3187361732 0 0) 0x7f2cc013adc0 con 0x7f2cc00613c0 2021-02-24T15:26:11.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2ca0004bd0 con 0x7f2cc00613c0 2021-02-24T15:26:11.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2cb4001c50 con 0x7f2cc00613c0 2021-02-24T15:26:11.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3257534382 0 0) 0x7f2cc01345f0 con 0x7f2cc00679c0 2021-02-24T15:26:11.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 >> v1:172.21.15.152:6790/0 conn(0x7f2cc00613c0 legacy=0x7f2cc0133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:11.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 >> v1:172.21.15.181:6789/0 conn(0x7f2cc0067e70 legacy=0x7f2cc0142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:11.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc012f760 con 0x7f2cc00679c0 2021-02-24T15:26:11.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc012fa00 con 0x7f2cc00679c0 2021-02-24T15:26:11.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cc7136700 10 client.28260.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:11.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc013a5e0 con 0x7f2cc00679c0 2021-02-24T15:26:11.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cc7136700 1 librados: init done 2021-02-24T15:26:11.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2cac001560 con 0x7f2cc00679c0 2021-02-24T15:26:11.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.011+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2cac004f60 con 0x7f2cc00679c0 2021-02-24T15:26:11.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.012+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f2cac0050c0 con 0x7f2cc00679c0 2021-02-24T15:26:11.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.012+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c98004d60 con 0x7f2cc00679c0 2021-02-24T15:26:11.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.012+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(372..372 src has 66..372) v4 ==== 5290+0+0 (unknown 2340595407 0 0) 0x7f2cac03b2d0 con 0x7f2cc00679c0 2021-02-24T15:26:11.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.012+0000 7f2cbcff9700 10 client.28260.objecter ms_dispatch 0x7f2cc0001510 osd_map(372..372 src has 66..372) v4 2021-02-24T15:26:11.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.012+0000 7f2cbcff9700 3 client.28260.objecter handle_osd_map got epochs [372,372] > 0 2021-02-24T15:26:11.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.012+0000 7f2cbcff9700 3 client.28260.objecter handle_osd_map decoding full epoch 372 2021-02-24T15:26:11.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.012+0000 7f2cbcff9700 20 client.28260.objecter dump_active .. 0 homeless 2021-02-24T15:26:11.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.014+0000 7f2cbcff9700 10 client.28260.objecter ms_handle_connect 0x7f2ca0031370 2021-02-24T15:26:11.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.016+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f2cac012ac0 con 0x7f2cc00679c0 2021-02-24T15:26:11.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.247+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f2c98005820 con 0x7f2cc00679c0 2021-02-24T15:26:11.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.248+0000 7f2cbcff9700 1 -- 172.21.15.152:0/3392147235 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (unknown 246732539 0 0) 0x7f2cac0126b0 con 0x7f2cc00679c0 2021-02-24T15:26:11.257 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 10 librados: watch_flush enter 2021-02-24T15:26:11.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 10 librados: watch_flush exit 2021-02-24T15:26:11.258 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 20 client.28260.objecter shutdown clearing up homeless session... 2021-02-24T15:26:11.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 10 client.28260.objecter successfully canceled tick 2021-02-24T15:26:11.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 >> v1:172.21.15.181:6812/33484 conn(0x7f2ca0031370 legacy=0x7f2ca0033830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:11.259 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 >> v1:172.21.15.152:6789/0 conn(0x7f2cc00679c0 legacy=0x7f2cc0139ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:11.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 shutdown_connections 2021-02-24T15:26:11.260 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 >> 172.21.15.152:0/3392147235 conn(0x7f2cc009a940 msgr2=0x7f2cc0097310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:11.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 shutdown_connections 2021-02-24T15:26:11.261 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 1 -- 172.21.15.152:0/3392147235 wait complete. 2021-02-24T15:26:11.262 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f2cc7136700 1 librados: shutdown 2021-02-24T15:26:11.262 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.249+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.263 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.249+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=6,logm=64} crc {auth=2955979260,config=3140514009,health=3213680649,kv=2558848642,logm=16820138}) 2021-02-24T15:26:11.263 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.249+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=11,kv=5,logm=65} crc {auth=2617984325,config=3140514009,health=3131903550,kv=62027798,logm=3375058917}) 2021-02-24T15:26:11.263 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.249+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.264 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.249+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=6,logm=64} crc {auth=2955979260,config=3140514009,health=3213680649,kv=2558848642,logm=16820138}) 2021-02-24T15:26:11.264 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.249+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=18,config=2,health=11,kv=6,logm=63} crc {auth=2315035918,config=3140514009,health=1230495749,kv=2558848642,logm=649450204}) 2021-02-24T15:26:11.265 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.265 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316222378}) 2021-02-24T15:26:11.265 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=558943797}) 2021-02-24T15:26:11.266 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.267 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316222378}) 2021-02-24T15:26:11.267 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.250+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1435463051}) 2021-02-24T15:26:11.268 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.251+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.268 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.251+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3561616236}) 2021-02-24T15:26:11.269 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.251+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3231432635}) 2021-02-24T15:26:11.269 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.251+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.269 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.251+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3561616236}) 2021-02-24T15:26:11.270 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.251+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3388783304}) 2021-02-24T15:26:11.270 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.252+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.271 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.252+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175272082}) 2021-02-24T15:26:11.271 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.252+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3336048097}) 2021-02-24T15:26:11.272 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.252+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.272 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.252+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175272082}) 2021-02-24T15:26:11.272 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.252+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4268944615}) 2021-02-24T15:26:11.273 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.254+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.273 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.254+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1233550163}) 2021-02-24T15:26:11.274 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.254+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=240909374}) 2021-02-24T15:26:11.274 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.254+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.274 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.254+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1233550163}) 2021-02-24T15:26:11.275 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.254+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2808156034}) 2021-02-24T15:26:11.285 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.257+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.286 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.257+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3272687346}) 2021-02-24T15:26:11.286 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.257+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=598619363}) 2021-02-24T15:26:11.288 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.257+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.288 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.258+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3272687346}) 2021-02-24T15:26:11.288 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.258+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2360654126}) 2021-02-24T15:26:11.288 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.261+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.289 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.261+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3776481103}) 2021-02-24T15:26:11.289 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.261+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3308332151}) 2021-02-24T15:26:11.289 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.261+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.289 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.261+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3776481103}) 2021-02-24T15:26:11.290 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.261+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1032932992}) 2021-02-24T15:26:11.290 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.264+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.290 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.264+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=180476010}) 2021-02-24T15:26:11.290 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.264+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2979555093}) 2021-02-24T15:26:11.291 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.264+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.291 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.264+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=180476010}) 2021-02-24T15:26:11.291 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.264+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1631320053}) 2021-02-24T15:26:11.291 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.265+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.292 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.265+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=23,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=4,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=36,osdmap=8} crc {logm=4171871028,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=267275085,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4083687920,osd_pg_creating=2952485202,osd_snap=1833980397,osdmap=1161506054}) 2021-02-24T15:26:11.292 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.265+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=20,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=36,osdmap=9} crc {logm=807611920,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=4154018443,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=2952485202,osd_snap=1957715160,osdmap=1833362362}) 2021-02-24T15:26:11.292 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.265+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.292 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.265+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=23,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=4,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=36,osdmap=8} crc {logm=4171871028,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=267275085,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4083687920,osd_pg_creating=2952485202,osd_snap=1833980397,osdmap=1161506054}) 2021-02-24T15:26:11.293 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.265+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=22,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=3,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=36,osdmap=10} crc {logm=580906405,mdsmap=1531151339,mgr=2254402315,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=4270304603,mon_config_key=2672520484,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=2952485202,osd_snap=2931515395,osdmap=1939376839}) 2021-02-24T15:26:11.293 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.266+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.293 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.266+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1028386500}) 2021-02-24T15:26:11.293 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.266+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3932865672}) 2021-02-24T15:26:11.294 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.266+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.295 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.266+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1028386500}) 2021-02-24T15:26:11.295 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.266+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3069234074}) 2021-02-24T15:26:11.296 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.267+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.296 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.267+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3033171915}) 2021-02-24T15:26:11.296 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.267+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3117977888}) 2021-02-24T15:26:11.296 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.267+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.296 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.267+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3033171915}) 2021-02-24T15:26:11.297 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.267+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3277085061}) 2021-02-24T15:26:11.297 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.268+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.297 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.268+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1363069916}) 2021-02-24T15:26:11.298 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.268+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4267487338}) 2021-02-24T15:26:11.298 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.268+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.298 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.268+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1363069916}) 2021-02-24T15:26:11.298 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.268+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1847800192}) 2021-02-24T15:26:11.299 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.269+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.299 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.269+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2293155032}) 2021-02-24T15:26:11.299 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.269+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1005172526}) 2021-02-24T15:26:11.299 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.269+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.299 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.269+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2293155032}) 2021-02-24T15:26:11.300 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.269+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=7151750}) 2021-02-24T15:26:11.300 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.270+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.300 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.270+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=49} crc {osdmap=3867700819}) 2021-02-24T15:26:11.300 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.270+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=47} crc {osdmap=3348041822}) 2021-02-24T15:26:11.300 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.270+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:26:11.301 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.270+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=49} crc {osdmap=3867700819}) 2021-02-24T15:26:11.301 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:26:11.270+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=47} crc {osdmap=961453497}) 2021-02-24T15:26:11.301 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2021-02-24T15:26:11.881 INFO:tasks.ceph.osd.4.smithi181.stderr:2021-02-24T15:26:11.880+0000 7f1c2bb32700 -1 snap_mapper.add_oid found existing snaps mapped on 208:daf939fb:test-rados-api-smithi181-36860-76::foo:2, removing 2021-02-24T15:26:11.881 INFO:tasks.ceph.osd.5.smithi181.stderr:2021-02-24T15:26:11.881+0000 7f1950fb2700 -1 snap_mapper.add_oid found existing snaps mapped on 208:daf939fb:test-rados-api-smithi181-36860-76::foo:2, removing 2021-02-24T15:26:12.302 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:26:12.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:26:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.424+0000 7f08315fb700 1 Processor -- start 2021-02-24T15:26:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.424+0000 7f08315fb700 1 -- start start 2021-02-24T15:26:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.424+0000 7f08315fb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c127b60 con 0x7f082c067e40 2021-02-24T15:26:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.425+0000 7f08315fb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c099e30 con 0x7f082c0679c0 2021-02-24T15:26:12.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.425+0000 7f08315fb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c09a0d0 con 0x7f082c0613c0 2021-02-24T15:26:12.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.425+0000 7f082affd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f082c0613c0 0x7f082c127450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36960/0 (socket says 172.21.15.152:36960) 2021-02-24T15:26:12.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.425+0000 7f082b7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f082c067e40 0x7f082c133450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48484/0 (socket says 172.21.15.152:48484) 2021-02-24T15:26:12.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.425+0000 7f082affd700 1 -- 172.21.15.152:0/681343539 learned_addr learned my addr 172.21.15.152:0/681343539 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:12.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f082affd700 1 -- 172.21.15.152:0/681343539 >> v1:172.21.15.152:6790/0 conn(0x7f082c0613c0 legacy=0x7f082c127450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f082b7fe700 1 -- 172.21.15.152:0/681343539 >> v1:172.21.15.152:6789/0 conn(0x7f082c067e40 legacy=0x7f082c133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129612598 0 0) 0x7f082c127b60 con 0x7f082c067e40 2021-02-24T15:26:12.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0818003230 con 0x7f082c067e40 2021-02-24T15:26:12.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050691362 0 0) 0x7f082c09a0d0 con 0x7f082c0613c0 2021-02-24T15:26:12.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f082c127b60 con 0x7f082c0613c0 2021-02-24T15:26:12.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f082a7fc700 1 -- 172.21.15.152:0/681343539 >> v1:172.21.15.181:6789/0 conn(0x7f082c0679c0 legacy=0x7f082c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2659019015 0 0) 0x7f082c127b60 con 0x7f082c0613c0 2021-02-24T15:26:12.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 >> v1:172.21.15.181:6789/0 conn(0x7f082c0679c0 legacy=0x7f082c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.430 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 >> v1:172.21.15.152:6789/0 conn(0x7f082c067e40 legacy=0x7f082c133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c09a370 con 0x7f082c0613c0 2021-02-24T15:26:12.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f081c001930 con 0x7f082c0613c0 2021-02-24T15:26:12.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f082affd700 1 --1- 172.21.15.152:0/681343539 >> v1:172.21.15.152:6790/0 conn(0x7f082c0613c0 0x7f082c127450 :-1 s=OPENED pgs=8411 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f081c004750 mon_map magic: 0 v1 2021-02-24T15:26:12.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.427+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f081c001c40 con 0x7f082c0613c0 2021-02-24T15:26:12.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.428+0000 7f08315fb700 1 -- 172.21.15.152:0/681343539 >> v1:172.21.15.152:6790/0 conn(0x7f082c0613c0 legacy=0x7f082c127450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.428+0000 7f0829ffb700 1 -- 172.21.15.152:0/681343539 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f081c004750 con 0x7f082c0613c0 2021-02-24T15:26:12.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.428+0000 7f08315fb700 1 -- 172.21.15.152:0/681343539 shutdown_connections 2021-02-24T15:26:12.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.428+0000 7f08315fb700 1 -- 172.21.15.152:0/681343539 >> 172.21.15.152:0/681343539 conn(0x7f082c09a940 msgr2=0x7f082c09ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:12.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.428+0000 7f08315fb700 1 -- 172.21.15.152:0/681343539 shutdown_connections 2021-02-24T15:26:12.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.428+0000 7f08315fb700 1 -- 172.21.15.152:0/681343539 wait complete. 2021-02-24T15:26:12.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f08315fb700 1 librados: starting msgr at 2021-02-24T15:26:12.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f08315fb700 1 librados: starting objecter 2021-02-24T15:26:12.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f08315fb700 1 Processor -- start 2021-02-24T15:26:12.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f08315fb700 1 -- start start 2021-02-24T15:26:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f08315fb700 1 librados: setting wanted keys 2021-02-24T15:26:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f08315fb700 1 librados: calling monclient init 2021-02-24T15:26:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f08315fb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c120890 con 0x7f082c067e40 2021-02-24T15:26:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f08315fb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c121f90 con 0x7f082c0679c0 2021-02-24T15:26:12.437 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f08315fb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c1214c0 con 0x7f082c0613c0 2021-02-24T15:26:12.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f082affd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f082c0613c0 0x7f082c124360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36966/0 (socket says 172.21.15.152:36966) 2021-02-24T15:26:12.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.429+0000 7f082affd700 1 -- 172.21.15.152:0/3770006264 learned_addr learned my addr 172.21.15.152:0/3770006264 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:12.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f082b7fe700 1 -- 172.21.15.152:0/3770006264 >> v1:172.21.15.152:6789/0 conn(0x7f082c067e40 legacy=0x7f082c142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f082affd700 1 -- 172.21.15.152:0/3770006264 >> v1:172.21.15.152:6790/0 conn(0x7f082c0613c0 legacy=0x7f082c124360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.438 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 10 client.?.objecter ms_handle_connect 0x7f082c067e40 2021-02-24T15:26:12.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:12.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 10 client.?.objecter ms_handle_connect 0x7f082c0613c0 2021-02-24T15:26:12.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:12.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f082affd700 1 --1- 172.21.15.152:0/3770006264 >> v1:172.21.15.152:6790/0 conn(0x7f082c0613c0 0x7f082c124360 :-1 s=OPENED pgs=8412 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f082c1214c0 auth_reply(proto 2 0 (0) Success) v1 2021-02-24T15:26:12.439 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556750647 0 0) 0x7f082c120890 con 0x7f082c067e40 2021-02-24T15:26:12.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f080c004bd0 con 0x7f082c067e40 2021-02-24T15:26:12.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f082a7fc700 1 -- 172.21.15.152:0/3770006264 >> v1:172.21.15.181:6789/0 conn(0x7f082c0679c0 legacy=0x7f082c13f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 10 client.?.objecter ms_handle_connect 0x7f082c0679c0 2021-02-24T15:26:12.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:12.440 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2850527078 0 0) 0x7f080c004bd0 con 0x7f082c067e40 2021-02-24T15:26:12.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f082c120890 con 0x7f082c067e40 2021-02-24T15:26:12.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0824001f10 con 0x7f082c067e40 2021-02-24T15:26:12.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16699661 0 0) 0x7f082c121f90 con 0x7f082c0679c0 2021-02-24T15:26:12.441 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f080c004bd0 con 0x7f082c0679c0 2021-02-24T15:26:12.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2149686049 0 0) 0x7f082c120890 con 0x7f082c067e40 2021-02-24T15:26:12.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 >> v1:172.21.15.152:6790/0 conn(0x7f082c0613c0 legacy=0x7f082c124360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 >> v1:172.21.15.181:6789/0 conn(0x7f082c0679c0 legacy=0x7f082c13f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.442 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c11fed0 con 0x7f082c067e40 2021-02-24T15:26:12.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373394865 0 0) 0x7f082c1214c0 con 0x7f082c0613c0 2021-02-24T15:26:12.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c124a70 con 0x7f082c067e40 2021-02-24T15:26:12.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f08315fb700 10 client.28266.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:12.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c11f690 con 0x7f082c067e40 2021-02-24T15:26:12.443 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f08315fb700 1 librados: init done 2021-02-24T15:26:12.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0824004c90 con 0x7f082c067e40 2021-02-24T15:26:12.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.432+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0824004fa0 con 0x7f082c067e40 2021-02-24T15:26:12.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.433+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f0824005100 con 0x7f082c067e40 2021-02-24T15:26:12.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.433+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(374..374 src has 66..374) v4 ==== 4876+0+0 (unknown 272012038 0 0) 0x7f082403b250 con 0x7f082c067e40 2021-02-24T15:26:12.444 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.433+0000 7f0812ffd700 10 client.28266.objecter ms_dispatch 0x7f082c001510 osd_map(374..374 src has 66..374) v4 2021-02-24T15:26:12.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.433+0000 7f0812ffd700 3 client.28266.objecter handle_osd_map got epochs [374,374] > 0 2021-02-24T15:26:12.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.433+0000 7f0812ffd700 3 client.28266.objecter handle_osd_map decoding full epoch 374 2021-02-24T15:26:12.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.433+0000 7f0812ffd700 20 client.28266.objecter dump_active .. 0 homeless 2021-02-24T15:26:12.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.433+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0804004d60 con 0x7f082c067e40 2021-02-24T15:26:12.445 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.436+0000 7f0812ffd700 10 client.28266.objecter ms_handle_connect 0x7f080c0312e0 2021-02-24T15:26:12.446 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.438+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f0824012ab0 con 0x7f082c067e40 2021-02-24T15:26:12.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.673+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0804005590 con 0x7f082c067e40 2021-02-24T15:26:12.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.674+0000 7f0812ffd700 1 -- 172.21.15.152:0/3770006264 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 603190456) 0x7f08240126a0 con 0x7f082c067e40 2021-02-24T15:26:12.674 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:26:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 10 librados: watch_flush enter 2021-02-24T15:26:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 10 librados: watch_flush exit 2021-02-24T15:26:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 20 client.28266.objecter shutdown clearing up homeless session... 2021-02-24T15:26:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 10 client.28266.objecter successfully canceled tick 2021-02-24T15:26:12.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 >> v1:172.21.15.181:6812/33484 conn(0x7f080c0312e0 legacy=0x7f080c0337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 >> v1:172.21.15.152:6789/0 conn(0x7f082c067e40 legacy=0x7f082c142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 shutdown_connections 2021-02-24T15:26:12.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 >> 172.21.15.152:0/3770006264 conn(0x7f082c09a940 msgr2=0x7f082c097310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:12.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 shutdown_connections 2021-02-24T15:26:12.678 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 1 -- 172.21.15.152:0/3770006264 wait complete. 2021-02-24T15:26:12.678 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.675+0000 7f08315fb700 1 librados: shutdown 2021-02-24T15:26:12.687 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:26:12.687 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-02-24T15:26:12.687 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:26:12.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.804+0000 7f43861a1700 1 Processor -- start 2021-02-24T15:26:12.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.804+0000 7f43861a1700 1 -- start start 2021-02-24T15:26:12.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.805+0000 7f43861a1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4380064120 con 0x7f4380062a90 2021-02-24T15:26:12.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.805+0000 7f43861a1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4380063300 con 0x7f4380062e70 2021-02-24T15:26:12.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.805+0000 7f43861a1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4380098610 con 0x7f4380131040 2021-02-24T15:26:12.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.805+0000 7f43859a0700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f4380131040 0x7f4380133430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36974/0 (socket says 172.21.15.152:36974) 2021-02-24T15:26:12.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.805+0000 7f438519f700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4380062a90 0x7f4380097320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48498/0 (socket says 172.21.15.152:48498) 2021-02-24T15:26:12.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.805+0000 7f43859a0700 1 -- 172.21.15.152:0/2151925204 learned_addr learned my addr 172.21.15.152:0/2151925204 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:12.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.807+0000 7f43859a0700 1 -- 172.21.15.152:0/2151925204 >> v1:172.21.15.152:6790/0 conn(0x7f4380131040 legacy=0x7f4380133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.807+0000 7f438519f700 1 -- 172.21.15.152:0/2151925204 >> v1:172.21.15.152:6789/0 conn(0x7f4380062a90 legacy=0x7f4380097320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.807+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161609699 0 0) 0x7f4380098610 con 0x7f4380131040 2021-02-24T15:26:12.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.807+0000 7f438499e700 1 -- 172.21.15.152:0/2151925204 >> v1:172.21.15.181:6789/0 conn(0x7f4380062e70 legacy=0x7f4380097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.807+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4368003230 con 0x7f4380131040 2021-02-24T15:26:12.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.807+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9785536 0 0) 0x7f4380064120 con 0x7f4380062a90 2021-02-24T15:26:12.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4380098610 con 0x7f4380062a90 2021-02-24T15:26:12.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2813887347 0 0) 0x7f4368003230 con 0x7f4380131040 2021-02-24T15:26:12.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 >> v1:172.21.15.181:6789/0 conn(0x7f4380062e70 legacy=0x7f4380097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 >> v1:172.21.15.152:6789/0 conn(0x7f4380062a90 legacy=0x7f4380097320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380098140 con 0x7f4380131040 2021-02-24T15:26:12.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4378001cb0 con 0x7f4380131040 2021-02-24T15:26:12.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4378001fc0 con 0x7f4380131040 2021-02-24T15:26:12.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f436ffff700 1 -- 172.21.15.152:0/2151925204 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4378004ad0 con 0x7f4380131040 2021-02-24T15:26:12.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f43861a1700 1 -- 172.21.15.152:0/2151925204 >> v1:172.21.15.152:6790/0 conn(0x7f4380131040 legacy=0x7f4380133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f43861a1700 1 -- 172.21.15.152:0/2151925204 shutdown_connections 2021-02-24T15:26:12.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f43861a1700 1 -- 172.21.15.152:0/2151925204 >> 172.21.15.152:0/2151925204 conn(0x7f438009b810 msgr2=0x7f438009bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:12.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f43861a1700 1 -- 172.21.15.152:0/2151925204 shutdown_connections 2021-02-24T15:26:12.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.808+0000 7f43861a1700 1 -- 172.21.15.152:0/2151925204 wait complete. 2021-02-24T15:26:12.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.809+0000 7f43861a1700 1 librados: starting msgr at 2021-02-24T15:26:12.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.809+0000 7f43861a1700 1 librados: starting objecter 2021-02-24T15:26:12.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.809+0000 7f43861a1700 1 Processor -- start 2021-02-24T15:26:12.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.809+0000 7f43861a1700 1 -- start start 2021-02-24T15:26:12.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.809+0000 7f43861a1700 1 librados: setting wanted keys 2021-02-24T15:26:12.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.809+0000 7f43861a1700 1 librados: calling monclient init 2021-02-24T15:26:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.810+0000 7f43861a1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4380129c00 con 0x7f4380131040 2021-02-24T15:26:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.810+0000 7f43861a1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4380113c60 con 0x7f4380062e70 2021-02-24T15:26:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.810+0000 7f43861a1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4380113f00 con 0x7f4380062a90 2021-02-24T15:26:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.810+0000 7f438519f700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f4380062a90 0x7f43801294f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36980/0 (socket says 172.21.15.152:36980) 2021-02-24T15:26:12.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.810+0000 7f438519f700 1 -- 172.21.15.152:0/1758349630 learned_addr learned my addr 172.21.15.152:0/1758349630 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:12.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f43859a0700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6789/0 conn(0x7f4380131040 legacy=0x7f4380142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f438519f700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6790/0 conn(0x7f4380062a90 legacy=0x7f43801294f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 10 client.?.objecter ms_handle_connect 0x7f4380131040 2021-02-24T15:26:12.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:12.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 10 client.?.objecter ms_handle_connect 0x7f4380062a90 2021-02-24T15:26:12.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:12.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754730909 0 0) 0x7f4380129c00 con 0x7f4380131040 2021-02-24T15:26:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4360004bd0 con 0x7f4380131040 2021-02-24T15:26:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913939086 0 0) 0x7f4380113f00 con 0x7f4380062a90 2021-02-24T15:26:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4380129c00 con 0x7f4380062a90 2021-02-24T15:26:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 10 client.?.objecter ms_handle_connect 0x7f4380062e70 2021-02-24T15:26:12.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f436d7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:12.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.812+0000 7f438499e700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.181:6789/0 conn(0x7f4380062e70 legacy=0x7f438013ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2047321179 0 0) 0x7f4380129c00 con 0x7f4380062a90 2021-02-24T15:26:12.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4380113f00 con 0x7f4380062a90 2021-02-24T15:26:12.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3509669359 0 0) 0x7f4360004bd0 con 0x7f4380131040 2021-02-24T15:26:12.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4380129c00 con 0x7f4380131040 2021-02-24T15:26:12.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f437c001cd0 con 0x7f4380062a90 2021-02-24T15:26:12.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4378001c70 con 0x7f4380131040 2021-02-24T15:26:12.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050508387 0 0) 0x7f4380113c60 con 0x7f4380062e70 2021-02-24T15:26:12.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4360004bd0 con 0x7f4380062e70 2021-02-24T15:26:12.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1143260888 0 0) 0x7f4380113f00 con 0x7f4380062a90 2021-02-24T15:26:12.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.181:6789/0 conn(0x7f4380062e70 legacy=0x7f438013ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6789/0 conn(0x7f4380131040 legacy=0x7f4380142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800955f0 con 0x7f4380062a90 2021-02-24T15:26:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43801366a0 con 0x7f4380062a90 2021-02-24T15:26:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f43861a1700 10 client.84215.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f43801128e0 con 0x7f4380062a90 2021-02-24T15:26:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f43861a1700 1 librados: init done 2021-02-24T15:26:12.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f437c004820 con 0x7f4380062a90 2021-02-24T15:26:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.813+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f437c004b30 con 0x7f4380062a90 2021-02-24T15:26:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.814+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4358006550 con 0x7f43580027f0 2021-02-24T15:26:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.814+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f437c004d50 con 0x7f4380062a90 2021-02-24T15:26:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.814+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(374..374 src has 66..374) v4 ==== 4876+0+0 (unknown 272012038 0 0) 0x7f437c03aec0 con 0x7f4380062a90 2021-02-24T15:26:12.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.814+0000 7f436d7fa700 10 client.84215.objecter ms_dispatch 0x7f4380001510 osd_map(374..374 src has 66..374) v4 2021-02-24T15:26:12.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.814+0000 7f436d7fa700 3 client.84215.objecter handle_osd_map got epochs [374,374] > 0 2021-02-24T15:26:12.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.814+0000 7f436d7fa700 3 client.84215.objecter handle_osd_map decoding full epoch 374 2021-02-24T15:26:12.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.814+0000 7f436d7fa700 20 client.84215.objecter dump_active .. 0 homeless 2021-02-24T15:26:12.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.816+0000 7f438499e700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6789/0 conn(0x7f43580027f0 legacy=0x7f4358004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.816+0000 7f436d7fa700 10 client.84215.objecter ms_handle_connect 0x7f43580027f0 2021-02-24T15:26:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.816+0000 7f436d7fa700 10 client.84215.objecter resend_mon_ops 2021-02-24T15:26:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.816+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917984152 0 0) 0x7f4358006550 con 0x7f43580027f0 2021-02-24T15:26:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.816+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4380113f00 con 0x7f43580027f0 2021-02-24T15:26:12.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.816+0000 7f436d7fa700 10 client.84215.objecter ms_handle_connect 0x7f43600316b0 2021-02-24T15:26:12.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.816+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 890594149 0 0) 0x7f4380113f00 con 0x7f43580027f0 2021-02-24T15:26:12.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.816+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4358006550 con 0x7f43580027f0 2021-02-24T15:26:12.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.816+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4370001a70 con 0x7f43580027f0 2021-02-24T15:26:12.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.817+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1705311829 0 0) 0x7f4358006550 con 0x7f43580027f0 2021-02-24T15:26:12.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.817+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4358009df0 con 0x7f43580027f0 2021-02-24T15:26:12.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.817+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f43700054d0 con 0x7f43580027f0 2021-02-24T15:26:12.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.817+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6789/0 conn(0x7f43580027f0 legacy=0x7f4358004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.817+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6789/0 conn(0x7f43580027f0 legacy=0x7f4358004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:12.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.825+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4358007500 con 0x7f43580068a0 2021-02-24T15:26:12.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.827+0000 7f438499e700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6789/0 conn(0x7f43580068a0 legacy=0x7f4358006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.827+0000 7f436d7fa700 10 client.84215.objecter ms_handle_connect 0x7f43580068a0 2021-02-24T15:26:12.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.827+0000 7f436d7fa700 10 client.84215.objecter resend_mon_ops 2021-02-24T15:26:12.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.827+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861136064 0 0) 0x7f4358007500 con 0x7f43580068a0 2021-02-24T15:26:12.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.827+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4358006550 con 0x7f43580068a0 2021-02-24T15:26:12.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.827+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 471449836 0 0) 0x7f4358006550 con 0x7f43580068a0 2021-02-24T15:26:12.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.827+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4358007500 con 0x7f43580068a0 2021-02-24T15:26:12.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.827+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f43700023c0 con 0x7f43580068a0 2021-02-24T15:26:12.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3684262078 0 0) 0x7f4358007500 con 0x7f43580068a0 2021-02-24T15:26:12.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4358008720 con 0x7f43580068a0 2021-02-24T15:26:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4112 (unknown 0 0 1355500469) 0x7f4370002670 con 0x7f43580068a0 2021-02-24T15:26:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6789/0 conn(0x7f43580068a0 legacy=0x7f4358006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f436d7fa700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6789/0 conn(0x7f43580068a0 legacy=0x7f4358006d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 10 librados: watch_flush enter 2021-02-24T15:26:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 10 librados: watch_flush exit 2021-02-24T15:26:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 20 client.84215.objecter shutdown clearing up homeless session... 2021-02-24T15:26:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 10 client.84215.objecter successfully canceled tick 2021-02-24T15:26:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.181:6812/33484 conn(0x7f43600316b0 legacy=0x7f4360033b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 >> v1:172.21.15.152:6790/0 conn(0x7f4380062a90 legacy=0x7f43801294f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:12.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43859a0700 1 -- 172.21.15.152:0/1758349630 reap_dead start 2021-02-24T15:26:12.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43859a0700 1 -- 172.21.15.152:0/1758349630 reap_dead start 2021-02-24T15:26:12.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 shutdown_connections 2021-02-24T15:26:12.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 >> 172.21.15.152:0/1758349630 conn(0x7f438009b810 msgr2=0x7f4380130840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:12.840 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 shutdown_connections 2021-02-24T15:26:12.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 1 -- 172.21.15.152:0/1758349630 wait complete. 2021-02-24T15:26:12.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.828+0000 7f43861a1700 1 librados: shutdown 2021-02-24T15:26:12.841 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:26:12.841 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:12.842 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:12.842 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:26:12.842 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 46, 2021-02-24T15:26:12.842 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:26:12.842 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:26:12.843 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:26:12.843 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:26:12.843 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:12.843 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 2, 2021-02-24T15:26:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:26:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:26:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:12.844 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:12.845 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:12.846 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:12.846 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:12.846 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:12.846 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:26:12.846 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:26:12.847 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:12.847 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:12.847 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:12.847 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:12.848 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:26:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:26:12.849 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:26:12.850 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:26:12.850 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:26:12.850 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:26:12.850 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:26:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:26:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:26:12.851 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:26:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:26:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:26:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:12.852 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:12.853 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:12.854 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:12.854 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:12.854 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:12.854 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:26:12.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:12.855 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:26:12.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.855 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:12.855 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:12.856 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:26:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:12.857 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:26:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:26:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:12.859 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:26:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:26:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:26:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:12.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.863 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:12.863 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:12.863 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:12.863 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:12.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.864 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:12.864 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:26:12.864 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:12.864 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:12.865 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:12.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:12.865 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:26:12.865 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:26:12.865 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:12.866 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:12.866 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:12.866 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:12.866 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:12.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:12.867 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:26:12.867 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:26:12.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.868 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:12.868 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:12.868 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:12.868 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:12.868 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:12.869 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:26:12.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.869 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:12.869 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:12.869 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:26:12.870 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:12.870 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:12.870 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:26:12.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.871 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:12.871 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:12.872 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:26:12.873 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:12.873 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:12.873 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:26:12.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:12.874 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:12.874 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:12.874 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:12.874 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:12.875 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:12.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:12.875 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:26:12.875 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:26:12.877 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:26:12.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.995+0000 7efe25a64700 1 Processor -- start 2021-02-24T15:26:12.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.995+0000 7efe25a64700 1 -- start start 2021-02-24T15:26:12.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.995+0000 7efe25a64700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe20129990 con 0x7efe20097b10 2021-02-24T15:26:12.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.995+0000 7efe25a64700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2012a2c0 con 0x7efe200974f0 2021-02-24T15:26:12.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.995+0000 7efe25a64700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2009a300 con 0x7efe20097040 2021-02-24T15:26:12.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.995+0000 7efe24a62700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efe20097b10 0x7efe20129bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48516/0 (socket says 172.21.15.152:48516) 2021-02-24T15:26:12.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.995+0000 7efe1ffff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7efe20097040 0x7efe2012fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:36992/0 (socket says 172.21.15.152:36992) 2021-02-24T15:26:12.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.995+0000 7efe24a62700 1 -- 172.21.15.152:0/2440481034 learned_addr learned my addr 172.21.15.152:0/2440481034 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:12.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.997+0000 7efe1ffff700 1 -- 172.21.15.152:0/2440481034 >> v1:172.21.15.152:6790/0 conn(0x7efe20097040 legacy=0x7efe2012fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.997+0000 7efe24a62700 1 -- 172.21.15.152:0/2440481034 >> v1:172.21.15.152:6789/0 conn(0x7efe20097b10 legacy=0x7efe20129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:12.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438765938 0 0) 0x7efe2009a300 con 0x7efe20097040 2021-02-24T15:26:13.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe04003230 con 0x7efe20097040 2021-02-24T15:26:13.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416977645 0 0) 0x7efe20129990 con 0x7efe20097b10 2021-02-24T15:26:13.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe2009a300 con 0x7efe20097b10 2021-02-24T15:26:13.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe25263700 1 -- 172.21.15.152:0/2440481034 >> v1:172.21.15.181:6789/0 conn(0x7efe200974f0 legacy=0x7efe20133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4164191349 0 0) 0x7efe2009a300 con 0x7efe20097b10 2021-02-24T15:26:13.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 >> v1:172.21.15.152:6790/0 conn(0x7efe20097040 legacy=0x7efe2012fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 >> v1:172.21.15.181:6789/0 conn(0x7efe200974f0 legacy=0x7efe20133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2008fb30 con 0x7efe20097b10 2021-02-24T15:26:13.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe14001920 con 0x7efe20097b10 2021-02-24T15:26:13.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efe14001b40 con 0x7efe20097b10 2021-02-24T15:26:13.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe1f7fe700 1 -- 172.21.15.152:0/2440481034 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe140045b0 con 0x7efe20097b10 2021-02-24T15:26:13.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe25a64700 1 -- 172.21.15.152:0/2440481034 >> v1:172.21.15.152:6789/0 conn(0x7efe20097b10 legacy=0x7efe20129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe25a64700 1 -- 172.21.15.152:0/2440481034 shutdown_connections 2021-02-24T15:26:13.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.998+0000 7efe25a64700 1 -- 172.21.15.152:0/2440481034 >> 172.21.15.152:0/2440481034 conn(0x7efe2009d9e0 msgr2=0x7efe2009ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:13.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.999+0000 7efe25a64700 1 -- 172.21.15.152:0/2440481034 shutdown_connections 2021-02-24T15:26:13.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.999+0000 7efe25a64700 1 -- 172.21.15.152:0/2440481034 wait complete. 2021-02-24T15:26:13.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.999+0000 7efe25a64700 1 librados: starting msgr at 2021-02-24T15:26:13.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.999+0000 7efe25a64700 1 librados: starting objecter 2021-02-24T15:26:13.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:12.999+0000 7efe25a64700 1 Processor -- start 2021-02-24T15:26:13.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.000+0000 7efe25a64700 1 -- start start 2021-02-24T15:26:13.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.000+0000 7efe25a64700 1 librados: setting wanted keys 2021-02-24T15:26:13.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.000+0000 7efe25a64700 1 librados: calling monclient init 2021-02-24T15:26:13.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.000+0000 7efe25a64700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe20115420 con 0x7efe20097040 2021-02-24T15:26:13.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.000+0000 7efe25a64700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe201156c0 con 0x7efe20097b10 2021-02-24T15:26:13.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.000+0000 7efe25a64700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe20115960 con 0x7efe200974f0 2021-02-24T15:26:13.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.000+0000 7efe24a62700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efe20097040 0x7efe20126f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48520/0 (socket says 172.21.15.152:48520) 2021-02-24T15:26:13.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.000+0000 7efe24a62700 1 -- 172.21.15.152:0/967193608 learned_addr learned my addr 172.21.15.152:0/967193608 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:13.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe24a62700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6789/0 conn(0x7efe20097040 legacy=0x7efe20126f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe1cff9700 10 client.?.objecter ms_handle_connect 0x7efe20097040 2021-02-24T15:26:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe1cff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe1cff9700 10 client.?.objecter ms_handle_connect 0x7efe200974f0 2021-02-24T15:26:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe1cff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe1ffff700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6790/0 conn(0x7efe200974f0 legacy=0x7efe2013ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462790895 0 0) 0x7efe20115420 con 0x7efe20097040 2021-02-24T15:26:13.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe00004bd0 con 0x7efe20097040 2021-02-24T15:26:13.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546350176 0 0) 0x7efe20115960 con 0x7efe200974f0 2021-02-24T15:26:13.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.002+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe20115420 con 0x7efe200974f0 2021-02-24T15:26:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 10 client.?.objecter ms_handle_connect 0x7efe20097b10 2021-02-24T15:26:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe25263700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.181:6789/0 conn(0x7efe20097b10 legacy=0x7efe20142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3961394173 0 0) 0x7efe00004bd0 con 0x7efe20097040 2021-02-24T15:26:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe20115960 con 0x7efe20097040 2021-02-24T15:26:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe140044f0 con 0x7efe20097040 2021-02-24T15:26:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3499862397 0 0) 0x7efe20115420 con 0x7efe200974f0 2021-02-24T15:26:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe00004bd0 con 0x7efe200974f0 2021-02-24T15:26:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe0c001c60 con 0x7efe200974f0 2021-02-24T15:26:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163680891 0 0) 0x7efe201156c0 con 0x7efe20097b10 2021-02-24T15:26:13.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe20115420 con 0x7efe20097b10 2021-02-24T15:26:13.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4280713503 0 0) 0x7efe20115960 con 0x7efe20097040 2021-02-24T15:26:13.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6790/0 conn(0x7efe200974f0 legacy=0x7efe2013ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.181:6789/0 conn(0x7efe20097b10 legacy=0x7efe20142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200967f0 con 0x7efe20097040 2021-02-24T15:26:13.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe20127620 con 0x7efe20097040 2021-02-24T15:26:13.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe25a64700 10 client.28284.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:13.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efe20095df0 con 0x7efe20097040 2021-02-24T15:26:13.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe25a64700 1 librados: init done 2021-02-24T15:26:13.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efe14004d40 con 0x7efe20097040 2021-02-24T15:26:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.003+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe14005050 con 0x7efe20097040 2021-02-24T15:26:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.004+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7efdf8006550 con 0x7efdf80027f0 2021-02-24T15:26:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.004+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7efe140051b0 con 0x7efe20097040 2021-02-24T15:26:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.004+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(374..374 src has 66..374) v4 ==== 4876+0+0 (unknown 272012038 0 0) 0x7efe1403afb0 con 0x7efe20097040 2021-02-24T15:26:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.004+0000 7efe1cff9700 10 client.28284.objecter ms_dispatch 0x7efe20001510 osd_map(374..374 src has 66..374) v4 2021-02-24T15:26:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.004+0000 7efe1cff9700 3 client.28284.objecter handle_osd_map got epochs [374,374] > 0 2021-02-24T15:26:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.004+0000 7efe1cff9700 3 client.28284.objecter handle_osd_map decoding full epoch 374 2021-02-24T15:26:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.004+0000 7efe1cff9700 20 client.28284.objecter dump_active .. 0 homeless 2021-02-24T15:26:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 10 client.28284.objecter ms_handle_connect 0x7efdf80027f0 2021-02-24T15:26:13.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 10 client.28284.objecter resend_mon_ops 2021-02-24T15:26:13.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1ffff700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6790/0 conn(0x7efdf80027f0 legacy=0x7efdf8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694329003 0 0) 0x7efdf8006550 con 0x7efdf80027f0 2021-02-24T15:26:13.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe20115960 con 0x7efdf80027f0 2021-02-24T15:26:13.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2811244396 0 0) 0x7efe20115960 con 0x7efdf80027f0 2021-02-24T15:26:13.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efdf8006550 con 0x7efdf80027f0 2021-02-24T15:26:13.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe0c004930 con 0x7efdf80027f0 2021-02-24T15:26:13.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2329503633 0 0) 0x7efdf8006550 con 0x7efdf80027f0 2021-02-24T15:26:13.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efdf8009df0 con 0x7efdf80027f0 2021-02-24T15:26:13.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.006+0000 7efe1cff9700 10 client.28284.objecter ms_handle_connect 0x7efe00031680 2021-02-24T15:26:13.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.007+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7efe0c004cc0 con 0x7efdf80027f0 2021-02-24T15:26:13.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.007+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6790/0 conn(0x7efdf80027f0 legacy=0x7efdf8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.007+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6790/0 conn(0x7efdf80027f0 legacy=0x7efdf8004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:13.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.014+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7efdf8007520 con 0x7efdf80068c0 2021-02-24T15:26:13.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1cff9700 10 client.28284.objecter ms_handle_connect 0x7efdf80068c0 2021-02-24T15:26:13.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1ffff700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6790/0 conn(0x7efdf80068c0 legacy=0x7efdf8006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1cff9700 10 client.28284.objecter resend_mon_ops 2021-02-24T15:26:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660840421 0 0) 0x7efdf8007520 con 0x7efdf80068c0 2021-02-24T15:26:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf8006550 con 0x7efdf80068c0 2021-02-24T15:26:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 325770670 0 0) 0x7efdf8006550 con 0x7efdf80068c0 2021-02-24T15:26:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efdf8007520 con 0x7efdf80068c0 2021-02-24T15:26:13.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7efe0c0053b0 con 0x7efdf80068c0 2021-02-24T15:26:13.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 4201238147 0 0) 0x7efdf8007520 con 0x7efdf80068c0 2021-02-24T15:26:13.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.017+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efdf8008720 con 0x7efdf80068c0 2021-02-24T15:26:13.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3940 (unknown 0 0 4294540286) 0x7efe0c006680 con 0x7efdf80068c0 2021-02-24T15:26:13.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6790/0 conn(0x7efdf80068c0 legacy=0x7efdf8006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe1cff9700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6790/0 conn(0x7efdf80068c0 legacy=0x7efdf8006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:13.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 10 librados: watch_flush enter 2021-02-24T15:26:13.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 10 librados: watch_flush exit 2021-02-24T15:26:13.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 20 client.28284.objecter shutdown clearing up homeless session... 2021-02-24T15:26:13.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 10 client.28284.objecter successfully canceled tick 2021-02-24T15:26:13.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.181:6812/33484 conn(0x7efe00031680 legacy=0x7efe00033b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 >> v1:172.21.15.152:6789/0 conn(0x7efe20097040 legacy=0x7efe20126f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25263700 1 -- 172.21.15.152:0/967193608 reap_dead start 2021-02-24T15:26:13.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25263700 1 -- 172.21.15.152:0/967193608 reap_dead start 2021-02-24T15:26:13.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 shutdown_connections 2021-02-24T15:26:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 >> 172.21.15.152:0/967193608 conn(0x7efe2009d9e0 msgr2=0x7efe2009c740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 shutdown_connections 2021-02-24T15:26:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 1 -- 172.21.15.152:0/967193608 wait complete. 2021-02-24T15:26:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.018+0000 7efe25a64700 1 librados: shutdown 2021-02-24T15:26:13.029 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:26:13.029 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:13.029 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:13.029 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:26:13.029 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 46, 2021-02-24T15:26:13.030 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:26:13.030 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:26:13.030 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:26:13.030 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:26:13.031 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:13.031 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:26:13.031 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:13.031 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:26:13.031 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:26:13.032 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:13.032 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:13.032 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:13.032 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:13.032 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:13.033 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:13.033 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:13.033 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:13.033 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:13.034 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:13.034 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:26:13.034 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:26:13.034 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:13.034 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:13.035 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:13.035 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:13.035 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:13.035 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:13.035 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:13.036 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:13.036 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:13.036 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.036 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:26:13.037 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:26:13.037 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:26:13.037 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:26:13.037 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:26:13.037 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:26:13.038 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:13.038 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:13.038 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:26:13.038 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:26:13.039 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:26:13.039 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:26:13.039 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:26:13.039 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:13.039 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:26:13.040 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:13.040 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:13.040 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:13.040 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:13.040 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:13.041 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:13.041 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:13.041 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:13.041 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:13.043 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:13.043 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:26:13.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.044 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:26:13.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.044 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:13.044 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:13.044 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:13.045 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:13.045 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.045 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:13.045 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:26:13.045 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:13.046 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.046 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.046 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:26:13.047 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:26:13.047 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:13.047 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:13.047 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:13.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.048 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:13.048 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:13.048 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:13.048 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:13.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.049 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:13.049 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:26:13.049 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:13.049 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.050 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.050 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:26:13.050 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:26:13.051 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:13.051 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:13.051 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:13.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.052 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:13.052 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:13.052 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:13.052 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:13.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.053 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:13.053 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:26:13.053 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:13.053 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.053 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.054 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:26:13.054 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:26:13.054 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:13.055 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:13.055 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:13.055 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.055 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.056 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:26:13.056 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:26:13.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.056 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:13.056 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:13.057 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:13.057 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.057 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:13.057 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:26:13.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.058 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:13.058 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:13.058 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:26:13.058 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.058 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:13.059 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:26:13.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.059 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:13.059 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:13.059 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:13.060 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.060 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.060 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:26:13.061 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:26:13.062 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:26:13.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.185+0000 7f1e0f61d700 1 Processor -- start 2021-02-24T15:26:13.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.185+0000 7f1e0f61d700 1 -- start start 2021-02-24T15:26:13.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.186+0000 7f1e0f61d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e08062660 con 0x7f1e08068410 2021-02-24T15:26:13.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.186+0000 7f1e0f61d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e08063af0 con 0x7f1e080966a0 2021-02-24T15:26:13.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.186+0000 7f1e0f61d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e08063d90 con 0x7f1e08095bb0 2021-02-24T15:26:13.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.186+0000 7f1e0dbba700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1e08068410 0x7f1e08133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48534/0 (socket says 172.21.15.152:48534) 2021-02-24T15:26:13.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.186+0000 7f1e0dbba700 1 -- 172.21.15.152:0/3843606049 learned_addr learned my addr 172.21.15.152:0/3843606049 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:13.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.186+0000 7f1e0cbb8700 1 --1- 172.21.15.152:0/3843606049 >> v1:172.21.15.152:6790/0 conn(0x7f1e08095bb0 0x7f1e08130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37008/0 (socket says 172.21.15.152:37008) 2021-02-24T15:26:13.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1e0dbba700 1 -- 172.21.15.152:0/3843606049 >> v1:172.21.15.152:6789/0 conn(0x7f1e08068410 legacy=0x7f1e08133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1e0cbb8700 1 -- 172.21.15.152:0/3843606049 >> v1:172.21.15.152:6790/0 conn(0x7f1e08095bb0 legacy=0x7f1e08130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.190 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1e0d3b9700 1 -- 172.21.15.152:0/3843606049 >> v1:172.21.15.181:6789/0 conn(0x7f1e080966a0 legacy=0x7f1e08096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312986335 0 0) 0x7f1e08063d90 con 0x7f1e08095bb0 2021-02-24T15:26:13.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df0003230 con 0x7f1e08095bb0 2021-02-24T15:26:13.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890984909 0 0) 0x7f1e08062660 con 0x7f1e08068410 2021-02-24T15:26:13.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e08063d90 con 0x7f1e08068410 2021-02-24T15:26:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640833989 0 0) 0x7f1e08063af0 con 0x7f1e080966a0 2021-02-24T15:26:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e08062660 con 0x7f1e080966a0 2021-02-24T15:26:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2144220135 0 0) 0x7f1df0003230 con 0x7f1e08095bb0 2021-02-24T15:26:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 >> v1:172.21.15.181:6789/0 conn(0x7f1e080966a0 legacy=0x7f1e08096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 >> v1:172.21.15.152:6789/0 conn(0x7f1e08068410 legacy=0x7f1e08133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08064030 con 0x7f1e08095bb0 2021-02-24T15:26:13.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.188+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1dfc001930 con 0x7f1e08095bb0 2021-02-24T15:26:13.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.189+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1dfc001cd0 con 0x7f1e08095bb0 2021-02-24T15:26:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.189+0000 7f1dfbfff700 1 -- 172.21.15.152:0/3843606049 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1dfc004690 con 0x7f1e08095bb0 2021-02-24T15:26:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.189+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3843606049 >> v1:172.21.15.152:6790/0 conn(0x7f1e08095bb0 legacy=0x7f1e08130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.189+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3843606049 shutdown_connections 2021-02-24T15:26:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.189+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3843606049 >> 172.21.15.152:0/3843606049 conn(0x7f1e0809ba40 msgr2=0x7f1e0809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.189+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3843606049 shutdown_connections 2021-02-24T15:26:13.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.189+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3843606049 wait complete. 2021-02-24T15:26:13.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.190+0000 7f1e0f61d700 1 librados: starting msgr at 2021-02-24T15:26:13.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.190+0000 7f1e0f61d700 1 librados: starting objecter 2021-02-24T15:26:13.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.190+0000 7f1e0f61d700 1 Processor -- start 2021-02-24T15:26:13.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.190+0000 7f1e0f61d700 1 -- start start 2021-02-24T15:26:13.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.190+0000 7f1e0f61d700 1 librados: setting wanted keys 2021-02-24T15:26:13.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.190+0000 7f1e0f61d700 1 librados: calling monclient init 2021-02-24T15:26:13.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.191+0000 7f1e0f61d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e08063010 con 0x7f1e08068410 2021-02-24T15:26:13.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.191+0000 7f1e0f61d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e08067430 con 0x7f1e08095bb0 2021-02-24T15:26:13.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.191+0000 7f1e0f61d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e08134730 con 0x7f1e080966a0 2021-02-24T15:26:13.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.191+0000 7f1e0d3b9700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1e08068410 0x7f1e08134020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48536/0 (socket says 172.21.15.152:48536) 2021-02-24T15:26:13.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.191+0000 7f1e0d3b9700 1 -- 172.21.15.152:0/3771381622 learned_addr learned my addr 172.21.15.152:0/3771381622 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:13.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1e0d3b9700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.152:6789/0 conn(0x7f1e08068410 legacy=0x7f1e08134020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 10 client.?.objecter ms_handle_connect 0x7f1e08068410 2021-02-24T15:26:13.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:13.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 10 client.?.objecter ms_handle_connect 0x7f1e080966a0 2021-02-24T15:26:13.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1e0dbba700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.152:6790/0 conn(0x7f1e080966a0 legacy=0x7f1e08142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:13.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384261289 0 0) 0x7f1e08063010 con 0x7f1e08068410 2021-02-24T15:26:13.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de8004bd0 con 0x7f1e08068410 2021-02-24T15:26:13.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734499505 0 0) 0x7f1e08134730 con 0x7f1e080966a0 2021-02-24T15:26:13.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e08063010 con 0x7f1e080966a0 2021-02-24T15:26:13.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 10 client.?.objecter ms_handle_connect 0x7f1e08095bb0 2021-02-24T15:26:13.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:13.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1e0cbb8700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.181:6789/0 conn(0x7f1e08095bb0 legacy=0x7f1e0813a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037408006 0 0) 0x7f1e08067430 con 0x7f1e08095bb0 2021-02-24T15:26:13.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e08134730 con 0x7f1e08095bb0 2021-02-24T15:26:13.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3693292537 0 0) 0x7f1de8004bd0 con 0x7f1e08068410 2021-02-24T15:26:13.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1e08067430 con 0x7f1e08068410 2021-02-24T15:26:13.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2602204516 0 0) 0x7f1e08063010 con 0x7f1e080966a0 2021-02-24T15:26:13.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1de8004bd0 con 0x7f1e080966a0 2021-02-24T15:26:13.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1e04001c60 con 0x7f1e08068410 2021-02-24T15:26:13.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1e00001fe0 con 0x7f1e080966a0 2021-02-24T15:26:13.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1569777664 0 0) 0x7f1e08067430 con 0x7f1e08068410 2021-02-24T15:26:13.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.152:6790/0 conn(0x7f1e080966a0 legacy=0x7f1e08142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.181:6789/0 conn(0x7f1e08095bb0 legacy=0x7f1e0813a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0811ba00 con 0x7f1e08068410 2021-02-24T15:26:13.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.193+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0813aaf0 con 0x7f1e08068410 2021-02-24T15:26:13.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1e0f61d700 10 client.28290.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:13.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0811a530 con 0x7f1e08068410 2021-02-24T15:26:13.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1e0f61d700 1 librados: init done 2021-02-24T15:26:13.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1e04002350 con 0x7f1e08068410 2021-02-24T15:26:13.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1e04002660 con 0x7f1e08068410 2021-02-24T15:26:13.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f1e04002840 con 0x7f1e08068410 2021-02-24T15:26:13.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(374..374 src has 66..374) v4 ==== 4876+0+0 (unknown 272012038 0 0) 0x7f1e0403ae60 con 0x7f1e08068410 2021-02-24T15:26:13.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1df97fa700 10 client.28290.objecter ms_dispatch 0x7f1e08001510 osd_map(374..374 src has 66..374) v4 2021-02-24T15:26:13.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1df97fa700 3 client.28290.objecter handle_osd_map got epochs [374,374] > 0 2021-02-24T15:26:13.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1df97fa700 3 client.28290.objecter handle_osd_map decoding full epoch 374 2021-02-24T15:26:13.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.194+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f1de0006550 con 0x7f1de00027f0 2021-02-24T15:26:13.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.195+0000 7f1df97fa700 20 client.28290.objecter dump_active .. 0 homeless 2021-02-24T15:26:13.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 10 client.28290.objecter ms_handle_connect 0x7f1de00027f0 2021-02-24T15:26:13.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 10 client.28290.objecter resend_mon_ops 2021-02-24T15:26:13.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1e0dbba700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.181:6789/0 conn(0x7f1de00027f0 legacy=0x7f1de0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697146896 0 0) 0x7f1de0006550 con 0x7f1de00027f0 2021-02-24T15:26:13.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e08067430 con 0x7f1de00027f0 2021-02-24T15:26:13.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 10 client.28290.objecter ms_handle_connect 0x7f1de8031450 2021-02-24T15:26:13.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4188719009 0 0) 0x7f1e08067430 con 0x7f1de00027f0 2021-02-24T15:26:13.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1de0006550 con 0x7f1de00027f0 2021-02-24T15:26:13.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1e00004fa0 con 0x7f1de00027f0 2021-02-24T15:26:13.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1838089154 0 0) 0x7f1de0006550 con 0x7f1de00027f0 2021-02-24T15:26:13.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.197+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1de0009df0 con 0x7f1de00027f0 2021-02-24T15:26:13.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.198+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f1e00007310 con 0x7f1de00027f0 2021-02-24T15:26:13.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.198+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.181:6789/0 conn(0x7f1de00027f0 legacy=0x7f1de0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.198+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.181:6789/0 conn(0x7f1de00027f0 legacy=0x7f1de0004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:13.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.206+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f1de0007520 con 0x7f1de00068c0 2021-02-24T15:26:13.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.208+0000 7f1e0dbba700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.181:6789/0 conn(0x7f1de00068c0 legacy=0x7f1de0006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.209+0000 7f1df97fa700 10 client.28290.objecter ms_handle_connect 0x7f1de00068c0 2021-02-24T15:26:13.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.209+0000 7f1df97fa700 10 client.28290.objecter resend_mon_ops 2021-02-24T15:26:13.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.209+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408381508 0 0) 0x7f1de0007520 con 0x7f1de00068c0 2021-02-24T15:26:13.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.209+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de0006550 con 0x7f1de00068c0 2021-02-24T15:26:13.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.209+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1570745713 0 0) 0x7f1de0006550 con 0x7f1de00068c0 2021-02-24T15:26:13.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.209+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1de0007520 con 0x7f1de00068c0 2021-02-24T15:26:13.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.209+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f1e000058c0 con 0x7f1de00068c0 2021-02-24T15:26:13.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.209+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2085182284 0 0) 0x7f1de0007520 con 0x7f1de00068c0 2021-02-24T15:26:13.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.209+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1de0008720 con 0x7f1de00068c0 2021-02-24T15:26:13.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 4276621309) 0x7f1e00006c90 con 0x7f1de00068c0 2021-02-24T15:26:13.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.181:6789/0 conn(0x7f1de00068c0 legacy=0x7f1de0006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1df97fa700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.181:6789/0 conn(0x7f1de00068c0 legacy=0x7f1de0006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:13.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 10 librados: watch_flush enter 2021-02-24T15:26:13.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 10 librados: watch_flush exit 2021-02-24T15:26:13.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 20 client.28290.objecter shutdown clearing up homeless session... 2021-02-24T15:26:13.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 10 client.28290.objecter successfully canceled tick 2021-02-24T15:26:13.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.181:6812/33484 conn(0x7f1de8031450 legacy=0x7f1de8033910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 >> v1:172.21.15.152:6789/0 conn(0x7f1e08068410 legacy=0x7f1e08134020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0dbba700 1 -- 172.21.15.152:0/3771381622 reap_dead start 2021-02-24T15:26:13.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0dbba700 1 -- 172.21.15.152:0/3771381622 reap_dead start 2021-02-24T15:26:13.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 shutdown_connections 2021-02-24T15:26:13.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 >> 172.21.15.152:0/3771381622 conn(0x7f1e0809ba40 msgr2=0x7f1e0809a420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:13.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 shutdown_connections 2021-02-24T15:26:13.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 1 -- 172.21.15.152:0/3771381622 wait complete. 2021-02-24T15:26:13.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.210+0000 7f1e0f61d700 1 librados: shutdown 2021-02-24T15:26:13.220 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:26:13.220 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:13.220 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:13.220 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:26:13.221 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 46, 2021-02-24T15:26:13.221 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:26:13.221 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:26:13.221 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:26:13.221 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:26:13.222 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:13.222 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:26:13.222 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:13.222 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:26:13.223 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:26:13.223 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:13.223 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:13.223 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:13.223 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:13.224 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:13.224 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:13.224 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:13.224 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:13.224 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:13.225 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:13.225 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:26:13.225 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:26:13.225 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:13.225 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:13.226 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:13.226 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:13.226 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:13.226 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:13.227 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:13.227 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:13.227 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:13.227 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.228 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:26:13.228 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:26:13.228 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:26:13.228 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:26:13.228 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:26:13.229 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:26:13.229 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:13.229 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:13.229 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:26:13.229 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:26:13.230 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:26:13.230 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:26:13.230 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:26:13.230 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:13.230 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:26:13.231 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:13.231 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:13.231 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:13.231 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:13.232 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:13.232 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:13.232 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:13.232 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:13.232 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:13.233 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:13.233 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:26:13.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.233 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:26:13.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.234 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:13.234 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:13.234 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:13.234 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:13.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.235 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:13.235 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:26:13.235 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:13.235 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.235 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.236 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:26:13.236 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:26:13.236 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:13.236 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:13.237 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:13.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.237 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:13.238 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:13.238 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:13.238 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:13.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.238 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:13.239 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:26:13.239 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:13.239 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.239 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.240 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:26:13.240 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:26:13.240 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:13.240 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:13.240 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:13.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.241 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:13.241 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:13.241 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:13.242 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:13.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.242 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:13.242 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:26:13.243 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:13.243 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.243 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.243 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:26:13.244 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:26:13.244 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:13.244 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:13.245 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:13.245 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.245 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.245 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:26:13.246 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:26:13.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.246 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:13.246 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:13.247 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:13.247 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.247 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:13.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:26:13.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:13.248 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:13.248 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:13.248 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:13.248 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:13.248 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:13.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:13.249 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:26:13.249 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:26:13.250 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2021-02-24T15:26:13.251 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2021-02-24T15:26:13.251 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2021-02-24T15:26:13.251 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2021-02-24T15:26:13.252 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-02-24T15:26:13.252 INFO:teuthology.orchestra.run:waiting for 300 2021-02-24T15:26:13.263 INFO:tasks.ceph.mon.b:Stopped 2021-02-24T15:26:13.263 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2021-02-24T15:26:13.263 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:26:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2021-02-24T15:26:13.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.378+0000 7faa164e0700 1 Processor -- start 2021-02-24T15:26:13.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.378+0000 7faa164e0700 1 -- start start 2021-02-24T15:26:13.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.379+0000 7faa164e0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100922a0 con 0x7faa100945b0 2021-02-24T15:26:13.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.379+0000 7faa164e0700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa10092540 con 0x7faa1012e1c0 2021-02-24T15:26:13.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.379+0000 7faa164e0700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100927e0 con 0x7faa100939f0 2021-02-24T15:26:13.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.379+0000 7faa0ffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7faa100945b0 0x7faa1008fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48550/0 (socket says 172.21.15.152:48550) 2021-02-24T15:26:13.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.379+0000 7faa0ffff700 1 -- 172.21.15.152:0/1314028575 learned_addr learned my addr 172.21.15.152:0/1314028575 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:13.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.379+0000 7faa14a7d700 1 -- 172.21.15.152:0/1314028575 >> v1:172.21.15.181:6789/0 conn(0x7faa1012e1c0 legacy=0x7faa101305b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:13.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.381+0000 7faa0f7fe700 1 -- 172.21.15.152:0/1314028575 >> v1:172.21.15.152:6790/0 conn(0x7faa100939f0 legacy=0x7faa10090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.381+0000 7faa0ffff700 1 -- 172.21.15.152:0/1314028575 >> v1:172.21.15.152:6789/0 conn(0x7faa100945b0 legacy=0x7faa1008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.381+0000 7faa0effd700 1 -- 172.21.15.152:0/1314028575 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454996426 0 0) 0x7faa100922a0 con 0x7faa100945b0 2021-02-24T15:26:13.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.381+0000 7faa0effd700 1 -- 172.21.15.152:0/1314028575 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9fc003230 con 0x7faa100945b0 2021-02-24T15:26:13.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.381+0000 7faa0effd700 1 -- 172.21.15.152:0/1314028575 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2060405714 0 0) 0x7fa9fc003230 con 0x7faa100945b0 2021-02-24T15:26:13.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.381+0000 7faa0effd700 1 -- 172.21.15.152:0/1314028575 >> v1:172.21.15.152:6790/0 conn(0x7faa100939f0 legacy=0x7faa10090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.381+0000 7faa0effd700 1 -- 172.21.15.152:0/1314028575 >> v1:172.21.15.181:6789/0 conn(0x7faa1012e1c0 legacy=0x7faa101305b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:26:13.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.381+0000 7faa0effd700 1 -- 172.21.15.152:0/1314028575 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa10092a80 con 0x7faa100945b0 2021-02-24T15:26:13.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.382+0000 7faa0effd700 1 -- 172.21.15.152:0/1314028575 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa000019f0 con 0x7faa100945b0 2021-02-24T15:26:13.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.382+0000 7faa0effd700 1 -- 172.21.15.152:0/1314028575 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faa00001ce0 con 0x7faa100945b0 2021-02-24T15:26:13.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.382+0000 7faa0effd700 1 -- 172.21.15.152:0/1314028575 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa00004750 con 0x7faa100945b0 2021-02-24T15:26:13.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.382+0000 7faa164e0700 1 -- 172.21.15.152:0/1314028575 >> v1:172.21.15.152:6789/0 conn(0x7faa100945b0 legacy=0x7faa1008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.382+0000 7faa164e0700 1 -- 172.21.15.152:0/1314028575 shutdown_connections 2021-02-24T15:26:13.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.382+0000 7faa164e0700 1 -- 172.21.15.152:0/1314028575 >> 172.21.15.152:0/1314028575 conn(0x7faa100999a0 msgr2=0x7faa10099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:13.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.382+0000 7faa164e0700 1 -- 172.21.15.152:0/1314028575 shutdown_connections 2021-02-24T15:26:13.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.382+0000 7faa164e0700 1 -- 172.21.15.152:0/1314028575 wait complete. 2021-02-24T15:26:13.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.383+0000 7faa164e0700 1 librados: starting msgr at 2021-02-24T15:26:13.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.383+0000 7faa164e0700 1 librados: starting objecter 2021-02-24T15:26:13.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.383+0000 7faa164e0700 1 Processor -- start 2021-02-24T15:26:13.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.383+0000 7faa164e0700 1 -- start start 2021-02-24T15:26:13.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.383+0000 7faa164e0700 1 librados: setting wanted keys 2021-02-24T15:26:13.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.383+0000 7faa164e0700 1 librados: calling monclient init 2021-02-24T15:26:13.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.384+0000 7faa164e0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa10066eb0 con 0x7faa100939f0 2021-02-24T15:26:13.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.384+0000 7faa164e0700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa10127fd0 con 0x7faa100945b0 2021-02-24T15:26:13.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.384+0000 7faa164e0700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa101127f0 con 0x7faa1012e1c0 2021-02-24T15:26:13.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.384+0000 7faa0ffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7faa100939f0 0x7faa101278c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48556/0 (socket says 172.21.15.152:48556) 2021-02-24T15:26:13.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.384+0000 7faa0ffff700 1 -- 172.21.15.152:0/2165369553 learned_addr learned my addr 172.21.15.152:0/2165369553 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:13.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.384+0000 7faa0f7fe700 1 -- 172.21.15.152:0/2165369553 >> v1:172.21.15.181:6789/0 conn(0x7faa100945b0 legacy=0x7faa1013d020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:13.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7faa0ffff700 1 -- 172.21.15.152:0/2165369553 >> v1:172.21.15.152:6789/0 conn(0x7faa100939f0 legacy=0x7faa101278c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 10 client.?.objecter ms_handle_connect 0x7faa100939f0 2021-02-24T15:26:13.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:13.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 10 client.?.objecter ms_handle_connect 0x7faa1012e1c0 2021-02-24T15:26:13.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:13.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7faa14a7d700 1 -- 172.21.15.152:0/2165369553 >> v1:172.21.15.152:6790/0 conn(0x7faa1012e1c0 legacy=0x7faa10140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:13.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283755483 0 0) 0x7faa10066eb0 con 0x7faa100939f0 2021-02-24T15:26:13.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f0004bd0 con 0x7faa100939f0 2021-02-24T15:26:13.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 808385013 0 0) 0x7fa9f0004bd0 con 0x7faa100939f0 2021-02-24T15:26:13.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa10066eb0 con 0x7faa100939f0 2021-02-24T15:26:13.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa000019b0 con 0x7faa100939f0 2021-02-24T15:26:13.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2977773025 0 0) 0x7faa10066eb0 con 0x7faa100939f0 2021-02-24T15:26:13.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 >> v1:172.21.15.152:6790/0 conn(0x7faa1012e1c0 legacy=0x7faa10140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 >> v1:172.21.15.181:6789/0 conn(0x7faa100945b0 legacy=0x7faa1013d020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:26:13.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa10138ad0 con 0x7faa100939f0 2021-02-24T15:26:13.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa10066690 con 0x7faa100939f0 2021-02-24T15:26:13.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7faa164e0700 10 client.28296.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:13.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faa10138360 con 0x7faa100939f0 2021-02-24T15:26:13.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.386+0000 7faa164e0700 1 librados: init done 2021-02-24T15:26:13.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.387+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faa00004ef0 con 0x7faa100939f0 2021-02-24T15:26:13.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.387+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa00005200 con 0x7faa100939f0 2021-02-24T15:26:13.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.387+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7faa000053e0 con 0x7faa100939f0 2021-02-24T15:26:13.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.387+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(374..374 src has 66..374) v4 ==== 4876+0+0 (unknown 272012038 0 0) 0x7faa0003b2b0 con 0x7faa100939f0 2021-02-24T15:26:13.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.387+0000 7fa9f7fff700 10 client.28296.objecter ms_dispatch 0x7faa10001510 osd_map(374..374 src has 66..374) v4 2021-02-24T15:26:13.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.387+0000 7fa9f7fff700 3 client.28296.objecter handle_osd_map got epochs [374,374] > 0 2021-02-24T15:26:13.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.387+0000 7fa9f7fff700 3 client.28296.objecter handle_osd_map decoding full epoch 374 2021-02-24T15:26:13.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.387+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e8004d60 con 0x7faa100939f0 2021-02-24T15:26:13.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.387+0000 7fa9f7fff700 20 client.28296.objecter dump_active .. 0 homeless 2021-02-24T15:26:13.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.390+0000 7fa9f7fff700 10 client.28296.objecter ms_handle_connect 0x7fa9f00312c0 2021-02-24T15:26:13.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.391+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7faa00012c20 con 0x7faa100939f0 2021-02-24T15:26:13.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.625+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa9e8005590 con 0x7faa100939f0 2021-02-24T15:26:13.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.625+0000 7fa9f7fff700 1 -- 172.21.15.152:0/2165369553 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 2042309448) 0x7faa00012810 con 0x7faa100939f0 2021-02-24T15:26:13.626 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:26:13.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 10 librados: watch_flush enter 2021-02-24T15:26:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 10 librados: watch_flush exit 2021-02-24T15:26:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 20 client.28296.objecter shutdown clearing up homeless session... 2021-02-24T15:26:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 10 client.28296.objecter successfully canceled tick 2021-02-24T15:26:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 >> v1:172.21.15.181:6812/33484 conn(0x7fa9f00312c0 legacy=0x7fa9f0033780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 >> v1:172.21.15.152:6789/0 conn(0x7faa100939f0 legacy=0x7faa101278c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 shutdown_connections 2021-02-24T15:26:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 >> 172.21.15.152:0/2165369553 conn(0x7faa100999a0 msgr2=0x7faa100977d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 shutdown_connections 2021-02-24T15:26:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 1 -- 172.21.15.152:0/2165369553 wait complete. 2021-02-24T15:26:13.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:13.627+0000 7faa164e0700 1 librados: shutdown 2021-02-24T15:26:16.640 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:26:16.767 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.766+0000 7f479df0b700 1 Processor -- start 2021-02-24T15:26:16.768 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.766+0000 7f479df0b700 1 -- start start 2021-02-24T15:26:16.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.766+0000 7f479df0b700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47980922a0 con 0x7f47980939f0 2021-02-24T15:26:16.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.766+0000 7f479df0b700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4798092540 con 0x7f479812e1c0 2021-02-24T15:26:16.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.767+0000 7f479df0b700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47980927e0 con 0x7f47980945b0 2021-02-24T15:26:16.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.767+0000 7f4797fff700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f479812e1c0 legacy=0x7f47981305b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:16.769 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.767+0000 7f47977fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f47980945b0 0x7f479808fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37048/0 (socket says 172.21.15.152:37048) 2021-02-24T15:26:16.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.767+0000 7f4796ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f47980939f0 0x7f4798090130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48572/0 (socket says 172.21.15.152:48572) 2021-02-24T15:26:16.770 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.767+0000 7f47977fe700 1 -- 172.21.15.152:0/3110479947 learned_addr learned my addr 172.21.15.152:0/3110479947 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:16.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f4796ffd700 1 -- 172.21.15.152:0/3110479947 >> v1:172.21.15.152:6789/0 conn(0x7f47980939f0 legacy=0x7f4798090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:16.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47967fc700 1 -- 172.21.15.152:0/3110479947 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543982747 0 0) 0x7f47980922a0 con 0x7f47980939f0 2021-02-24T15:26:16.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47967fc700 1 -- 172.21.15.152:0/3110479947 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4784003230 con 0x7f47980939f0 2021-02-24T15:26:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47977fe700 1 -- 172.21.15.152:0/3110479947 >> v1:172.21.15.152:6790/0 conn(0x7f47980945b0 legacy=0x7f479808fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47967fc700 1 -- 172.21.15.152:0/3110479947 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1431983334 0 0) 0x7f4784003230 con 0x7f47980939f0 2021-02-24T15:26:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47967fc700 1 -- 172.21.15.152:0/3110479947 >> v1:172.21.15.152:6790/0 conn(0x7f47980945b0 legacy=0x7f479808fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47967fc700 1 -- 172.21.15.152:0/3110479947 >> v1:172.21.15.181:6789/0 conn(0x7f479812e1c0 legacy=0x7f47981305b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:26:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47967fc700 1 -- 172.21.15.152:0/3110479947 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798092a80 con 0x7f47980939f0 2021-02-24T15:26:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47967fc700 1 -- 172.21.15.152:0/3110479947 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f478c001930 con 0x7f47980939f0 2021-02-24T15:26:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47967fc700 1 -- 172.21.15.152:0/3110479947 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f478c001c40 con 0x7f47980939f0 2021-02-24T15:26:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.769+0000 7f47967fc700 1 -- 172.21.15.152:0/3110479947 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f478c004690 con 0x7f47980939f0 2021-02-24T15:26:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.770+0000 7f479df0b700 1 -- 172.21.15.152:0/3110479947 >> v1:172.21.15.152:6789/0 conn(0x7f47980939f0 legacy=0x7f4798090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.770+0000 7f479df0b700 1 -- 172.21.15.152:0/3110479947 shutdown_connections 2021-02-24T15:26:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.770+0000 7f479df0b700 1 -- 172.21.15.152:0/3110479947 >> 172.21.15.152:0/3110479947 conn(0x7f47980999a0 msgr2=0x7f4798099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.770+0000 7f479df0b700 1 -- 172.21.15.152:0/3110479947 shutdown_connections 2021-02-24T15:26:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.770+0000 7f479df0b700 1 -- 172.21.15.152:0/3110479947 wait complete. 2021-02-24T15:26:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.771+0000 7f479df0b700 1 librados: starting msgr at 2021-02-24T15:26:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.771+0000 7f479df0b700 1 librados: starting objecter 2021-02-24T15:26:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.771+0000 7f479df0b700 1 Processor -- start 2021-02-24T15:26:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.771+0000 7f479df0b700 1 -- start start 2021-02-24T15:26:16.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.771+0000 7f479df0b700 1 librados: setting wanted keys 2021-02-24T15:26:16.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.771+0000 7f479df0b700 1 librados: calling monclient init 2021-02-24T15:26:16.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.771+0000 7f479df0b700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4798066ec0 con 0x7f47980939f0 2021-02-24T15:26:16.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.771+0000 7f479df0b700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4798065ce0 con 0x7f479812e1c0 2021-02-24T15:26:16.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.771+0000 7f479df0b700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47980656a0 con 0x7f47980945b0 2021-02-24T15:26:16.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.772+0000 7f47977fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f47980939f0 0x7f4798064f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48576/0 (socket says 172.21.15.152:48576) 2021-02-24T15:26:16.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.772+0000 7f47977fe700 1 -- 172.21.15.152:0/2721525161 learned_addr learned my addr 172.21.15.152:0/2721525161 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:16.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.772+0000 7f4797fff700 1 -- 172.21.15.152:0/2721525161 >> v1:172.21.15.181:6789/0 conn(0x7f479812e1c0 legacy=0x7f479813ffb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:16.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f47977fe700 1 -- 172.21.15.152:0/2721525161 >> v1:172.21.15.152:6789/0 conn(0x7f47980939f0 legacy=0x7f4798064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 10 client.?.objecter ms_handle_connect 0x7f47980939f0 2021-02-24T15:26:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 10 client.?.objecter ms_handle_connect 0x7f47980945b0 2021-02-24T15:26:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f4796ffd700 1 -- 172.21.15.152:0/2721525161 >> v1:172.21.15.152:6790/0 conn(0x7f47980945b0 legacy=0x7f4798127780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:16.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:16.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546434114 0 0) 0x7f4798066ec0 con 0x7f47980939f0 2021-02-24T15:26:16.783 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4778004bd0 con 0x7f47980939f0 2021-02-24T15:26:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3401486782 0 0) 0x7f4778004bd0 con 0x7f47980939f0 2021-02-24T15:26:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4798066ec0 con 0x7f47980939f0 2021-02-24T15:26:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4788001b10 con 0x7f47980939f0 2021-02-24T15:26:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2468673921 0 0) 0x7f4798066ec0 con 0x7f47980939f0 2021-02-24T15:26:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 >> v1:172.21.15.152:6790/0 conn(0x7f47980945b0 legacy=0x7f4798127780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 >> v1:172.21.15.181:6789/0 conn(0x7f479812e1c0 legacy=0x7f479813ffb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:26:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47981131a0 con 0x7f47980939f0 2021-02-24T15:26:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4798095bb0 con 0x7f47980939f0 2021-02-24T15:26:16.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f479df0b700 10 client.28302.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:16.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4798094f90 con 0x7f47980939f0 2021-02-24T15:26:16.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f479df0b700 1 librados: init done 2021-02-24T15:26:16.786 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4788004860 con 0x7f47980939f0 2021-02-24T15:26:16.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.774+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4788004b70 con 0x7f47980939f0 2021-02-24T15:26:16.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.775+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f4788004cd0 con 0x7f47980939f0 2021-02-24T15:26:16.787 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.775+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4770004d60 con 0x7f47980939f0 2021-02-24T15:26:16.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.775+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(374..374 src has 66..374) v4 ==== 4876+0+0 (unknown 272012038 0 0) 0x7f478803aeb0 con 0x7f47980939f0 2021-02-24T15:26:16.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.775+0000 7f477f7fe700 10 client.28302.objecter ms_dispatch 0x7f4798001510 osd_map(374..374 src has 66..374) v4 2021-02-24T15:26:16.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.775+0000 7f477f7fe700 3 client.28302.objecter handle_osd_map got epochs [374,374] > 0 2021-02-24T15:26:16.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.775+0000 7f477f7fe700 3 client.28302.objecter handle_osd_map decoding full epoch 374 2021-02-24T15:26:16.788 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.775+0000 7f477f7fe700 20 client.28302.objecter dump_active .. 0 homeless 2021-02-24T15:26:16.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.778+0000 7f477f7fe700 10 client.28302.objecter ms_handle_connect 0x7f47780313c0 2021-02-24T15:26:16.789 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:16.779+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f4788012760 con 0x7f47980939f0 2021-02-24T15:26:17.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.013+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4770005590 con 0x7f47980939f0 2021-02-24T15:26:17.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.014+0000 7f477f7fe700 1 -- 172.21.15.152:0/2721525161 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 359932537) 0x7f4788012350 con 0x7f47980939f0 2021-02-24T15:26:17.015 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:26:17.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 10 librados: watch_flush enter 2021-02-24T15:26:17.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 10 librados: watch_flush exit 2021-02-24T15:26:17.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 20 client.28302.objecter shutdown clearing up homeless session... 2021-02-24T15:26:17.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 10 client.28302.objecter successfully canceled tick 2021-02-24T15:26:17.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 >> v1:172.21.15.181:6812/33484 conn(0x7f47780313c0 legacy=0x7f4778033880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:17.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 >> v1:172.21.15.152:6789/0 conn(0x7f47980939f0 legacy=0x7f4798064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:17.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 shutdown_connections 2021-02-24T15:26:17.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 >> 172.21.15.152:0/2721525161 conn(0x7f47980999a0 msgr2=0x7f47980977d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:17.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 shutdown_connections 2021-02-24T15:26:17.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 1 -- 172.21.15.152:0/2721525161 wait complete. 2021-02-24T15:26:17.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:17.015+0000 7f479df0b700 1 librados: shutdown 2021-02-24T15:26:19.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2021-02-24T15:26:20.028 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:26:20.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.155+0000 7f6184a7a700 1 Processor -- start 2021-02-24T15:26:20.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.155+0000 7f6184a7a700 1 -- start start 2021-02-24T15:26:20.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.155+0000 7f6184a7a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6180062660 con 0x7f6180095bb0 2021-02-24T15:26:20.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.155+0000 7f6184a7a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6180063af0 con 0x7f6180068410 2021-02-24T15:26:20.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.155+0000 7f6184a7a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6180063d90 con 0x7f61800966a0 2021-02-24T15:26:20.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.156+0000 7f617e59c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f61800966a0 0x7f6180096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37062/0 (socket says 172.21.15.152:37062) 2021-02-24T15:26:20.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.156+0000 7f617dd9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6180095bb0 0x7f6180130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48586/0 (socket says 172.21.15.152:48586) 2021-02-24T15:26:20.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.156+0000 7f617ed9d700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f6180133990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:20.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.156+0000 7f617e59c700 1 -- 172.21.15.152:0/2508460148 learned_addr learned my addr 172.21.15.152:0/2508460148 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:20.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.158+0000 7f617dd9b700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6789/0 conn(0x7f6180095bb0 legacy=0x7f6180130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:20.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.158+0000 7f617e59c700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6790/0 conn(0x7f61800966a0 legacy=0x7f6180096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:20.358 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.357+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f6180133990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:20.758+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f6180133990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:21.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:21.559+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f6180133990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:23.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.156+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6790/0 conn(0x7f61800966a0 legacy=0x7f6180096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:23.351 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.156+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f6180133990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:26:23.352 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.156+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6789/0 conn(0x7f6180095bb0 legacy=0x7f6180130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:23.352 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.156+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6180064030 con 0x7f615c0034a0 2021-02-24T15:26:23.352 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.156+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6180063af0 con 0x7f6180068410 2021-02-24T15:26:23.352 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.156+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c010700 con 0x7f615c007130 2021-02-24T15:26:23.353 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.156+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f615c00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:23.353 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.158+0000 7f617e59c700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6789/0 conn(0x7f615c0034a0 legacy=0x7f615c0058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:23.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.158+0000 7f617dd9b700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6790/0 conn(0x7f615c007130 legacy=0x7f615c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:23.358 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.357+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f615c00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:23.758 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:23.758+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f615c00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:24.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:24.559+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f615c00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:26.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.157+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6790/0 conn(0x7f615c007130 legacy=0x7f615c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.157+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f615c00cef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:26:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.157+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6789/0 conn(0x7f615c0034a0 legacy=0x7f615c0058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.157+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0118f0 con 0x7f615c012b70 2021-02-24T15:26:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.157+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6180063af0 con 0x7f6180068410 2021-02-24T15:26:26.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.157+0000 7f616ffff700 1 -- 172.21.15.152:0/2508460148 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c005980 con 0x7f615c010b40 2021-02-24T15:26:26.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.157+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f615c00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:26.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.158+0000 7f617e59c700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6790/0 conn(0x7f615c010b40 legacy=0x7f615c010f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:26.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.158+0000 7f617dd9b700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6789/0 conn(0x7f615c012b70 legacy=0x7f615c014f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:26.359 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.358+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f615c00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:26.759+0000 7f617ed9d700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f615c00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:27.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.377+0000 7f617d59a700 1 -- 172.21.15.152:0/2508460148 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539744502 0 0) 0x7f615c005980 con 0x7f615c010b40 2021-02-24T15:26:27.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.377+0000 7f617d59a700 1 -- 172.21.15.152:0/2508460148 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6164003230 con 0x7f615c010b40 2021-02-24T15:26:27.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.378+0000 7f617d59a700 1 -- 172.21.15.152:0/2508460148 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1547740071 0 0) 0x7f6164003230 con 0x7f615c010b40 2021-02-24T15:26:27.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.378+0000 7f617d59a700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.181:6789/0 conn(0x7f6180068410 legacy=0x7f615c00cef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:26:27.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.378+0000 7f617d59a700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6789/0 conn(0x7f615c012b70 legacy=0x7f615c014f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.378+0000 7f617d59a700 1 -- 172.21.15.152:0/2508460148 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c005b60 con 0x7f615c010b40 2021-02-24T15:26:27.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.378+0000 7f617d59a700 1 -- 172.21.15.152:0/2508460148 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6174001880 con 0x7f615c010b40 2021-02-24T15:26:27.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.378+0000 7f617d59a700 1 -- 172.21.15.152:0/2508460148 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6174001ae0 con 0x7f615c010b40 2021-02-24T15:26:27.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.378+0000 7f617d59a700 1 -- 172.21.15.152:0/2508460148 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f61740045b0 con 0x7f615c010b40 2021-02-24T15:26:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.379+0000 7f6184a7a700 1 -- 172.21.15.152:0/2508460148 >> v1:172.21.15.152:6790/0 conn(0x7f615c010b40 legacy=0x7f615c010f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.379+0000 7f6184a7a700 1 -- 172.21.15.152:0/2508460148 shutdown_connections 2021-02-24T15:26:27.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.379+0000 7f6184a7a700 1 -- 172.21.15.152:0/2508460148 >> 172.21.15.152:0/2508460148 conn(0x7f618009ba40 msgr2=0x7f618009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:27.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.379+0000 7f6184a7a700 1 -- 172.21.15.152:0/2508460148 shutdown_connections 2021-02-24T15:26:27.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.379+0000 7f6184a7a700 1 -- 172.21.15.152:0/2508460148 wait complete. 2021-02-24T15:26:27.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.380+0000 7f6184a7a700 1 librados: starting msgr at 2021-02-24T15:26:27.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.380+0000 7f6184a7a700 1 librados: starting objecter 2021-02-24T15:26:27.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.380+0000 7f6184a7a700 1 Processor -- start 2021-02-24T15:26:27.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.380+0000 7f6184a7a700 1 -- start start 2021-02-24T15:26:27.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.380+0000 7f6184a7a700 1 librados: setting wanted keys 2021-02-24T15:26:27.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.380+0000 7f6184a7a700 1 librados: calling monclient init 2021-02-24T15:26:27.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.381+0000 7f6184a7a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6180063010 con 0x7f6180068410 2021-02-24T15:26:27.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.381+0000 7f6184a7a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618011ad20 con 0x7f615c010b40 2021-02-24T15:26:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.381+0000 7f6184a7a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618009a790 con 0x7f615c012b70 2021-02-24T15:26:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.381+0000 7f617e59c700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f615c010b40 legacy=0x7f618013a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:27.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.381+0000 7f617dd9b700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f615c012b70 0x7f6180133e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37108/0 (socket says 172.21.15.152:37108) 2021-02-24T15:26:27.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.381+0000 7f617dd9b700 1 -- 172.21.15.152:0/163476706 learned_addr learned my addr 172.21.15.152:0/163476706 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:27.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.383+0000 7f617dd9b700 1 -- 172.21.15.152:0/163476706 >> v1:172.21.15.152:6790/0 conn(0x7f615c012b70 legacy=0x7f6180133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:27.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.383+0000 7f616e7fc700 10 client.?.objecter ms_handle_connect 0x7f615c012b70 2021-02-24T15:26:27.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.383+0000 7f616e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:27.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.384+0000 7f616e7fc700 10 client.?.objecter ms_handle_connect 0x7f6180068410 2021-02-24T15:26:27.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.384+0000 7f616e7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:27.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.384+0000 7f617ed9d700 1 -- 172.21.15.152:0/163476706 >> v1:172.21.15.152:6789/0 conn(0x7f6180068410 legacy=0x7f6180142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:27.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.415+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510102349 0 0) 0x7f6180063010 con 0x7f6180068410 2021-02-24T15:26:27.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.415+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f615c009af0 con 0x7f6180068410 2021-02-24T15:26:27.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504605068 0 0) 0x7f618009a790 con 0x7f615c012b70 2021-02-24T15:26:27.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6180063010 con 0x7f615c012b70 2021-02-24T15:26:27.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4091833655 0 0) 0x7f6180063010 con 0x7f615c012b70 2021-02-24T15:26:27.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f618009a790 con 0x7f615c012b70 2021-02-24T15:26:27.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f61700019d0 con 0x7f615c012b70 2021-02-24T15:26:27.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 153636629 0 0) 0x7f618009a790 con 0x7f615c012b70 2021-02-24T15:26:27.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 >> v1:172.21.15.181:6789/0 conn(0x7f615c010b40 legacy=0x7f618013a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:26:27.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 >> v1:172.21.15.152:6789/0 conn(0x7f6180068410 legacy=0x7f6180142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6180134520 con 0x7f615c012b70 2021-02-24T15:26:27.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618011a320 con 0x7f615c012b70 2021-02-24T15:26:27.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f6184a7a700 10 client.84239.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:27.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6180118ce0 con 0x7f615c012b70 2021-02-24T15:26:27.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.417+0000 7f6184a7a700 1 librados: init done 2021-02-24T15:26:27.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.418+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6170001c90 con 0x7f615c012b70 2021-02-24T15:26:27.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.418+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f6170004940 con 0x7f615c012b70 2021-02-24T15:26:27.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.418+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f6170004aa0 con 0x7f615c012b70 2021-02-24T15:26:27.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.418+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(374..374 src has 66..374) v4 ==== 4876+0+0 (unknown 272012038 0 0) 0x7f617003a9e0 con 0x7f615c012b70 2021-02-24T15:26:27.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.418+0000 7f616e7fc700 10 client.84239.objecter ms_dispatch 0x7f6180001510 osd_map(374..374 src has 66..374) v4 2021-02-24T15:26:27.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.418+0000 7f616e7fc700 3 client.84239.objecter handle_osd_map got epochs [374,374] > 0 2021-02-24T15:26:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.418+0000 7f616e7fc700 3 client.84239.objecter handle_osd_map decoding full epoch 374 2021-02-24T15:26:27.427 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.418+0000 7f616e7fc700 20 client.84239.objecter dump_active .. 0 homeless 2021-02-24T15:26:27.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.419+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6180058400 con 0x7f615c012b70 2021-02-24T15:26:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.421+0000 7f616e7fc700 10 client.84239.objecter ms_handle_connect 0x7f615c033060 2021-02-24T15:26:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.427+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f61700122f0 con 0x7f615c012b70 2021-02-24T15:26:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.672+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6180093e30 con 0x7f615c012b70 2021-02-24T15:26:27.674 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.672+0000 7f616e7fc700 1 -- 172.21.15.152:0/163476706 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1336 (unknown 254746657 0 628511400) 0x7f6170011ee0 con 0x7f615c012b70 2021-02-24T15:26:27.674 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":50,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:26:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.673+0000 7f6184a7a700 10 librados: watch_flush enter 2021-02-24T15:26:27.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.673+0000 7f6184a7a700 10 librados: watch_flush exit 2021-02-24T15:26:27.677 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.673+0000 7f6184a7a700 20 client.84239.objecter shutdown clearing up homeless session... 2021-02-24T15:26:27.678 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.673+0000 7f6184a7a700 10 client.84239.objecter successfully canceled tick 2021-02-24T15:26:27.678 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.674+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 >> v1:172.21.15.181:6812/33484 conn(0x7f615c033060 legacy=0x7f615c035520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.678 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.674+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 >> v1:172.21.15.152:6790/0 conn(0x7f615c012b70 legacy=0x7f6180133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.674+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 shutdown_connections 2021-02-24T15:26:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.674+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 >> 172.21.15.152:0/163476706 conn(0x7f618009ba40 msgr2=0x7f6180094360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.674+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 shutdown_connections 2021-02-24T15:26:27.680 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.674+0000 7f6184a7a700 1 -- 172.21.15.152:0/163476706 wait complete. 2021-02-24T15:26:27.680 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.674+0000 7f6184a7a700 1 librados: shutdown 2021-02-24T15:26:27.690 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2021-02-24T15:26:27.691 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:26:27.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.808+0000 7fb1c815a700 1 Processor -- start 2021-02-24T15:26:27.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.808+0000 7fb1c815a700 1 -- start start 2021-02-24T15:26:27.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.809+0000 7fb1c815a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c00688c0 con 0x7fb1c00974d0 2021-02-24T15:26:27.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.809+0000 7fb1c815a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c0068af0 con 0x7fb1c0130e30 2021-02-24T15:26:27.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.809+0000 7fb1c815a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c0068530 con 0x7fb1c0090640 2021-02-24T15:26:27.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.809+0000 7fb1c66f7700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fb1c0130e30 legacy=0x7fb1c0133220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:27.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.809+0000 7fb1c56f5700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fb1c0090640 0x7fb1c0090ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37114/0 (socket says 172.21.15.152:37114) 2021-02-24T15:26:27.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.809+0000 7fb1c56f5700 1 -- 172.21.15.152:0/1138000890 learned_addr learned my addr 172.21.15.152:0/1138000890 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:27.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.809+0000 7fb1c5ef6700 1 --1- 172.21.15.152:0/1138000890 >> v1:172.21.15.152:6789/0 conn(0x7fb1c00974d0 0x7fb1c0127aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48638/0 (socket says 172.21.15.152:48638) 2021-02-24T15:26:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.811+0000 7fb1c56f5700 1 -- 172.21.15.152:0/1138000890 >> v1:172.21.15.152:6790/0 conn(0x7fb1c0090640 legacy=0x7fb1c0090ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.811+0000 7fb1c5ef6700 1 -- 172.21.15.152:0/1138000890 >> v1:172.21.15.152:6789/0 conn(0x7fb1c00974d0 legacy=0x7fb1c0127aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:27.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.811+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526654895 0 0) 0x7fb1c0068530 con 0x7fb1c0090640 2021-02-24T15:26:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.811+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a8003230 con 0x7fb1c0090640 2021-02-24T15:26:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.811+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473151877 0 0) 0x7fb1c00688c0 con 0x7fb1c00974d0 2021-02-24T15:26:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.811+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c0068530 con 0x7fb1c00974d0 2021-02-24T15:26:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2314555715 0 0) 0x7fb1a8003230 con 0x7fb1c0090640 2021-02-24T15:26:27.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 >> v1:172.21.15.181:6789/0 conn(0x7fb1c0130e30 legacy=0x7fb1c0133220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:26:27.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 >> v1:172.21.15.152:6789/0 conn(0x7fb1c00974d0 legacy=0x7fb1c0127aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c0067fd0 con 0x7fb1c0090640 2021-02-24T15:26:27.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb1b40019f0 con 0x7fb1c0090640 2021-02-24T15:26:27.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb1b4001ca0 con 0x7fb1c0090640 2021-02-24T15:26:27.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c4ef4700 1 -- 172.21.15.152:0/1138000890 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb1b4004750 con 0x7fb1c0090640 2021-02-24T15:26:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c815a700 1 -- 172.21.15.152:0/1138000890 >> v1:172.21.15.152:6790/0 conn(0x7fb1c0090640 legacy=0x7fb1c0090ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c815a700 1 -- 172.21.15.152:0/1138000890 shutdown_connections 2021-02-24T15:26:27.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c815a700 1 -- 172.21.15.152:0/1138000890 >> 172.21.15.152:0/1138000890 conn(0x7fb1c009ab10 msgr2=0x7fb1c0096ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:27.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c815a700 1 -- 172.21.15.152:0/1138000890 shutdown_connections 2021-02-24T15:26:27.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.812+0000 7fb1c815a700 1 -- 172.21.15.152:0/1138000890 wait complete. 2021-02-24T15:26:27.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.813+0000 7fb1c815a700 1 librados: starting msgr at 2021-02-24T15:26:27.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.813+0000 7fb1c815a700 1 librados: starting objecter 2021-02-24T15:26:27.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.813+0000 7fb1c815a700 1 Processor -- start 2021-02-24T15:26:27.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.813+0000 7fb1c815a700 1 -- start start 2021-02-24T15:26:27.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.813+0000 7fb1c815a700 1 librados: setting wanted keys 2021-02-24T15:26:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.813+0000 7fb1c815a700 1 librados: calling monclient init 2021-02-24T15:26:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.814+0000 7fb1c815a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c0082fa0 con 0x7fb1c00974d0 2021-02-24T15:26:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.814+0000 7fb1c815a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c0083240 con 0x7fb1c0130e30 2021-02-24T15:26:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.814+0000 7fb1c815a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c0087e10 con 0x7fb1c0090640 2021-02-24T15:26:27.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.814+0000 7fb1c5ef6700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fb1c0090640 0x7fb1c00849c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37120/0 (socket says 172.21.15.152:37120) 2021-02-24T15:26:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.814+0000 7fb1c5ef6700 1 -- 172.21.15.152:0/3988837733 learned_addr learned my addr 172.21.15.152:0/3988837733 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:27.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.814+0000 7fb1c66f7700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.181:6789/0 conn(0x7fb1c0130e30 legacy=0x7fb1c0142380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:27.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.816+0000 7fb1c56f5700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6789/0 conn(0x7fb1c00974d0 legacy=0x7fb1c013ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:27.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.816+0000 7fb1c5ef6700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6790/0 conn(0x7fb1c0090640 legacy=0x7fb1c00849c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:27.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.816+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 DispatchQueue::entry inject delay of 0.002000 2021-02-24T15:26:27.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 10 client.?.objecter ms_handle_connect 0x7fb1c00974d0 2021-02-24T15:26:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 10 client.?.objecter ms_handle_connect 0x7fb1c0090640 2021-02-24T15:26:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:27.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372603621 0 0) 0x7fb1c0087e10 con 0x7fb1c0090640 2021-02-24T15:26:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0004bd0 con 0x7fb1c0090640 2021-02-24T15:26:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432931699 0 0) 0x7fb1c0082fa0 con 0x7fb1c00974d0 2021-02-24T15:26:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c0087e10 con 0x7fb1c00974d0 2021-02-24T15:26:27.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 309016282 0 0) 0x7fb1a0004bd0 con 0x7fb1c0090640 2021-02-24T15:26:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb1c0082fa0 con 0x7fb1c0090640 2021-02-24T15:26:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb1bc001c40 con 0x7fb1c0090640 2021-02-24T15:26:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 571994886 0 0) 0x7fb1c0087e10 con 0x7fb1c00974d0 2021-02-24T15:26:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb1a0004bd0 con 0x7fb1c00974d0 2021-02-24T15:26:27.832 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb1b4004690 con 0x7fb1c00974d0 2021-02-24T15:26:27.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.818+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 15331042 0 0) 0x7fb1c0082fa0 con 0x7fb1c0090640 2021-02-24T15:26:27.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.181:6789/0 conn(0x7fb1c0130e30 legacy=0x7fb1c0142380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:26:27.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6789/0 conn(0x7fb1c00974d0 legacy=0x7fb1c013ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.833 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c008de00 con 0x7fb1c0090640 2021-02-24T15:26:27.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c0133950 con 0x7fb1c0090640 2021-02-24T15:26:27.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb1bc0048e0 con 0x7fb1c0090640 2021-02-24T15:26:27.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb1bc004bf0 con 0x7fb1c0090640 2021-02-24T15:26:27.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1c815a700 10 client.84245.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:27.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c00837c0 con 0x7fb1c0090640 2021-02-24T15:26:27.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1c815a700 1 librados: init done 2021-02-24T15:26:27.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.819+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fb1bc004dd0 con 0x7fb1c0090640 2021-02-24T15:26:27.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.820+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(374..374 src has 66..374) v4 ==== 4876+0+0 (unknown 272012038 0 0) 0x7fb1bc03ae70 con 0x7fb1c0090640 2021-02-24T15:26:27.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.820+0000 7fb1b1ffb700 10 client.84245.objecter ms_dispatch 0x7fb1c0001510 osd_map(374..374 src has 66..374) v4 2021-02-24T15:26:27.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.820+0000 7fb1b1ffb700 3 client.84245.objecter handle_osd_map got epochs [374,374] > 0 2021-02-24T15:26:27.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.820+0000 7fb1b1ffb700 3 client.84245.objecter handle_osd_map decoding full epoch 374 2021-02-24T15:26:27.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.820+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fb1c0082d90 con 0x7fb1c0098c70 2021-02-24T15:26:27.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.820+0000 7fb1b1ffb700 20 client.84245.objecter dump_active .. 0 homeless 2021-02-24T15:26:27.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 10 client.84245.objecter ms_handle_connect 0x7fb1c0098c70 2021-02-24T15:26:27.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 10 client.84245.objecter resend_mon_ops 2021-02-24T15:26:27.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1c66f7700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6789/0 conn(0x7fb1c0098c70 legacy=0x7fb1c0099050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:27.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020866968 0 0) 0x7fb1c0082d90 con 0x7fb1c0098c70 2021-02-24T15:26:27.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c0082fa0 con 0x7fb1c0098c70 2021-02-24T15:26:27.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 10 client.84245.objecter ms_handle_connect 0x7fb1a0031510 2021-02-24T15:26:27.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4160949489 0 0) 0x7fb1c0082fa0 con 0x7fb1c0098c70 2021-02-24T15:26:27.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb1c0082d90 con 0x7fb1c0098c70 2021-02-24T15:26:27.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb1b8004290 con 0x7fb1c0098c70 2021-02-24T15:26:27.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 622234328 0 0) 0x7fb1c0082d90 con 0x7fb1c0098c70 2021-02-24T15:26:27.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.822+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1c0058400 con 0x7fb1c0098c70 2021-02-24T15:26:27.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.823+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fb1b8006620 con 0x7fb1c0098c70 2021-02-24T15:26:27.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.823+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6789/0 conn(0x7fb1c0098c70 legacy=0x7fb1c0099050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.823+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6789/0 conn(0x7fb1c0098c70 legacy=0x7fb1c0099050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:27.841 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.831+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fb1c0068d90 con 0x7fb1c0027010 2021-02-24T15:26:27.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1b1ffb700 10 client.84245.objecter ms_handle_connect 0x7fb1c0027010 2021-02-24T15:26:27.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1b1ffb700 10 client.84245.objecter resend_mon_ops 2021-02-24T15:26:27.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1c66f7700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6789/0 conn(0x7fb1c0027010 legacy=0x7fb1c0147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:27.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953855857 0 0) 0x7fb1c0068d90 con 0x7fb1c0027010 2021-02-24T15:26:27.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c0082d90 con 0x7fb1c0027010 2021-02-24T15:26:27.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 407168423 0 0) 0x7fb1c0082d90 con 0x7fb1c0027010 2021-02-24T15:26:27.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb1c0068d90 con 0x7fb1c0027010 2021-02-24T15:26:27.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fb1b8004bd0 con 0x7fb1c0027010 2021-02-24T15:26:27.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3353524564 0 0) 0x7fb1c0068d90 con 0x7fb1c0027010 2021-02-24T15:26:27.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.833+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb1c0044c90 con 0x7fb1c0027010 2021-02-24T15:26:27.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4101 (unknown 0 0 1819230710) 0x7fb1b8006010 con 0x7fb1c0027010 2021-02-24T15:26:27.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6789/0 conn(0x7fb1c0027010 legacy=0x7fb1c0147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1b1ffb700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6789/0 conn(0x7fb1c0027010 legacy=0x7fb1c0147ac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:27.844 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 10 librados: watch_flush enter 2021-02-24T15:26:27.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 10 librados: watch_flush exit 2021-02-24T15:26:27.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 20 client.84245.objecter shutdown clearing up homeless session... 2021-02-24T15:26:27.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 10 client.84245.objecter successfully canceled tick 2021-02-24T15:26:27.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.181:6812/33484 conn(0x7fb1a0031510 legacy=0x7fb1a00339d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 >> v1:172.21.15.152:6790/0 conn(0x7fb1c0090640 legacy=0x7fb1c00849c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:27.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c66f7700 1 -- 172.21.15.152:0/3988837733 reap_dead start 2021-02-24T15:26:27.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c66f7700 1 -- 172.21.15.152:0/3988837733 reap_dead start 2021-02-24T15:26:27.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 shutdown_connections 2021-02-24T15:26:27.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 >> 172.21.15.152:0/3988837733 conn(0x7fb1c009ab10 msgr2=0x7fb1c0080fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:27.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 shutdown_connections 2021-02-24T15:26:27.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 1 -- 172.21.15.152:0/3988837733 wait complete. 2021-02-24T15:26:27.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:27.834+0000 7fb1c815a700 1 librados: shutdown 2021-02-24T15:26:27.847 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:26:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:26:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 50, 2021-02-24T15:26:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:26:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:26:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:26:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:26:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:26:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:26:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:26:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:26:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:26:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:26:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:26:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:26:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:26:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:26:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:26:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:26:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:26:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:26:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:26:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:26:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:26:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:26:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:26:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:26:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:26:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:26:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:26:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:26:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:26:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:26:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:26:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:26:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:26:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:26:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:26:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:26:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:26:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:26:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:26:27.883 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:26:27.884 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:26:28.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.000+0000 7f3614a26700 1 Processor -- start 2021-02-24T15:26:28.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.000+0000 7f3614a26700 1 -- start start 2021-02-24T15:26:28.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.001+0000 7f3614a26700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36100922a0 con 0x7f361012e1c0 2021-02-24T15:26:28.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.001+0000 7f3614a26700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3610092540 con 0x7f36100939f0 2021-02-24T15:26:28.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.001+0000 7f3614a26700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36100927e0 con 0x7f36100945b0 2021-02-24T15:26:28.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.001+0000 7f360e59c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f36100945b0 0x7f361008fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37132/0 (socket says 172.21.15.152:37132) 2021-02-24T15:26:28.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.001+0000 7f360ed9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f361012e1c0 0x7f36101305b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48660/0 (socket says 172.21.15.152:48660) 2021-02-24T15:26:28.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.001+0000 7f360e59c700 1 -- 172.21.15.152:0/3235779047 learned_addr learned my addr 172.21.15.152:0/3235779047 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:28.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.001+0000 7f3607fff700 1 -- 172.21.15.152:0/3235779047 >> v1:172.21.15.181:6789/0 conn(0x7f36100939f0 legacy=0x7f3610090130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:28.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360e59c700 1 -- 172.21.15.152:0/3235779047 >> v1:172.21.15.152:6790/0 conn(0x7f36100945b0 legacy=0x7f361008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:28.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360ed9d700 1 -- 172.21.15.152:0/3235779047 >> v1:172.21.15.152:6789/0 conn(0x7f361012e1c0 legacy=0x7f36101305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:28.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339820941 0 0) 0x7f36100927e0 con 0x7f36100945b0 2021-02-24T15:26:28.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f0003230 con 0x7f36100945b0 2021-02-24T15:26:28.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286114696 0 0) 0x7f36100922a0 con 0x7f361012e1c0 2021-02-24T15:26:28.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36100927e0 con 0x7f361012e1c0 2021-02-24T15:26:28.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3340501550 0 0) 0x7f35f0003230 con 0x7f36100945b0 2021-02-24T15:26:28.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 >> v1:172.21.15.181:6789/0 conn(0x7f36100939f0 legacy=0x7f3610090130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:26:28.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 >> v1:172.21.15.152:6789/0 conn(0x7f361012e1c0 legacy=0x7f36101305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:28.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.003+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610092a80 con 0x7f36100945b0 2021-02-24T15:26:28.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.004+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f36000019f0 con 0x7f36100945b0 2021-02-24T15:26:28.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.004+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3600001ca0 con 0x7f36100945b0 2021-02-24T15:26:28.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.004+0000 7f360dd9b700 1 -- 172.21.15.152:0/3235779047 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3600004750 con 0x7f36100945b0 2021-02-24T15:26:28.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.004+0000 7f3614a26700 1 -- 172.21.15.152:0/3235779047 >> v1:172.21.15.152:6790/0 conn(0x7f36100945b0 legacy=0x7f361008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:28.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.004+0000 7f3614a26700 1 -- 172.21.15.152:0/3235779047 shutdown_connections 2021-02-24T15:26:28.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.004+0000 7f3614a26700 1 -- 172.21.15.152:0/3235779047 >> 172.21.15.152:0/3235779047 conn(0x7f36100999a0 msgr2=0x7f3610099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:28.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.004+0000 7f3614a26700 1 -- 172.21.15.152:0/3235779047 shutdown_connections 2021-02-24T15:26:28.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.004+0000 7f3614a26700 1 -- 172.21.15.152:0/3235779047 wait complete. 2021-02-24T15:26:28.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3614a26700 1 librados: starting msgr at 2021-02-24T15:26:28.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3614a26700 1 librados: starting objecter 2021-02-24T15:26:28.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3614a26700 1 Processor -- start 2021-02-24T15:26:28.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3614a26700 1 -- start start 2021-02-24T15:26:28.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3614a26700 1 librados: setting wanted keys 2021-02-24T15:26:28.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3614a26700 1 librados: calling monclient init 2021-02-24T15:26:28.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3614a26700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361012cbb0 con 0x7f36100939f0 2021-02-24T15:26:28.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3614a26700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361012cde0 con 0x7f36100945b0 2021-02-24T15:26:28.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3614a26700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361012d080 con 0x7f361012e1c0 2021-02-24T15:26:28.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f360e59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f36100939f0 0x7f3610139da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48662/0 (socket says 172.21.15.152:48662) 2021-02-24T15:26:28.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f360e59c700 1 -- 172.21.15.152:0/1180618312 learned_addr learned my addr 172.21.15.152:0/1180618312 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:26:28.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f360ed9d700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f361012e1c0 0x7f3610142050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37142/0 (socket says 172.21.15.152:37142) 2021-02-24T15:26:28.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.005+0000 7f3607fff700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.181:6789/0 conn(0x7f36100945b0 legacy=0x7f361013a4b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:26:28.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f360e59c700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6789/0 conn(0x7f36100939f0 legacy=0x7f3610139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:28.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 10 client.?.objecter ms_handle_connect 0x7f36100939f0 2021-02-24T15:26:28.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:28.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 10 client.?.objecter ms_handle_connect 0x7f361012e1c0 2021-02-24T15:26:28.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:26:28.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f360ed9d700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6790/0 conn(0x7f361012e1c0 legacy=0x7f3610142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:28.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545896328 0 0) 0x7f361012cbb0 con 0x7f36100939f0 2021-02-24T15:26:28.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f4004bd0 con 0x7f36100939f0 2021-02-24T15:26:28.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022435747 0 0) 0x7f361012d080 con 0x7f361012e1c0 2021-02-24T15:26:28.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f361012cbb0 con 0x7f361012e1c0 2021-02-24T15:26:28.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3636052527 0 0) 0x7f35f4004bd0 con 0x7f36100939f0 2021-02-24T15:26:28.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f361012d080 con 0x7f36100939f0 2021-02-24T15:26:28.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3600004690 con 0x7f36100939f0 2021-02-24T15:26:28.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3231712111 0 0) 0x7f361012cbb0 con 0x7f361012e1c0 2021-02-24T15:26:28.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f35f4004bd0 con 0x7f361012e1c0 2021-02-24T15:26:28.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3608001fe0 con 0x7f361012e1c0 2021-02-24T15:26:28.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3293278270 0 0) 0x7f361012d080 con 0x7f36100939f0 2021-02-24T15:26:28.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6790/0 conn(0x7f361012e1c0 legacy=0x7f3610142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:28.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.181:6789/0 conn(0x7f36100945b0 legacy=0x7f361013a4b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:26:28.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100917d0 con 0x7f36100939f0 2021-02-24T15:26:28.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3610066fe0 con 0x7f36100939f0 2021-02-24T15:26:28.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f3614a26700 10 client.28323.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:26:28.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f361012b9f0 con 0x7f36100939f0 2021-02-24T15:26:28.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f3614a26700 1 librados: init done 2021-02-24T15:26:28.026 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3600004d70 con 0x7f36100939f0 2021-02-24T15:26:28.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.008+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3600005080 con 0x7f36100939f0 2021-02-24T15:26:28.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.009+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f360000db80 con 0x7f36100939f0 2021-02-24T15:26:28.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.009+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f35e8006550 con 0x7f35e80027f0 2021-02-24T15:26:28.027 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.009+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(374..374 src has 66..374) v4 ==== 4876+0+0 (unknown 272012038 0 0) 0x7f360003b070 con 0x7f36100939f0 2021-02-24T15:26:28.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.009+0000 7f36067fc700 10 client.28323.objecter ms_dispatch 0x7f3610001510 osd_map(374..374 src has 66..374) v4 2021-02-24T15:26:28.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.009+0000 7f36067fc700 3 client.28323.objecter handle_osd_map got epochs [374,374] > 0 2021-02-24T15:26:28.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.009+0000 7f36067fc700 3 client.28323.objecter handle_osd_map decoding full epoch 374 2021-02-24T15:26:28.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.009+0000 7f36067fc700 20 client.28323.objecter dump_active .. 0 homeless 2021-02-24T15:26:28.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.011+0000 7f36067fc700 10 client.28323.objecter ms_handle_connect 0x7f35e80027f0 2021-02-24T15:26:28.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.011+0000 7f36067fc700 10 client.28323.objecter resend_mon_ops 2021-02-24T15:26:28.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.011+0000 7f3607fff700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6790/0 conn(0x7f35e80027f0 legacy=0x7f35e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:28.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.011+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714222130 0 0) 0x7f35e8006550 con 0x7f35e80027f0 2021-02-24T15:26:28.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.011+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f361012d080 con 0x7f35e80027f0 2021-02-24T15:26:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.011+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1648144039 0 0) 0x7f361012d080 con 0x7f35e80027f0 2021-02-24T15:26:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.012+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f35e8006550 con 0x7f35e80027f0 2021-02-24T15:26:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.012+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f35f8003fe0 con 0x7f35e80027f0 2021-02-24T15:26:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.012+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 245536375 0 0) 0x7f35e8006550 con 0x7f35e80027f0 2021-02-24T15:26:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.012+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35e8009df0 con 0x7f35e80027f0 2021-02-24T15:26:28.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.012+0000 7f36067fc700 10 client.28323.objecter ms_handle_connect 0x7f35f4031400 2021-02-24T15:26:28.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.012+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f35f8006380 con 0x7f35e80027f0 2021-02-24T15:26:28.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.012+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6790/0 conn(0x7f35e80027f0 legacy=0x7f35e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:28.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.012+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6790/0 conn(0x7f35e80027f0 legacy=0x7f35e8004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:28.034 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.020+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f35e8009a80 con 0x7f35e8008da0 2021-02-24T15:26:28.035 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.022+0000 7f3607fff700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6790/0 conn(0x7f35e8008da0 legacy=0x7f35e8009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:26:28.035 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.022+0000 7f36067fc700 10 client.28323.objecter ms_handle_connect 0x7f35e8008da0 2021-02-24T15:26:28.035 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.022+0000 7f36067fc700 10 client.28323.objecter resend_mon_ops 2021-02-24T15:26:28.035 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.022+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784524850 0 0) 0x7f35e8009a80 con 0x7f35e8008da0 2021-02-24T15:26:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.022+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e8006550 con 0x7f35e8008da0 2021-02-24T15:26:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.022+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1561186999 0 0) 0x7f35e8006550 con 0x7f35e8008da0 2021-02-24T15:26:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.022+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f35e8009a80 con 0x7f35e8008da0 2021-02-24T15:26:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f35f80048b0 con 0x7f35e8008da0 2021-02-24T15:26:28.037 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1189766917 0 0) 0x7f35e8009a80 con 0x7f35e8008da0 2021-02-24T15:26:28.037 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f35e80086f0 con 0x7f35e8008da0 2021-02-24T15:26:28.037 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3929 (unknown 0 0 1839775268) 0x7f35f8005d30 con 0x7f35e8008da0 2021-02-24T15:26:28.037 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6790/0 conn(0x7f35e8008da0 legacy=0x7f35e8009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:28.037 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f36067fc700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6790/0 conn(0x7f35e8008da0 legacy=0x7f35e8009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:26:28.038 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 10 librados: watch_flush enter 2021-02-24T15:26:28.038 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 10 librados: watch_flush exit 2021-02-24T15:26:28.038 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 20 client.28323.objecter shutdown clearing up homeless session... 2021-02-24T15:26:28.038 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 10 client.28323.objecter successfully canceled tick 2021-02-24T15:26:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.181:6812/33484 conn(0x7f35f4031400 legacy=0x7f35f40338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 >> v1:172.21.15.152:6789/0 conn(0x7f36100939f0 legacy=0x7f3610139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:26:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f360ed9d700 1 -- 172.21.15.152:0/1180618312 reap_dead start 2021-02-24T15:26:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f360ed9d700 1 -- 172.21.15.152:0/1180618312 reap_dead start 2021-02-24T15:26:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 shutdown_connections 2021-02-24T15:26:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 >> 172.21.15.152:0/1180618312 conn(0x7f36100999a0 msgr2=0x7f3610094de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:26:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 shutdown_connections 2021-02-24T15:26:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 1 -- 172.21.15.152:0/1180618312 wait complete. 2021-02-24T15:26:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:26:28.023+0000 7f3614a26700 1 librados: shutdown 2021-02-24T15:26:28.041 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:26:28.041 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:28.041 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:28.041 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:26:28.042 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 50, 2021-02-24T15:26:28.042 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:26:28.042 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:26:28.042 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:26:28.042 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:28.043 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:26:28.043 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:28.043 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:26:28.043 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:26:28.043 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:28.044 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:28.044 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:28.044 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:28.044 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:28.045 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:28.045 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:28.045 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:28.045 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:28.045 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:28.046 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:26:28.046 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:26:28.046 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:28.047 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:28.047 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:28.047 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:28.047 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:28.048 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:28.048 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:28.048 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:28.048 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:28.048 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:28.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:28.049 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:26:28.049 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:26:28.050 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:26:28.050 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:26:28.050 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:26:28.050 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:26:28.051 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:28.051 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:26:28.051 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:26:28.051 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:26:28.052 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:26:28.052 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:26:28.052 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:26:28.052 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:26:28.052 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:26:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:26:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:26:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:26:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:26:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:26:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:26:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:26:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:26:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:26:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:26:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:26:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:26:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:26:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:26:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:28.058 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:28.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:28.058 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:26:28.058 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:26:28.059 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:28.059 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:28.059 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:28.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:28.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:28.060 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:26:28.060 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:26:28.060 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:28.060 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:28.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:28.061 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:28.061 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:26:28.061 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:28.061 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:28.061 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:28.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:28.062 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:26:28.062 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:26:28.062 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:28.063 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:28.063 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:28.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:28.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:28.063 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:26:28.064 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:26:28.064 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:26:28.064 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:26:28.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:28.064 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:26:28.065 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:26:28.065 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:26:28.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:28.065 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:28.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:28.066 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:26:28.066 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:26:28.066 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:26:28.066 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:26:28.067 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:26:28.067 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:28.067 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:28.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:28.067 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:26:28.068 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:26:28.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:28.068 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:28.068 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:28.068 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:28.069 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:28.069 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:28.069 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:26:28.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:28.070 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:28.070 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:28.070 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:26:28.070 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:28.070 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:26:28.071 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:26:28.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:26:28.071 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:26:28.071 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:26:28.072 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:26:28.072 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:26:28.072 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:26:28.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:26:28.072 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:26:28.073 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:26:28.074 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-02-24T15:27:09.928 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22997 ms) 2021-02-24T15:27:09.929 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2021-02-24T15:27:09.929 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3772 ms) 2021-02-24T15:27:09.929 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2021-02-24T15:27:09.930 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.930 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3006 ms) 2021-02-24T15:27:09.930 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2021-02-24T15:27:09.930 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3004 ms) 2021-02-24T15:27:09.931 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2021-02-24T15:27:09.931 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.931 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3005 ms) 2021-02-24T15:27:09.931 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2021-02-24T15:27:09.931 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.932 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (3211 ms) 2021-02-24T15:27:09.932 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2021-02-24T15:27:09.932 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.932 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (56133 ms) 2021-02-24T15:27:09.933 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2021-02-24T15:27:09.933 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.933 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (17989 ms) 2021-02-24T15:27:09.933 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2021-02-24T15:27:09.934 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.934 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4080 ms) 2021-02-24T15:27:09.934 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2021-02-24T15:27:09.934 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.935 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (2926 ms) 2021-02-24T15:27:09.935 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2021-02-24T15:27:09.935 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.935 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (25017 ms) 2021-02-24T15:27:09.935 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2021-02-24T15:27:09.936 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.936 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (16001 ms) 2021-02-24T15:27:09.936 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2021-02-24T15:27:09.936 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.937 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5050 ms) 2021-02-24T15:27:09.937 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2021-02-24T15:27:09.937 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.937 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: waiting for scrubs... 2021-02-24T15:27:09.937 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: done waiting 2021-02-24T15:27:09.938 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (25039 ms) 2021-02-24T15:27:09.938 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2021-02-24T15:27:09.938 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.938 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (24619 ms) 2021-02-24T15:27:09.939 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2021-02-24T15:27:09.939 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.939 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (8978 ms) 2021-02-24T15:27:09.939 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2021-02-24T15:27:09.940 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.940 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9013 ms) 2021-02-24T15:27:09.940 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2021-02-24T15:27:09.940 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.941 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (8975 ms) 2021-02-24T15:27:09.941 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2021-02-24T15:27:09.941 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: require_osd_release = quincy 2021-02-24T15:27:09.941 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (5989 ms) 2021-02-24T15:27:58.076 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2021-02-24T15:27:58.077 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2021-02-24T15:27:58.078 INFO:tasks.ceph.mon.b:Restarting daemon 2021-02-24T15:27:58.078 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-02-24T15:27:58.082 INFO:tasks.ceph.mon.b:Started 2021-02-24T15:27:58.082 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:27:58.082 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:27:58.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.211+0000 7f781a2f4700 1 Processor -- start 2021-02-24T15:27:58.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.212+0000 7f781a2f4700 1 -- start start 2021-02-24T15:27:58.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.212+0000 7f781a2f4700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78140922a0 con 0x7f78140939f0 2021-02-24T15:27:58.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.212+0000 7f781a2f4700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7814092540 con 0x7f78140945b0 2021-02-24T15:27:58.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.212+0000 7f781a2f4700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78140927e0 con 0x7f781412e1c0 2021-02-24T15:27:58.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.212+0000 7f78137fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f78140939f0 0x7f7814090130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48792/0 (socket says 172.21.15.152:48792) 2021-02-24T15:27:58.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.212+0000 7f78137fe700 1 -- 172.21.15.152:0/2670653841 learned_addr learned my addr 172.21.15.152:0/2670653841 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:58.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.212+0000 7f7818891700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f781412e1c0 0x7f78141305b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37272/0 (socket says 172.21.15.152:37272) 2021-02-24T15:27:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.214+0000 7f78137fe700 1 -- 172.21.15.152:0/2670653841 >> v1:172.21.15.152:6789/0 conn(0x7f78140939f0 legacy=0x7f7814090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.214+0000 7f7818891700 1 -- 172.21.15.152:0/2670653841 >> v1:172.21.15.152:6790/0 conn(0x7f781412e1c0 legacy=0x7f78141305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.214+0000 7f7813fff700 1 -- 172.21.15.152:0/2670653841 >> v1:172.21.15.181:6789/0 conn(0x7f78140945b0 legacy=0x7f781408fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.215+0000 7f7812ffd700 1 -- 172.21.15.152:0/2670653841 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338023745 0 0) 0x7f78140927e0 con 0x7f781412e1c0 2021-02-24T15:27:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.215+0000 7f7812ffd700 1 -- 172.21.15.152:0/2670653841 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7800003230 con 0x7f781412e1c0 2021-02-24T15:27:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.215+0000 7f7812ffd700 1 -- 172.21.15.152:0/2670653841 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3962105748 0 0) 0x7f7800003230 con 0x7f781412e1c0 2021-02-24T15:27:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.215+0000 7f7812ffd700 1 -- 172.21.15.152:0/2670653841 >> v1:172.21.15.181:6789/0 conn(0x7f78140945b0 legacy=0x7f781408fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.215+0000 7f7812ffd700 1 -- 172.21.15.152:0/2670653841 >> v1:172.21.15.152:6789/0 conn(0x7f78140939f0 legacy=0x7f7814090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.215+0000 7f7812ffd700 1 -- 172.21.15.152:0/2670653841 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814092a80 con 0x7f781412e1c0 2021-02-24T15:27:58.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.215+0000 7f7812ffd700 1 -- 172.21.15.152:0/2670653841 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f780c001d70 con 0x7f781412e1c0 2021-02-24T15:27:58.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.215+0000 7f7812ffd700 1 -- 172.21.15.152:0/2670653841 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f780c002060 con 0x7f781412e1c0 2021-02-24T15:27:58.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.215+0000 7f7812ffd700 1 -- 172.21.15.152:0/2670653841 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f780c004a10 con 0x7f781412e1c0 2021-02-24T15:27:58.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.216+0000 7f781a2f4700 1 -- 172.21.15.152:0/2670653841 >> v1:172.21.15.152:6790/0 conn(0x7f781412e1c0 legacy=0x7f78141305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.216+0000 7f781a2f4700 1 -- 172.21.15.152:0/2670653841 shutdown_connections 2021-02-24T15:27:58.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.216+0000 7f781a2f4700 1 -- 172.21.15.152:0/2670653841 >> 172.21.15.152:0/2670653841 conn(0x7f78140999a0 msgr2=0x7f7814099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:58.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.216+0000 7f781a2f4700 1 -- 172.21.15.152:0/2670653841 shutdown_connections 2021-02-24T15:27:58.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.216+0000 7f781a2f4700 1 -- 172.21.15.152:0/2670653841 wait complete. 2021-02-24T15:27:58.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.216+0000 7f781a2f4700 1 librados: starting msgr at 2021-02-24T15:27:58.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.216+0000 7f781a2f4700 1 librados: starting objecter 2021-02-24T15:27:58.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f781a2f4700 1 Processor -- start 2021-02-24T15:27:58.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f781a2f4700 1 -- start start 2021-02-24T15:27:58.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f781a2f4700 1 librados: setting wanted keys 2021-02-24T15:27:58.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f781a2f4700 1 librados: calling monclient init 2021-02-24T15:27:58.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f781a2f4700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781411af30 con 0x7f78140945b0 2021-02-24T15:27:58.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f781a2f4700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781411b1d0 con 0x7f78140939f0 2021-02-24T15:27:58.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f781a2f4700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781411b470 con 0x7f781412e1c0 2021-02-24T15:27:58.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f7818891700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f781412e1c0 0x7f78141426b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37278/0 (socket says 172.21.15.152:37278) 2021-02-24T15:27:58.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f7818891700 1 -- 172.21.15.152:0/1430499444 learned_addr learned my addr 172.21.15.152:0/1430499444 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:58.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.217+0000 7f78137fe700 1 --1- 172.21.15.152:0/1430499444 >> v1:172.21.15.152:6789/0 conn(0x7f78140945b0 0x7f7814117f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48800/0 (socket says 172.21.15.152:48800) 2021-02-24T15:27:58.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.219+0000 7f78137fe700 1 -- 172.21.15.152:0/1430499444 >> v1:172.21.15.152:6789/0 conn(0x7f78140945b0 legacy=0x7f7814117f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f7813fff700 1 -- 172.21.15.152:0/1430499444 >> v1:172.21.15.181:6789/0 conn(0x7f78140939f0 legacy=0x7f78141177f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 10 client.?.objecter ms_handle_connect 0x7f78140945b0 2021-02-24T15:27:58.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:58.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 10 client.?.objecter ms_handle_connect 0x7f78140939f0 2021-02-24T15:27:58.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:58.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 10 client.?.objecter ms_handle_connect 0x7f781412e1c0 2021-02-24T15:27:58.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:58.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f7818891700 1 -- 172.21.15.152:0/1430499444 >> v1:172.21.15.152:6790/0 conn(0x7f781412e1c0 legacy=0x7f78141426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791031668 0 0) 0x7f781411af30 con 0x7f78140945b0 2021-02-24T15:27:58.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f4004bd0 con 0x7f78140945b0 2021-02-24T15:27:58.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731966694 0 0) 0x7f781411b470 con 0x7f781412e1c0 2021-02-24T15:27:58.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f781411af30 con 0x7f781412e1c0 2021-02-24T15:27:58.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1875736127 0 0) 0x7f77f4004bd0 con 0x7f78140945b0 2021-02-24T15:27:58.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f781411b470 con 0x7f78140945b0 2021-02-24T15:27:58.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7808001b10 con 0x7f78140945b0 2021-02-24T15:27:58.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1120910285 0 0) 0x7f781411af30 con 0x7f781412e1c0 2021-02-24T15:27:58.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f77f4004bd0 con 0x7f781412e1c0 2021-02-24T15:27:58.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f780c004a10 con 0x7f781412e1c0 2021-02-24T15:27:58.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1963699543 0 0) 0x7f781411b470 con 0x7f78140945b0 2021-02-24T15:27:58.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 >> v1:172.21.15.152:6790/0 conn(0x7f781412e1c0 legacy=0x7f78141426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.232 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 >> v1:172.21.15.181:6789/0 conn(0x7f78140939f0 legacy=0x7f78141177f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.232 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814119300 con 0x7f78140945b0 2021-02-24T15:27:58.232 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781412de10 con 0x7f78140945b0 2021-02-24T15:27:58.232 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f781a2f4700 10 client.28344.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:27:58.232 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f781411b9f0 con 0x7f78140945b0 2021-02-24T15:27:58.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f781a2f4700 1 librados: init done 2021-02-24T15:27:58.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7808004860 con 0x7f78140945b0 2021-02-24T15:27:58.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.220+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f7808004b70 con 0x7f78140945b0 2021-02-24T15:27:58.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.221+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f7808004d50 con 0x7f78140945b0 2021-02-24T15:27:58.233 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.221+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ec004d60 con 0x7f78140945b0 2021-02-24T15:27:58.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.221+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(465..465 src has 230..465) v4 ==== 6507+0+0 (unknown 535225126 0 0) 0x7f780803b3b0 con 0x7f78140945b0 2021-02-24T15:27:58.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.221+0000 7f77fbfff700 10 client.28344.objecter ms_dispatch 0x7f7814001510 osd_map(465..465 src has 230..465) v4 2021-02-24T15:27:58.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.221+0000 7f77fbfff700 3 client.28344.objecter handle_osd_map got epochs [465,465] > 0 2021-02-24T15:27:58.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.221+0000 7f77fbfff700 3 client.28344.objecter handle_osd_map decoding full epoch 465 2021-02-24T15:27:58.234 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.221+0000 7f77fbfff700 20 client.28344.objecter dump_active .. 0 homeless 2021-02-24T15:27:58.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.224+0000 7f77fbfff700 10 client.28344.objecter ms_handle_connect 0x7f77f40314c0 2021-02-24T15:27:58.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.226+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f7808012430 con 0x7f78140945b0 2021-02-24T15:27:58.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.471+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f77ec005010 con 0x7f78140945b0 2021-02-24T15:27:58.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.472+0000 7f77fbfff700 1 -- 172.21.15.152:0/1430499444 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 3803926854) 0x7f7808012250 con 0x7f78140945b0 2021-02-24T15:27:58.473 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:27:58.475 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.473+0000 7f781a2f4700 10 librados: watch_flush enter 2021-02-24T15:27:58.475 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 10 librados: watch_flush exit 2021-02-24T15:27:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 20 client.28344.objecter shutdown clearing up homeless session... 2021-02-24T15:27:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 10 client.28344.objecter successfully canceled tick 2021-02-24T15:27:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 >> v1:172.21.15.181:6812/33484 conn(0x7f77f40314c0 legacy=0x7f77f4033980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 >> v1:172.21.15.152:6789/0 conn(0x7f78140945b0 legacy=0x7f7814117f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 shutdown_connections 2021-02-24T15:27:58.477 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 >> 172.21.15.152:0/1430499444 conn(0x7f78140999a0 msgr2=0x7f78140666a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:58.477 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 shutdown_connections 2021-02-24T15:27:58.477 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 1 -- 172.21.15.152:0/1430499444 wait complete. 2021-02-24T15:27:58.477 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.474+0000 7f781a2f4700 1 librados: shutdown 2021-02-24T15:27:58.486 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:27:58.487 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:27:58.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.603+0000 7f72c6f90700 1 Processor -- start 2021-02-24T15:27:58.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.603+0000 7f72c6f90700 1 -- start start 2021-02-24T15:27:58.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.603+0000 7f72c6f90700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0092e60 con 0x7f72c0091110 2021-02-24T15:27:58.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.603+0000 7f72c6f90700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0091f30 con 0x7f72c0095930 2021-02-24T15:27:58.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.603+0000 7f72c6f90700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00921d0 con 0x7f72c0094e40 2021-02-24T15:27:58.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.603+0000 7f72c4d2c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f72c0094e40 0x7f72c0092750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37290/0 (socket says 172.21.15.152:37290) 2021-02-24T15:27:58.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.603+0000 7f72bffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f72c0091110 0x7f72c0095220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48810/0 (socket says 172.21.15.152:48810) 2021-02-24T15:27:58.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.603+0000 7f72c4d2c700 1 -- 172.21.15.152:0/470728436 learned_addr learned my addr 172.21.15.152:0/470728436 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:58.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72c4d2c700 1 -- 172.21.15.152:0/470728436 >> v1:172.21.15.152:6790/0 conn(0x7f72c0094e40 legacy=0x7f72c0092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bffff700 1 -- 172.21.15.152:0/470728436 >> v1:172.21.15.152:6789/0 conn(0x7f72c0091110 legacy=0x7f72c0095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72c552d700 1 -- 172.21.15.152:0/470728436 >> v1:172.21.15.181:6789/0 conn(0x7f72c0095930 legacy=0x7f72c012f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659266057 0 0) 0x7f72c0092e60 con 0x7f72c0091110 2021-02-24T15:27:58.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a4003230 con 0x7f72c0091110 2021-02-24T15:27:58.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628827139 0 0) 0x7f72c00921d0 con 0x7f72c0094e40 2021-02-24T15:27:58.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0092e60 con 0x7f72c0094e40 2021-02-24T15:27:58.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1733172877 0 0) 0x7f72a4003230 con 0x7f72c0091110 2021-02-24T15:27:58.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 >> v1:172.21.15.152:6790/0 conn(0x7f72c0094e40 legacy=0x7f72c0092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 >> v1:172.21.15.181:6789/0 conn(0x7f72c0095930 legacy=0x7f72c012f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c0091590 con 0x7f72c0091110 2021-02-24T15:27:58.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.606+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f72ac0019f0 con 0x7f72c0091110 2021-02-24T15:27:58.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.607+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f72ac001d10 con 0x7f72c0091110 2021-02-24T15:27:58.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.607+0000 7f72bf7fe700 1 -- 172.21.15.152:0/470728436 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f72ac004690 con 0x7f72c0091110 2021-02-24T15:27:58.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.607+0000 7f72c6f90700 1 -- 172.21.15.152:0/470728436 >> v1:172.21.15.152:6789/0 conn(0x7f72c0091110 legacy=0x7f72c0095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.607+0000 7f72c6f90700 1 -- 172.21.15.152:0/470728436 shutdown_connections 2021-02-24T15:27:58.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.607+0000 7f72c6f90700 1 -- 172.21.15.152:0/470728436 >> 172.21.15.152:0/470728436 conn(0x7f72c00999a0 msgr2=0x7f72c0099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:58.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.607+0000 7f72c6f90700 1 -- 172.21.15.152:0/470728436 shutdown_connections 2021-02-24T15:27:58.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.607+0000 7f72c6f90700 1 -- 172.21.15.152:0/470728436 wait complete. 2021-02-24T15:27:58.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.608+0000 7f72c6f90700 1 librados: starting msgr at 2021-02-24T15:27:58.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.608+0000 7f72c6f90700 1 librados: starting objecter 2021-02-24T15:27:58.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.608+0000 7f72c6f90700 1 Processor -- start 2021-02-24T15:27:58.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.608+0000 7f72c6f90700 1 -- start start 2021-02-24T15:27:58.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.608+0000 7f72c6f90700 1 librados: setting wanted keys 2021-02-24T15:27:58.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.608+0000 7f72c6f90700 1 librados: calling monclient init 2021-02-24T15:27:58.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.609+0000 7f72c6f90700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0130100 con 0x7f72c0095930 2021-02-24T15:27:58.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.609+0000 7f72c6f90700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0115340 con 0x7f72c0094e40 2021-02-24T15:27:58.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.609+0000 7f72c6f90700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0117130 con 0x7f72c0091110 2021-02-24T15:27:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.609+0000 7f72c4d2c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f72c0091110 0x7f72c0132960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37292/0 (socket says 172.21.15.152:37292) 2021-02-24T15:27:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.609+0000 7f72c4d2c700 1 -- 172.21.15.152:0/3853742643 learned_addr learned my addr 172.21.15.152:0/3853742643 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72c4d2c700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6790/0 conn(0x7f72c0091110 legacy=0x7f72c0132960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 10 client.?.objecter ms_handle_connect 0x7f72c0091110 2021-02-24T15:27:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:58.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 10 client.?.objecter ms_handle_connect 0x7f72c0095930 2021-02-24T15:27:58.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:58.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72c552d700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6789/0 conn(0x7f72c0095930 legacy=0x7f72c01400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 10 client.?.objecter ms_handle_connect 0x7f72c0094e40 2021-02-24T15:27:58.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bffff700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.181:6789/0 conn(0x7f72c0094e40 legacy=0x7f72c012f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:58.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777582054 0 0) 0x7f72c0117130 con 0x7f72c0091110 2021-02-24T15:27:58.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a0004bd0 con 0x7f72c0091110 2021-02-24T15:27:58.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584596607 0 0) 0x7f72c0130100 con 0x7f72c0095930 2021-02-24T15:27:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0117130 con 0x7f72c0095930 2021-02-24T15:27:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856143527 0 0) 0x7f72c0115340 con 0x7f72c0094e40 2021-02-24T15:27:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0130100 con 0x7f72c0094e40 2021-02-24T15:27:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3231541976 0 0) 0x7f72a0004bd0 con 0x7f72c0091110 2021-02-24T15:27:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72c0115340 con 0x7f72c0091110 2021-02-24T15:27:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f72b4001580 con 0x7f72c0091110 2021-02-24T15:27:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2484366306 0 0) 0x7f72c0117130 con 0x7f72c0095930 2021-02-24T15:27:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72a0004bd0 con 0x7f72c0095930 2021-02-24T15:27:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 378530077 0 0) 0x7f72c0130100 con 0x7f72c0094e40 2021-02-24T15:27:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72c0117130 con 0x7f72c0094e40 2021-02-24T15:27:58.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f72b8001f20 con 0x7f72c0095930 2021-02-24T15:27:58.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.611+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f72ac004690 con 0x7f72c0094e40 2021-02-24T15:27:58.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1629854762 0 0) 0x7f72c0115340 con 0x7f72c0091110 2021-02-24T15:27:58.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.181:6789/0 conn(0x7f72c0094e40 legacy=0x7f72c012f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6789/0 conn(0x7f72c0095930 legacy=0x7f72c01400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c01173d0 con 0x7f72c0091110 2021-02-24T15:27:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c0067a50 con 0x7f72c0091110 2021-02-24T15:27:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72c6f90700 10 client.84287.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:27:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c0114710 con 0x7f72c0091110 2021-02-24T15:27:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72c6f90700 1 librados: init done 2021-02-24T15:27:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f72b40048e0 con 0x7f72c0091110 2021-02-24T15:27:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f72b4004bf0 con 0x7f72c0091110 2021-02-24T15:27:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f72b4004dd0 con 0x7f72c0091110 2021-02-24T15:27:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f72c0058400 con 0x7f72c0110000 2021-02-24T15:27:58.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(465..465 src has 230..465) v4 ==== 6507+0+0 (unknown 535225126 0 0) 0x7f72b403b5b0 con 0x7f72c0091110 2021-02-24T15:27:58.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 10 client.84287.objecter ms_dispatch 0x7f72c0001510 osd_map(465..465 src has 230..465) v4 2021-02-24T15:27:58.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 3 client.84287.objecter handle_osd_map got epochs [465,465] > 0 2021-02-24T15:27:58.627 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.612+0000 7f72bcff9700 3 client.84287.objecter handle_osd_map decoding full epoch 465 2021-02-24T15:27:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.613+0000 7f72bcff9700 20 client.84287.objecter dump_active .. 0 homeless 2021-02-24T15:27:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 10 client.84287.objecter ms_handle_connect 0x7f72c0110000 2021-02-24T15:27:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 10 client.84287.objecter resend_mon_ops 2021-02-24T15:27:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bffff700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6789/0 conn(0x7f72c0110000 legacy=0x7f72c01103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397252011 0 0) 0x7f72c0058400 con 0x7f72c0110000 2021-02-24T15:27:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0115340 con 0x7f72c0110000 2021-02-24T15:27:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 10 client.84287.objecter ms_handle_connect 0x7f72a0031700 2021-02-24T15:27:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 624679458 0 0) 0x7f72c0115340 con 0x7f72c0110000 2021-02-24T15:27:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72c0058400 con 0x7f72c0110000 2021-02-24T15:27:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f72ac005240 con 0x7f72c0110000 2021-02-24T15:27:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2075360783 0 0) 0x7f72c0058400 con 0x7f72c0110000 2021-02-24T15:27:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72c0044c90 con 0x7f72c0110000 2021-02-24T15:27:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f72ac0054f0 con 0x7f72c0110000 2021-02-24T15:27:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6789/0 conn(0x7f72c0110000 legacy=0x7f72c01103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.615+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6789/0 conn(0x7f72c0110000 legacy=0x7f72c01103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:58.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.623+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f72c005d530 con 0x7f72c0027010 2021-02-24T15:27:58.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bffff700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6789/0 conn(0x7f72c0027010 legacy=0x7f72c01457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 10 client.84287.objecter ms_handle_connect 0x7f72c0027010 2021-02-24T15:27:58.634 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 10 client.84287.objecter resend_mon_ops 2021-02-24T15:27:58.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230530285 0 0) 0x7f72c005d530 con 0x7f72c0027010 2021-02-24T15:27:58.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0058400 con 0x7f72c0027010 2021-02-24T15:27:58.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3672622910 0 0) 0x7f72c0058400 con 0x7f72c0027010 2021-02-24T15:27:58.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72c005d530 con 0x7f72c0027010 2021-02-24T15:27:58.635 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f72ac005be0 con 0x7f72c0027010 2021-02-24T15:27:58.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3008711991 0 0) 0x7f72c005d530 con 0x7f72c0027010 2021-02-24T15:27:58.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f72c01149c0 con 0x7f72c0027010 2021-02-24T15:27:58.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4112 (unknown 0 0 2789025711) 0x7f72ac005dc0 con 0x7f72c0027010 2021-02-24T15:27:58.636 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6789/0 conn(0x7f72c0027010 legacy=0x7f72c01457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.626+0000 7f72bcff9700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6789/0 conn(0x7f72c0027010 legacy=0x7f72c01457f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:58.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 10 librados: watch_flush enter 2021-02-24T15:27:58.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 10 librados: watch_flush exit 2021-02-24T15:27:58.637 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 20 client.84287.objecter shutdown clearing up homeless session... 2021-02-24T15:27:58.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 10 client.84287.objecter successfully canceled tick 2021-02-24T15:27:58.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.181:6812/33484 conn(0x7f72a0031700 legacy=0x7f72a0033bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 >> v1:172.21.15.152:6790/0 conn(0x7f72c0091110 legacy=0x7f72c0132960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c552d700 1 -- 172.21.15.152:0/3853742643 reap_dead start 2021-02-24T15:27:58.638 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c552d700 1 -- 172.21.15.152:0/3853742643 reap_dead start 2021-02-24T15:27:58.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 shutdown_connections 2021-02-24T15:27:58.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 >> 172.21.15.152:0/3853742643 conn(0x7f72c00999a0 msgr2=0x7f72c0064930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:58.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 shutdown_connections 2021-02-24T15:27:58.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 1 -- 172.21.15.152:0/3853742643 wait complete. 2021-02-24T15:27:58.639 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.627+0000 7f72c6f90700 1 librados: shutdown 2021-02-24T15:27:58.640 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:27:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:27:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:27:58.640 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:27:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 56, 2021-02-24T15:27:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:27:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:27:58.641 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:27:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:27:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:27:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:27:58.642 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:27:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:27:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:27:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:27:58.643 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:27:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:27:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:27:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:27:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:27:58.644 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:27:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:27:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:27:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:27:58.645 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:27:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:27:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:27:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:27:58.646 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:27:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:27:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:27:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:27:58.647 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:27:58.651 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.651 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:27:58.652 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:27:58.652 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:27:58.652 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:27:58.652 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:27:58.653 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:27:58.654 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:27:58.654 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:27:58.655 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:27:58.655 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:27:58.655 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:27:58.655 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:27:58.656 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:27:58.656 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:27:58.657 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:27:58.657 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:27:58.657 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:27:58.657 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:27:58.657 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:27:58.658 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:27:58.658 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:27:58.658 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:27:58.658 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:27:58.659 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:27:58.659 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.659 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:27:58.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.659 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:27:58.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.660 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:27:58.660 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:27:58.660 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:27:58.660 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:27:58.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.661 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:27:58.661 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:27:58.661 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:27:58.662 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.662 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.662 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:27:58.662 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:27:58.663 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:27:58.663 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:27:58.663 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:27:58.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.664 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:27:58.664 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:27:58.664 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:27:58.664 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:27:58.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.665 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:27:58.665 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:27:58.665 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:27:58.665 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.666 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.666 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:27:58.666 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:27:58.666 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:27:58.667 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:27:58.667 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:27:58.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.668 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:27:58.668 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:27:58.668 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:27:58.668 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:27:58.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.669 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:27:58.669 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:27:58.669 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:27:58.669 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.669 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.670 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:27:58.670 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:27:58.670 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:27:58.671 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:27:58.671 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:27:58.671 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.671 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.672 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:27:58.673 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:27:58.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.673 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:27:58.674 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:27:58.674 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:27:58.674 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.674 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.675 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:27:58.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.675 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:27:58.675 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:27:58.675 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:27:58.676 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.676 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.676 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:27:58.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.676 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:27:58.677 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:27:58.677 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:27:58.677 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.677 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.678 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:27:58.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.678 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:27:58.678 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:27:58.678 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:27:58.679 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.679 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.679 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:27:58.680 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:27:58.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:27:58.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.797+0000 7fbaf7fcf700 1 Processor -- start 2021-02-24T15:27:58.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.797+0000 7fbaf7fcf700 1 -- start start 2021-02-24T15:27:58.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.798+0000 7fbaf7fcf700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf0092e60 con 0x7fbaf0094e40 2021-02-24T15:27:58.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.798+0000 7fbaf7fcf700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf0091f30 con 0x7fbaf0095930 2021-02-24T15:27:58.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.798+0000 7fbaf7fcf700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf00921d0 con 0x7fbaf0091110 2021-02-24T15:27:58.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.798+0000 7fbaf556a700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fbaf0091110 0x7fbaf0095220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37306/0 (socket says 172.21.15.152:37306) 2021-02-24T15:27:58.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.798+0000 7fbaf5d6b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbaf0094e40 0x7fbaf0092750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48828/0 (socket says 172.21.15.152:48828) 2021-02-24T15:27:58.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.798+0000 7fbaf556a700 1 -- 172.21.15.152:0/3355361006 learned_addr learned my addr 172.21.15.152:0/3355361006 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:58.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.800+0000 7fbaf556a700 1 -- 172.21.15.152:0/3355361006 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0091110 legacy=0x7fbaf0095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.803 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.800+0000 7fbaf5d6b700 1 -- 172.21.15.152:0/3355361006 >> v1:172.21.15.152:6789/0 conn(0x7fbaf0094e40 legacy=0x7fbaf0092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.800+0000 7fbaf656c700 1 -- 172.21.15.152:0/3355361006 >> v1:172.21.15.181:6789/0 conn(0x7fbaf0095930 legacy=0x7fbaf012f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.800+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772068027 0 0) 0x7fbaf0092e60 con 0x7fbaf0094e40 2021-02-24T15:27:58.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.800+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad8003230 con 0x7fbaf0094e40 2021-02-24T15:27:58.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.800+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008723318 0 0) 0x7fbaf00921d0 con 0x7fbaf0091110 2021-02-24T15:27:58.804 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.800+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0092e60 con 0x7fbaf0091110 2021-02-24T15:27:58.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.800+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874252262 0 0) 0x7fbaf0091f30 con 0x7fbaf0095930 2021-02-24T15:27:58.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.800+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf00921d0 con 0x7fbaf0095930 2021-02-24T15:27:58.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf656c700 1 -- 172.21.15.152:0/3355361006 >> v1:172.21.15.181:6789/0 conn(0x7fbaf0095930 legacy=0x7fbaf012f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2021-02-24T15:27:58.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf656c700 1 -- 172.21.15.152:0/3355361006 >> v1:172.21.15.181:6789/0 conn(0x7fbaf0095930 legacy=0x7fbaf012f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:27:58.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf656c700 1 --1- 172.21.15.152:0/3355361006 >> v1:172.21.15.181:6789/0 conn(0x7fbaf0095930 0x7fbaf012f5e0 :-1 s=OPENED pgs=812 cs=1 l=1).handle_message read tag failed 2021-02-24T15:27:58.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf656c700 1 --1- 172.21.15.152:0/3355361006 >> v1:172.21.15.181:6789/0 conn(0x7fbaf0095930 0x7fbaf012f5e0 :-1 s=OPENED pgs=812 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:27:58.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3257718600 0 0) 0x7fbad8003230 con 0x7fbaf0094e40 2021-02-24T15:27:58.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0091110 legacy=0x7fbaf0095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 >> v1:172.21.15.181:6789/0 conn(0x7fbaf0095930 legacy=0x7fbaf012f5e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:58.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf0091590 con 0x7fbaf0094e40 2021-02-24T15:27:58.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbaec0019f0 con 0x7fbaf0094e40 2021-02-24T15:27:58.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbaec001c50 con 0x7fbaf0094e40 2021-02-24T15:27:58.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf4d69700 1 -- 172.21.15.152:0/3355361006 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbaec004690 con 0x7fbaf0094e40 2021-02-24T15:27:58.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/3355361006 >> v1:172.21.15.152:6789/0 conn(0x7fbaf0094e40 legacy=0x7fbaf0092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/3355361006 shutdown_connections 2021-02-24T15:27:58.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/3355361006 >> 172.21.15.152:0/3355361006 conn(0x7fbaf00999a0 msgr2=0x7fbaf0099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:58.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/3355361006 shutdown_connections 2021-02-24T15:27:58.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.801+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/3355361006 wait complete. 2021-02-24T15:27:58.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.802+0000 7fbaf7fcf700 1 librados: starting msgr at 2021-02-24T15:27:58.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.802+0000 7fbaf7fcf700 1 librados: starting objecter 2021-02-24T15:27:58.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.802+0000 7fbaf7fcf700 1 Processor -- start 2021-02-24T15:27:58.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.802+0000 7fbaf7fcf700 1 -- start start 2021-02-24T15:27:58.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.802+0000 7fbaf7fcf700 1 librados: setting wanted keys 2021-02-24T15:27:58.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.802+0000 7fbaf7fcf700 1 librados: calling monclient init 2021-02-24T15:27:58.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.803+0000 7fbaf7fcf700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf0139b10 con 0x7fbaf0094e40 2021-02-24T15:27:58.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.803+0000 7fbaf7fcf700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf0134610 con 0x7fbaf0095930 2021-02-24T15:27:58.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.803+0000 7fbaf7fcf700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf0067260 con 0x7fbaf0091110 2021-02-24T15:27:58.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.803+0000 7fbaf5d6b700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fbaf0091110 0x7fbaf0139400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37310/0 (socket says 172.21.15.152:37310) 2021-02-24T15:27:58.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.803+0000 7fbaf556a700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbaf0094e40 0x7fbaf0133f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48836/0 (socket says 172.21.15.152:48836) 2021-02-24T15:27:58.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.803+0000 7fbaf5d6b700 1 -- 172.21.15.152:0/1567756618 learned_addr learned my addr 172.21.15.152:0/1567756618 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:58.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaf5d6b700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0091110 legacy=0x7fbaf0139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaf556a700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6789/0 conn(0x7fbaf0094e40 legacy=0x7fbaf0133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 10 client.?.objecter ms_handle_connect 0x7fbaf0091110 2021-02-24T15:27:58.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:58.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 10 client.?.objecter ms_handle_connect 0x7fbaf0094e40 2021-02-24T15:27:58.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:58.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 10 client.?.objecter ms_handle_connect 0x7fbaf0095930 2021-02-24T15:27:58.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaf656c700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.181:6789/0 conn(0x7fbaf0095930 legacy=0x7fbaf01422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:58.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947076174 0 0) 0x7fbaf0067260 con 0x7fbaf0091110 2021-02-24T15:27:58.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad0004bd0 con 0x7fbaf0091110 2021-02-24T15:27:58.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226217580 0 0) 0x7fbaf0139b10 con 0x7fbaf0094e40 2021-02-24T15:27:58.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0067260 con 0x7fbaf0094e40 2021-02-24T15:27:58.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915256929 0 0) 0x7fbaf0134610 con 0x7fbaf0095930 2021-02-24T15:27:58.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0139b10 con 0x7fbaf0095930 2021-02-24T15:27:58.819 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2844963478 0 0) 0x7fbad0004bd0 con 0x7fbaf0091110 2021-02-24T15:27:58.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbaf0134610 con 0x7fbaf0091110 2021-02-24T15:27:58.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbaec004690 con 0x7fbaf0091110 2021-02-24T15:27:58.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 793986472 0 0) 0x7fbaf0139b10 con 0x7fbaf0095930 2021-02-24T15:27:58.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbad0004bd0 con 0x7fbaf0095930 2021-02-24T15:27:58.820 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 344251795 0 0) 0x7fbaf0067260 con 0x7fbaf0094e40 2021-02-24T15:27:58.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbaf0139b10 con 0x7fbaf0094e40 2021-02-24T15:27:58.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbae8002060 con 0x7fbaf0095930 2021-02-24T15:27:58.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbae0001c60 con 0x7fbaf0094e40 2021-02-24T15:27:58.821 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2639176909 0 0) 0x7fbaf0134610 con 0x7fbaf0091110 2021-02-24T15:27:58.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.181:6789/0 conn(0x7fbaf0095930 legacy=0x7fbaf01422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6789/0 conn(0x7fbaf0094e40 legacy=0x7fbaf0133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf0067a90 con 0x7fbaf0091110 2021-02-24T15:27:58.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.805+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf0114970 con 0x7fbaf0091110 2021-02-24T15:27:58.822 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbaec004cb0 con 0x7fbaf0091110 2021-02-24T15:27:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbaec004fc0 con 0x7fbaf0091110 2021-02-24T15:27:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaf7fcf700 10 client.84293.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:27:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf011a4d0 con 0x7fbaf0091110 2021-02-24T15:27:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaf7fcf700 1 librados: init done 2021-02-24T15:27:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fbaec00dac0 con 0x7fbaf0091110 2021-02-24T15:27:58.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(465..465 src has 230..465) v4 ==== 6507+0+0 (unknown 535225126 0 0) 0x7fbaec03b550 con 0x7fbaf0091110 2021-02-24T15:27:58.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaddffb700 10 client.84293.objecter ms_dispatch 0x7fbaf0001510 osd_map(465..465 src has 230..465) v4 2021-02-24T15:27:58.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaddffb700 3 client.84293.objecter handle_osd_map got epochs [465,465] > 0 2021-02-24T15:27:58.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaddffb700 3 client.84293.objecter handle_osd_map decoding full epoch 465 2021-02-24T15:27:58.824 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbaf01153e0 con 0x7fbaf0110000 2021-02-24T15:27:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.806+0000 7fbaddffb700 20 client.84293.objecter dump_active .. 0 homeless 2021-02-24T15:27:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 10 client.84293.objecter ms_handle_connect 0x7fbaf0110000 2021-02-24T15:27:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaf656c700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0110000 legacy=0x7fbaf01103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 10 client.84293.objecter resend_mon_ops 2021-02-24T15:27:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653196825 0 0) 0x7fbaf01153e0 con 0x7fbaf0110000 2021-02-24T15:27:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0134610 con 0x7fbaf0110000 2021-02-24T15:27:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 10 client.84293.objecter ms_handle_connect 0x7fbad00319e0 2021-02-24T15:27:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2320091016 0 0) 0x7fbaf0134610 con 0x7fbaf0110000 2021-02-24T15:27:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbaf01153e0 con 0x7fbaf0110000 2021-02-24T15:27:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbae8002740 con 0x7fbaf0110000 2021-02-24T15:27:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3486765111 0 0) 0x7fbaf01153e0 con 0x7fbaf0110000 2021-02-24T15:27:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbaf0114b60 con 0x7fbaf0110000 2021-02-24T15:27:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaf656c700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0110000 legacy=0x7fbaf01103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-02-24T15:27:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaf656c700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0110000 legacy=0x7fbaf01103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:27:58.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaf656c700 1 --1- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0110000 0x7fbaf01103e0 :-1 s=OPENED pgs=8486 cs=1 l=1).handle_message read tag failed 2021-02-24T15:27:58.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaf656c700 1 --1- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0110000 0x7fbaf01103e0 :-1 s=OPENED pgs=8486 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:27:58.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0110000 legacy=0x7fbaf01103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:58.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0110000 legacy=0x7fbaf01103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:58.828 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.809+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbaf01153e0 con 0x7fbad003d050 2021-02-24T15:27:58.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.811+0000 7fbaf656c700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbad003d050 legacy=0x7fbad003d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.811+0000 7fbaddffb700 10 client.84293.objecter ms_handle_connect 0x7fbad003d050 2021-02-24T15:27:58.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.811+0000 7fbaddffb700 10 client.84293.objecter resend_mon_ops 2021-02-24T15:27:58.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145533695 0 0) 0x7fbaf01153e0 con 0x7fbad003d050 2021-02-24T15:27:58.829 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0134610 con 0x7fbad003d050 2021-02-24T15:27:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 935340917 0 0) 0x7fbaf0134610 con 0x7fbad003d050 2021-02-24T15:27:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbaf01153e0 con 0x7fbad003d050 2021-02-24T15:27:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbae8003000 con 0x7fbad003d050 2021-02-24T15:27:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1382836917 0 0) 0x7fbaf01153e0 con 0x7fbad003d050 2021-02-24T15:27:58.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbad003db40 con 0x7fbad003d050 2021-02-24T15:27:58.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fbae80078b0 con 0x7fbad003d050 2021-02-24T15:27:58.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbad003d050 legacy=0x7fbad003d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.831 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.812+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbad003d050 legacy=0x7fbad003d430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:58.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.820+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fbaf0058400 con 0x7fbaf0027010 2021-02-24T15:27:58.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.822+0000 7fbaf656c700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0027010 legacy=0x7fbaf0147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.822+0000 7fbaddffb700 10 client.84293.objecter ms_handle_connect 0x7fbaf0027010 2021-02-24T15:27:58.834 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.822+0000 7fbaddffb700 10 client.84293.objecter resend_mon_ops 2021-02-24T15:27:58.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177162758 0 0) 0x7fbaf0058400 con 0x7fbaf0027010 2021-02-24T15:27:58.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf01153e0 con 0x7fbaf0027010 2021-02-24T15:27:58.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 235644470 0 0) 0x7fbaf01153e0 con 0x7fbaf0027010 2021-02-24T15:27:58.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbaf0058400 con 0x7fbaf0027010 2021-02-24T15:27:58.835 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fbae8005d50 con 0x7fbaf0027010 2021-02-24T15:27:58.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 734375990 0 0) 0x7fbaf0058400 con 0x7fbaf0027010 2021-02-24T15:27:58.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbaf0044c90 con 0x7fbaf0027010 2021-02-24T15:27:58.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3940 (unknown 0 0 3761864431) 0x7fbae8007aa0 con 0x7fbaf0027010 2021-02-24T15:27:58.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0027010 legacy=0x7fbaf0147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.836 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaddffb700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0027010 legacy=0x7fbaf0147a30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:58.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaf656c700 1 -- 172.21.15.152:0/1567756618 reap_dead start 2021-02-24T15:27:58.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaf7fcf700 10 librados: watch_flush enter 2021-02-24T15:27:58.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaf7fcf700 10 librados: watch_flush exit 2021-02-24T15:27:58.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaf7fcf700 20 client.84293.objecter shutdown clearing up homeless session... 2021-02-24T15:27:58.837 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.823+0000 7fbaf7fcf700 10 client.84293.objecter successfully canceled tick 2021-02-24T15:27:58.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.824+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.181:6812/33484 conn(0x7fbad00319e0 legacy=0x7fbad0033ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.824+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 >> v1:172.21.15.152:6790/0 conn(0x7fbaf0091110 legacy=0x7fbaf0139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:58.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.824+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 shutdown_connections 2021-02-24T15:27:58.838 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.824+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 >> 172.21.15.152:0/1567756618 conn(0x7fbaf00999a0 msgr2=0x7fbaf0064930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:58.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.824+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 shutdown_connections 2021-02-24T15:27:58.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.824+0000 7fbaf7fcf700 1 -- 172.21.15.152:0/1567756618 wait complete. 2021-02-24T15:27:58.839 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.824+0000 7fbaf7fcf700 1 librados: shutdown 2021-02-24T15:27:58.839 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:27:58.840 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:27:58.840 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:27:58.840 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:27:58.840 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 56, 2021-02-24T15:27:58.840 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:27:58.841 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:27:58.841 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:27:58.841 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:27:58.841 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.841 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:27:58.842 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:27:58.842 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:27:58.842 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:27:58.842 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:27:58.842 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:27:58.843 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:27:58.843 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:27:58.843 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:27:58.843 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:27:58.844 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:27:58.844 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:27:58.844 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:27:58.845 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.845 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:27:58.845 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:27:58.845 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:27:58.845 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:27:58.846 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:27:58.846 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:27:58.846 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:27:58.846 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:27:58.846 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:27:58.847 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:27:58.847 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:27:58.847 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.848 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:27:58.848 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:27:58.848 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:27:58.848 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:27:58.848 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:27:58.849 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:27:58.849 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:27:58.849 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:27:58.849 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:27:58.849 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:27:58.850 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:27:58.850 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:27:58.850 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:27:58.850 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:27:58.850 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:27:58.851 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:27:58.851 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:27:58.851 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:27:58.851 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:27:58.852 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:27:58.852 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:27:58.852 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:27:58.852 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:27:58.852 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:27:58.853 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.853 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:27:58.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.853 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:27:58.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.854 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:27:58.854 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:27:58.854 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:27:58.854 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:27:58.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.855 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:27:58.855 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:27:58.855 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:27:58.855 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.855 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.856 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:27:58.856 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:27:58.856 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:27:58.857 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:27:58.857 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:27:58.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.857 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:27:58.858 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:27:58.858 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:27:58.858 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:27:58.858 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.858 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:27:58.859 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:27:58.859 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:27:58.859 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.859 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.860 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:27:58.860 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:27:58.860 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:27:58.860 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:27:58.861 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:27:58.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.861 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:27:58.861 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:27:58.862 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:27:58.862 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:27:58.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.862 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:27:58.862 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:27:58.863 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:27:58.863 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.863 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.863 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:27:58.864 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:27:58.864 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:27:58.864 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:27:58.864 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:27:58.864 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.865 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.865 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:27:58.865 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:27:58.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.866 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:27:58.866 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:27:58.867 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:27:58.867 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.867 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.867 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:27:58.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.868 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:27:58.868 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:27:58.868 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:27:58.868 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.869 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:58.869 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:27:58.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:58.870 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:27:58.870 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:27:58.870 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:27:58.871 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:58.871 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:58.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:58.871 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:27:58.871 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:27:58.873 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:27:58.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.991+0000 7fd185a6f700 1 Processor -- start 2021-02-24T15:27:58.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.991+0000 7fd185a6f700 1 -- start start 2021-02-24T15:27:58.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.992+0000 7fd185a6f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1800922a0 con 0x7fd1800945b0 2021-02-24T15:27:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.992+0000 7fd185a6f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd180092540 con 0x7fd18012e1c0 2021-02-24T15:27:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.992+0000 7fd185a6f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1800927e0 con 0x7fd1800939f0 2021-02-24T15:27:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.992+0000 7fd17f7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd1800945b0 0x7fd18008fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48848/0 (socket says 172.21.15.152:48848) 2021-02-24T15:27:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.992+0000 7fd17effd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fd1800939f0 0x7fd180090130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37328/0 (socket says 172.21.15.152:37328) 2021-02-24T15:27:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.992+0000 7fd17f7fe700 1 -- 172.21.15.152:0/913980300 learned_addr learned my addr 172.21.15.152:0/913980300 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:58.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.994+0000 7fd17f7fe700 1 -- 172.21.15.152:0/913980300 >> v1:172.21.15.152:6789/0 conn(0x7fd1800945b0 legacy=0x7fd18008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.994+0000 7fd17effd700 1 -- 172.21.15.152:0/913980300 >> v1:172.21.15.152:6790/0 conn(0x7fd1800939f0 legacy=0x7fd180090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.994+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260555746 0 0) 0x7fd1800922a0 con 0x7fd1800945b0 2021-02-24T15:27:58.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.994+0000 7fd17ffff700 1 -- 172.21.15.152:0/913980300 >> v1:172.21.15.181:6789/0 conn(0x7fd18012e1c0 legacy=0x7fd1801305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:58.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.994+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd16c003230 con 0x7fd1800945b0 2021-02-24T15:27:59.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.994+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732916574 0 0) 0x7fd1800927e0 con 0x7fd1800939f0 2021-02-24T15:27:59.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.994+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1800922a0 con 0x7fd1800939f0 2021-02-24T15:27:59.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 445015974 0 0) 0x7fd1800922a0 con 0x7fd1800939f0 2021-02-24T15:27:59.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 >> v1:172.21.15.181:6789/0 conn(0x7fd18012e1c0 legacy=0x7fd1801305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 >> v1:172.21.15.152:6789/0 conn(0x7fd1800945b0 legacy=0x7fd18008fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180092a80 con 0x7fd1800939f0 2021-02-24T15:27:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd174001970 con 0x7fd1800939f0 2021-02-24T15:27:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd174001c20 con 0x7fd1800939f0 2021-02-24T15:27:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd17e7fc700 1 -- 172.21.15.152:0/913980300 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd174004690 con 0x7fd1800939f0 2021-02-24T15:27:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd185a6f700 1 -- 172.21.15.152:0/913980300 >> v1:172.21.15.152:6790/0 conn(0x7fd1800939f0 legacy=0x7fd180090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd185a6f700 1 -- 172.21.15.152:0/913980300 shutdown_connections 2021-02-24T15:27:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd185a6f700 1 -- 172.21.15.152:0/913980300 >> 172.21.15.152:0/913980300 conn(0x7fd1800999a0 msgr2=0x7fd180099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd185a6f700 1 -- 172.21.15.152:0/913980300 shutdown_connections 2021-02-24T15:27:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.995+0000 7fd185a6f700 1 -- 172.21.15.152:0/913980300 wait complete. 2021-02-24T15:27:59.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.996+0000 7fd185a6f700 1 librados: starting msgr at 2021-02-24T15:27:59.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.996+0000 7fd185a6f700 1 librados: starting objecter 2021-02-24T15:27:59.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.996+0000 7fd185a6f700 1 Processor -- start 2021-02-24T15:27:59.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.996+0000 7fd185a6f700 1 -- start start 2021-02-24T15:27:59.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.996+0000 7fd185a6f700 1 librados: setting wanted keys 2021-02-24T15:27:59.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.996+0000 7fd185a6f700 1 librados: calling monclient init 2021-02-24T15:27:59.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.997+0000 7fd185a6f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1800959a0 con 0x7fd1800939f0 2021-02-24T15:27:59.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.997+0000 7fd185a6f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd180117260 con 0x7fd1800945b0 2021-02-24T15:27:59.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.997+0000 7fd185a6f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1800917d0 con 0x7fd18012e1c0 2021-02-24T15:27:59.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.997+0000 7fd17f7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd1800939f0 0x7fd180129820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48854/0 (socket says 172.21.15.152:48854) 2021-02-24T15:27:59.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.997+0000 7fd17f7fe700 1 -- 172.21.15.152:0/2387547805 learned_addr learned my addr 172.21.15.152:0/2387547805 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:59.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd17ffff700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.152:6790/0 conn(0x7fd18012e1c0 legacy=0x7fd180142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd17f7fe700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.152:6789/0 conn(0x7fd1800939f0 legacy=0x7fd180129820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 10 client.?.objecter ms_handle_connect 0x7fd18012e1c0 2021-02-24T15:27:59.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:59.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 10 client.?.objecter ms_handle_connect 0x7fd1800939f0 2021-02-24T15:27:59.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:59.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 10 client.?.objecter ms_handle_connect 0x7fd1800945b0 2021-02-24T15:27:59.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:59.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd17effd700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1800945b0 legacy=0x7fd18013eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193337433 0 0) 0x7fd1800959a0 con 0x7fd1800939f0 2021-02-24T15:27:59.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd160004bd0 con 0x7fd1800939f0 2021-02-24T15:27:59.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194578093 0 0) 0x7fd1800917d0 con 0x7fd18012e1c0 2021-02-24T15:27:59.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1800959a0 con 0x7fd18012e1c0 2021-02-24T15:27:59.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921623004 0 0) 0x7fd180117260 con 0x7fd1800945b0 2021-02-24T15:27:59.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1800917d0 con 0x7fd1800945b0 2021-02-24T15:27:59.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1991296373 0 0) 0x7fd160004bd0 con 0x7fd1800939f0 2021-02-24T15:27:59.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd180117260 con 0x7fd1800939f0 2021-02-24T15:27:59.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd170001c60 con 0x7fd1800939f0 2021-02-24T15:27:59.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3665619079 0 0) 0x7fd1800959a0 con 0x7fd18012e1c0 2021-02-24T15:27:59.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd160004bd0 con 0x7fd18012e1c0 2021-02-24T15:27:59.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd178001f20 con 0x7fd18012e1c0 2021-02-24T15:27:59.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:58.999+0000 7fd17effd700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1800945b0 legacy=0x7fd18013eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-24T15:27:59.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd17effd700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1800945b0 legacy=0x7fd18013eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:27:59.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd17effd700 1 --1- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1800945b0 0x7fd18013eed0 :-1 s=OPENED pgs=815 cs=1 l=1).handle_message read tag failed 2021-02-24T15:27:59.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd17effd700 1 --1- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1800945b0 0x7fd18013eed0 :-1 s=OPENED pgs=815 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:27:59.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1028882568 0 0) 0x7fd1800917d0 con 0x7fd1800945b0 2021-02-24T15:27:59.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd1800959a0 con 0x7fd1800945b0 2021-02-24T15:27:59.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2081207823 0 0) 0x7fd180117260 con 0x7fd1800939f0 2021-02-24T15:27:59.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.152:6790/0 conn(0x7fd18012e1c0 legacy=0x7fd180142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1800945b0 legacy=0x7fd18013eed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:59.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1801119f0 con 0x7fd1800939f0 2021-02-24T15:27:59.017 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd180129f30 con 0x7fd1800939f0 2021-02-24T15:27:59.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd185a6f700 10 client.28368.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:27:59.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd180095080 con 0x7fd1800939f0 2021-02-24T15:27:59.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd185a6f700 1 librados: init done 2021-02-24T15:27:59.018 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd170004860 con 0x7fd1800939f0 2021-02-24T15:27:59.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd170004b70 con 0x7fd1800939f0 2021-02-24T15:27:59.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd158006550 con 0x7fd1580027f0 2021-02-24T15:27:59.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.000+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fd17000d6f0 con 0x7fd1800939f0 2021-02-24T15:27:59.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.001+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(466..466 src has 230..466) v4 ==== 6507+0+0 (unknown 3263780985 0 0) 0x7fd17003b580 con 0x7fd1800939f0 2021-02-24T15:27:59.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.001+0000 7fd1677fe700 10 client.28368.objecter ms_dispatch 0x7fd180001510 osd_map(466..466 src has 230..466) v4 2021-02-24T15:27:59.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.001+0000 7fd1677fe700 3 client.28368.objecter handle_osd_map got epochs [466,466] > 0 2021-02-24T15:27:59.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.001+0000 7fd1677fe700 3 client.28368.objecter handle_osd_map decoding full epoch 466 2021-02-24T15:27:59.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.001+0000 7fd1677fe700 20 client.28368.objecter dump_active .. 0 homeless 2021-02-24T15:27:59.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 10 client.28368.objecter ms_handle_connect 0x7fd1580027f0 2021-02-24T15:27:59.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 10 client.28368.objecter resend_mon_ops 2021-02-24T15:27:59.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd17effd700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1580027f0 legacy=0x7fd158004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218555717 0 0) 0x7fd158006550 con 0x7fd1580027f0 2021-02-24T15:27:59.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd180117260 con 0x7fd1580027f0 2021-02-24T15:27:59.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2103318652 0 0) 0x7fd180117260 con 0x7fd1580027f0 2021-02-24T15:27:59.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd158006550 con 0x7fd1580027f0 2021-02-24T15:27:59.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 10 client.28368.objecter ms_handle_connect 0x7fd1600317c0 2021-02-24T15:27:59.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd174004b60 con 0x7fd1580027f0 2021-02-24T15:27:59.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2500681979 0 0) 0x7fd158006550 con 0x7fd1580027f0 2021-02-24T15:27:59.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd158009df0 con 0x7fd1580027f0 2021-02-24T15:27:59.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fd174005010 con 0x7fd1580027f0 2021-02-24T15:27:59.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1580027f0 legacy=0x7fd158004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.003+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1580027f0 legacy=0x7fd158004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:59.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.011+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd158007520 con 0x7fd1580068c0 2021-02-24T15:27:59.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd17effd700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1580068c0 legacy=0x7fd158006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 10 client.28368.objecter ms_handle_connect 0x7fd1580068c0 2021-02-24T15:27:59.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 10 client.28368.objecter resend_mon_ops 2021-02-24T15:27:59.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586965505 0 0) 0x7fd158007520 con 0x7fd1580068c0 2021-02-24T15:27:59.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd158006550 con 0x7fd1580068c0 2021-02-24T15:27:59.029 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1799042130 0 0) 0x7fd158006550 con 0x7fd1580068c0 2021-02-24T15:27:59.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd158007520 con 0x7fd1580068c0 2021-02-24T15:27:59.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fd1740056e0 con 0x7fd1580068c0 2021-02-24T15:27:59.030 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 971092621 0 0) 0x7fd158007520 con 0x7fd1580068c0 2021-02-24T15:27:59.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd158008720 con 0x7fd1580068c0 2021-02-24T15:27:59.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 1232988736) 0x7fd1740059c0 con 0x7fd1580068c0 2021-02-24T15:27:59.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1580068c0 legacy=0x7fd158006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.014+0000 7fd1677fe700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6789/0 conn(0x7fd1580068c0 legacy=0x7fd158006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:59.031 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 10 librados: watch_flush enter 2021-02-24T15:27:59.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 10 librados: watch_flush exit 2021-02-24T15:27:59.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 20 client.28368.objecter shutdown clearing up homeless session... 2021-02-24T15:27:59.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 10 client.28368.objecter successfully canceled tick 2021-02-24T15:27:59.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.181:6812/33484 conn(0x7fd1600317c0 legacy=0x7fd160033c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.032 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 >> v1:172.21.15.152:6789/0 conn(0x7fd1800939f0 legacy=0x7fd180129820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.033 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd17ffff700 1 -- 172.21.15.152:0/2387547805 reap_dead start 2021-02-24T15:27:59.033 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd17ffff700 1 -- 172.21.15.152:0/2387547805 reap_dead start 2021-02-24T15:27:59.033 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 shutdown_connections 2021-02-24T15:27:59.034 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 >> 172.21.15.152:0/2387547805 conn(0x7fd1800999a0 msgr2=0x7fd18012c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:59.034 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 shutdown_connections 2021-02-24T15:27:59.034 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 1 -- 172.21.15.152:0/2387547805 wait complete. 2021-02-24T15:27:59.035 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.015+0000 7fd185a6f700 1 librados: shutdown 2021-02-24T15:27:59.035 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:27:59.035 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:27:59.035 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:27:59.036 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:27:59.036 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 56, 2021-02-24T15:27:59.036 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:27:59.036 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:27:59.036 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:27:59.037 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:27:59.037 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:59.037 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:27:59.037 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:27:59.037 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:27:59.038 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:27:59.038 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:27:59.038 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:27:59.038 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:27:59.039 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:27:59.039 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:27:59.039 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:27:59.039 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:27:59.040 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:27:59.040 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:27:59.040 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:59.040 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:27:59.041 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:27:59.041 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:27:59.041 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:27:59.041 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:27:59.041 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:27:59.042 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:27:59.042 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:27:59.042 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:27:59.042 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:27:59.042 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:27:59.043 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:59.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:59.043 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:27:59.043 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:27:59.044 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:27:59.044 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:27:59.044 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:27:59.045 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:27:59.045 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:27:59.045 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:27:59.045 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:27:59.046 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:27:59.046 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:27:59.046 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:27:59.046 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:27:59.047 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:27:59.047 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:27:59.047 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:27:59.047 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:27:59.047 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:27:59.048 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:27:59.048 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:27:59.048 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:27:59.048 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:27:59.049 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:27:59.049 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:27:59.049 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:59.049 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:27:59.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:59.050 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:27:59.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:59.050 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:27:59.051 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:27:59.051 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:27:59.051 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:27:59.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:59.052 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:27:59.052 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:27:59.052 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:27:59.052 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:59.052 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:59.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:59.053 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:27:59.053 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:27:59.053 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:27:59.053 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:27:59.054 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:27:59.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:59.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:59.054 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:27:59.055 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:27:59.055 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:27:59.055 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:27:59.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:59.056 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:27:59.056 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:27:59.056 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:27:59.056 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:59.057 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:59.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:59.057 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:27:59.058 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:27:59.058 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:27:59.058 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:27:59.059 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:27:59.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:59.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:59.059 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:27:59.059 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:27:59.060 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:27:59.060 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:27:59.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:59.060 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:27:59.060 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:27:59.061 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:27:59.061 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:59.061 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:59.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:59.061 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:27:59.062 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:27:59.062 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:27:59.062 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:27:59.062 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:27:59.063 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:59.063 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:59.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:59.063 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:27:59.064 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:27:59.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:59.064 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:27:59.064 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:27:59.064 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:27:59.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:59.065 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:27:59.065 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:27:59.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:27:59.066 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:27:59.066 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:27:59.066 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:27:59.067 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:27:59.067 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:27:59.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:27:59.067 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:27:59.067 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:27:59.068 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2021-02-24T15:27:59.068 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2021-02-24T15:27:59.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.185+0000 7f0243068700 1 Processor -- start 2021-02-24T15:27:59.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.185+0000 7f0243068700 1 -- start start 2021-02-24T15:27:59.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.185+0000 7f0243068700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c0639d0 con 0x7f023c097040 2021-02-24T15:27:59.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.186+0000 7f0243068700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c09a060 con 0x7f023c0635f0 2021-02-24T15:27:59.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.186+0000 7f0243068700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c09a300 con 0x7f023c0974f0 2021-02-24T15:27:59.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.186+0000 7f0242867700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f023c0974f0 0x7f023c133180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37346/0 (socket says 172.21.15.152:37346) 2021-02-24T15:27:59.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.186+0000 7f0241865700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f023c097040 0x7f023c12fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48870/0 (socket says 172.21.15.152:48870) 2021-02-24T15:27:59.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.186+0000 7f0242867700 1 -- 172.21.15.152:0/2552284619 learned_addr learned my addr 172.21.15.152:0/2552284619 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:59.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0242867700 1 -- 172.21.15.152:0/2552284619 >> v1:172.21.15.152:6790/0 conn(0x7f023c0974f0 legacy=0x7f023c133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241865700 1 -- 172.21.15.152:0/2552284619 >> v1:172.21.15.152:6789/0 conn(0x7f023c097040 legacy=0x7f023c12fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.191 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0242066700 1 -- 172.21.15.152:0/2552284619 >> v1:172.21.15.181:6789/0 conn(0x7f023c0635f0 legacy=0x7f023c12abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675123512 0 0) 0x7f023c0639d0 con 0x7f023c097040 2021-02-24T15:27:59.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0224003230 con 0x7f023c097040 2021-02-24T15:27:59.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296657609 0 0) 0x7f023c09a300 con 0x7f023c0974f0 2021-02-24T15:27:59.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f023c0639d0 con 0x7f023c0974f0 2021-02-24T15:27:59.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239030324 0 0) 0x7f023c09a060 con 0x7f023c0635f0 2021-02-24T15:27:59.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f023c09a300 con 0x7f023c0635f0 2021-02-24T15:27:59.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2793014159 0 0) 0x7f0224003230 con 0x7f023c097040 2021-02-24T15:27:59.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 >> v1:172.21.15.152:6790/0 conn(0x7f023c0974f0 legacy=0x7f023c133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 >> v1:172.21.15.181:6789/0 conn(0x7f023c0635f0 legacy=0x7f023c12abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c08fb30 con 0x7f023c097040 2021-02-24T15:27:59.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f022c001930 con 0x7f023c097040 2021-02-24T15:27:59.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f022c001c40 con 0x7f023c097040 2021-02-24T15:27:59.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.188+0000 7f0241064700 1 -- 172.21.15.152:0/2552284619 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f022c004690 con 0x7f023c097040 2021-02-24T15:27:59.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.189+0000 7f0243068700 1 -- 172.21.15.152:0/2552284619 >> v1:172.21.15.152:6789/0 conn(0x7f023c097040 legacy=0x7f023c12fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.189+0000 7f0243068700 1 -- 172.21.15.152:0/2552284619 shutdown_connections 2021-02-24T15:27:59.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.189+0000 7f0243068700 1 -- 172.21.15.152:0/2552284619 >> 172.21.15.152:0/2552284619 conn(0x7f023c09d9e0 msgr2=0x7f023c09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:59.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.189+0000 7f0243068700 1 -- 172.21.15.152:0/2552284619 shutdown_connections 2021-02-24T15:27:59.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.189+0000 7f0243068700 1 -- 172.21.15.152:0/2552284619 wait complete. 2021-02-24T15:27:59.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0243068700 1 librados: starting msgr at 2021-02-24T15:27:59.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0243068700 1 librados: starting objecter 2021-02-24T15:27:59.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0243068700 1 Processor -- start 2021-02-24T15:27:59.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0243068700 1 -- start start 2021-02-24T15:27:59.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0243068700 1 librados: setting wanted keys 2021-02-24T15:27:59.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0243068700 1 librados: calling monclient init 2021-02-24T15:27:59.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0243068700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c092eb0 con 0x7f023c097040 2021-02-24T15:27:59.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0243068700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c093150 con 0x7f023c0635f0 2021-02-24T15:27:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0243068700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c096d30 con 0x7f023c0974f0 2021-02-24T15:27:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0241865700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f023c097040 0x7f023c13f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48874/0 (socket says 172.21.15.152:48874) 2021-02-24T15:27:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.190+0000 7f0241865700 1 -- 172.21.15.152:0/1157156095 learned_addr learned my addr 172.21.15.152:0/1157156095 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:27:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.192+0000 7f0241865700 1 -- 172.21.15.152:0/1157156095 >> v1:172.21.15.152:6789/0 conn(0x7f023c097040 legacy=0x7f023c13f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 10 client.?.objecter ms_handle_connect 0x7f023c097040 2021-02-24T15:27:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 10 client.?.objecter ms_handle_connect 0x7f023c0974f0 2021-02-24T15:27:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0242867700 1 -- 172.21.15.152:0/1157156095 >> v1:172.21.15.152:6790/0 conn(0x7f023c0974f0 legacy=0x7f023c142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10491175 0 0) 0x7f023c092eb0 con 0x7f023c097040 2021-02-24T15:27:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0242066700 1 -- 172.21.15.152:0/1157156095 >> v1:172.21.15.181:6789/0 conn(0x7f023c0635f0 legacy=0x7f023c096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:27:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0242867700 1 -- 172.21.15.152:0/1157156095 >> v1:172.21.15.152:6790/0 conn(0x7f023c0974f0 legacy=0x7f023c142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-02-24T15:27:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0242867700 1 -- 172.21.15.152:0/1157156095 >> v1:172.21.15.152:6790/0 conn(0x7f023c0974f0 legacy=0x7f023c142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:27:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0242867700 1 --1- 172.21.15.152:0/1157156095 >> v1:172.21.15.152:6790/0 conn(0x7f023c0974f0 0x7f023c142910 :-1 s=OPENED pgs=8492 cs=1 l=1).handle_message read tag failed 2021-02-24T15:27:59.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0242867700 1 --1- 172.21.15.152:0/1157156095 >> v1:172.21.15.152:6790/0 conn(0x7f023c0974f0 0x7f023c142910 :-1 s=OPENED pgs=8492 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:27:59.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f021c004bd0 con 0x7f023c097040 2021-02-24T15:27:59.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 10 client.?.objecter ms_handle_connect 0x7f023c0635f0 2021-02-24T15:27:59.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 10 client.?.objecter resend_mon_ops 2021-02-24T15:27:59.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657302318 0 0) 0x7f023c093150 con 0x7f023c0635f0 2021-02-24T15:27:59.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f023c092eb0 con 0x7f023c0635f0 2021-02-24T15:27:59.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1366603505 0 0) 0x7f021c004bd0 con 0x7f023c097040 2021-02-24T15:27:59.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f023c093150 con 0x7f023c097040 2021-02-24T15:27:59.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f022c0018f0 con 0x7f023c097040 2021-02-24T15:27:59.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2696204126 0 0) 0x7f023c092eb0 con 0x7f023c0635f0 2021-02-24T15:27:59.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f021c004bd0 con 0x7f023c0635f0 2021-02-24T15:27:59.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0238001be0 con 0x7f023c0635f0 2021-02-24T15:27:59.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3119388307 0 0) 0x7f023c093150 con 0x7f023c097040 2021-02-24T15:27:59.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 >> v1:172.21.15.152:6790/0 conn(0x7f023c0974f0 legacy=0x7f023c142910 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:27:59.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 >> v1:172.21.15.181:6789/0 conn(0x7f023c0635f0 legacy=0x7f023c096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c091bf0 con 0x7f023c097040 2021-02-24T15:27:59.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c090ca0 con 0x7f023c097040 2021-02-24T15:27:59.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0243068700 10 client.28374.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:27:59.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c127c20 con 0x7f023c097040 2021-02-24T15:27:59.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f0243068700 1 librados: init done 2021-02-24T15:27:59.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f022c004da0 con 0x7f023c097040 2021-02-24T15:27:59.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.193+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f022c0050b0 con 0x7f023c097040 2021-02-24T15:27:59.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.194+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f022c00dbb0 con 0x7f023c097040 2021-02-24T15:27:59.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.194+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0220004d60 con 0x7f023c097040 2021-02-24T15:27:59.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.194+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(466..466 src has 230..466) v4 ==== 6507+0+0 (unknown 3263780985 0 0) 0x7f022c03b680 con 0x7f023c097040 2021-02-24T15:27:59.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.194+0000 7f022a7fc700 10 client.28374.objecter ms_dispatch 0x7f023c001510 osd_map(466..466 src has 230..466) v4 2021-02-24T15:27:59.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.194+0000 7f022a7fc700 3 client.28374.objecter handle_osd_map got epochs [466,466] > 0 2021-02-24T15:27:59.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.194+0000 7f022a7fc700 3 client.28374.objecter handle_osd_map decoding full epoch 466 2021-02-24T15:27:59.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.194+0000 7f022a7fc700 20 client.28374.objecter dump_active .. 0 homeless 2021-02-24T15:27:59.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.197+0000 7f022a7fc700 10 client.28374.objecter ms_handle_connect 0x7f021c031530 2021-02-24T15:27:59.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.198+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f022c012930 con 0x7f023c097040 2021-02-24T15:27:59.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.430+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f0220005820 con 0x7f023c097040 2021-02-24T15:27:59.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.431+0000 7f022a7fc700 1 -- 172.21.15.152:0/1157156095 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (unknown 246732539 0 0) 0x7f022c012520 con 0x7f023c097040 2021-02-24T15:27:59.433 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.432+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.433 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.432+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=6,logm=63} crc {auth=2296330015,config=3140514009,health=4205804154,kv=2558848642,logm=2332982}) 2021-02-24T15:27:59.434 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.432+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=18,config=2,health=11,kv=5,logm=64} crc {auth=575037770,config=55734535,health=2786404570,kv=62027798,logm=4191654713}) 2021-02-24T15:27:59.434 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.432+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.434 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.432+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=6,logm=63} crc {auth=2296330015,config=3140514009,health=4205804154,kv=2558848642,logm=2332982}) 2021-02-24T15:27:59.434 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.432+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=11,kv=6,logm=62} crc {auth=2192871918,config=3140514009,health=4205804154,kv=2558848642,logm=55714903}) 2021-02-24T15:27:59.438 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.432+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.438 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.432+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4234840091}) 2021-02-24T15:27:59.439 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.432+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1691499343}) 2021-02-24T15:27:59.439 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.433+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.440 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.433+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4234840091}) 2021-02-24T15:27:59.440 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.433+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3409140405}) 2021-02-24T15:27:59.440 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.433+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.440 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.433+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3049053510}) 2021-02-24T15:27:59.440 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.433+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=536563664}) 2021-02-24T15:27:59.441 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.433+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.441 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.433+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3049053510}) 2021-02-24T15:27:59.441 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.433+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=756049799}) 2021-02-24T15:27:59.441 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.442 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3196420108}) 2021-02-24T15:27:59.443 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=875279794}) 2021-02-24T15:27:59.443 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.443 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3196420108}) 2021-02-24T15:27:59.443 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3590657046}) 2021-02-24T15:27:59.444 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.435+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.444 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.435+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541443572}) 2021-02-24T15:27:59.444 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.435+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2795856620}) 2021-02-24T15:27:59.444 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.435+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.445 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.435+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541443572}) 2021-02-24T15:27:59.445 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.435+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2619174760}) 2021-02-24T15:27:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 10 librados: watch_flush enter 2021-02-24T15:27:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 10 librados: watch_flush exit 2021-02-24T15:27:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 20 client.28374.objecter shutdown clearing up homeless session... 2021-02-24T15:27:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 10 client.28374.objecter successfully canceled tick 2021-02-24T15:27:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 >> v1:172.21.15.181:6812/33484 conn(0x7f021c031530 legacy=0x7f021c0339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.448 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 >> v1:172.21.15.152:6789/0 conn(0x7f023c097040 legacy=0x7f023c13f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:27:59.448 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 shutdown_connections 2021-02-24T15:27:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 >> 172.21.15.152:0/1157156095 conn(0x7f023c09d9e0 msgr2=0x7f023c1293c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:27:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 shutdown_connections 2021-02-24T15:27:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 1 -- 172.21.15.152:0/1157156095 wait complete. 2021-02-24T15:27:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:27:59.434+0000 7f0243068700 1 librados: shutdown 2021-02-24T15:27:59.456 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.437+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.456 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.437+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3298028076}) 2021-02-24T15:27:59.456 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.437+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3556547343}) 2021-02-24T15:27:59.457 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.437+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.457 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.437+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3298028076}) 2021-02-24T15:27:59.457 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.437+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3189238243}) 2021-02-24T15:27:59.457 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.440+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.458 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.440+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283138257}) 2021-02-24T15:27:59.458 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.440+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=519289260}) 2021-02-24T15:27:59.458 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.440+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.458 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.440+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283138257}) 2021-02-24T15:27:59.459 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.440+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3006712503}) 2021-02-24T15:27:59.459 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.443+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.459 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.443+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2603783368}) 2021-02-24T15:27:59.459 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.443+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=110105046}) 2021-02-24T15:27:59.460 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.443+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.460 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.443+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2603783368}) 2021-02-24T15:27:59.460 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.443+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3942199061}) 2021-02-24T15:27:59.460 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.445+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.461 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.445+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293193692}) 2021-02-24T15:27:59.461 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.445+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1723681218}) 2021-02-24T15:27:59.461 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.445+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.461 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.445+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293193692}) 2021-02-24T15:27:59.461 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.445+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3142166619}) 2021-02-24T15:27:59.462 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.447+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.462 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.447+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=76,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3197693359,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068173,mgrstat=3291647835}) 2021-02-24T15:27:59.462 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.447+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=76,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=2} crc {logm=1198004580,mdsmap=1531151339,mgr=209697895,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=3291647835,mon_config_key=494186914}) 2021-02-24T15:27:59.463 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.447+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.463 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.448+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=76,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3197693359,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068173,mgrstat=3291647835}) 2021-02-24T15:27:59.463 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.448+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=78,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10} crc {logm=3484514057,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068173,mgrstat=4111064075}) 2021-02-24T15:27:59.463 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.448+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.463 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.448+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=38,osdmap=48} crc {mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=2069550956,osd_snap=898610395,osdmap=3910238680}) 2021-02-24T15:27:59.464 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.448+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=4,monmap=3,osd_metadata=6,osd_snap=36,osdmap=51} crc {mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_snap=3010639764,osdmap=2937009316}) 2021-02-24T15:27:59.464 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.448+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.464 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.448+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=38,osdmap=48} crc {mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=2069550956,osd_snap=898610395,osdmap=3910238680}) 2021-02-24T15:27:59.464 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.448+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=37,osdmap=49} crc {mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=2069550956,osd_snap=269821030,osdmap=1690811426}) 2021-02-24T15:27:59.465 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.450+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.465 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.450+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3378838199}) 2021-02-24T15:27:59.465 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.450+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3271346679}) 2021-02-24T15:27:59.465 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.450+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.466 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.450+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3378838199}) 2021-02-24T15:27:59.466 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.450+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2131560766}) 2021-02-24T15:27:59.466 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.451+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.466 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.451+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1236788171}) 2021-02-24T15:27:59.467 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.451+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1249515811}) 2021-02-24T15:27:59.467 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.451+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.467 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.451+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1236788171}) 2021-02-24T15:27:59.467 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.451+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3449871315}) 2021-02-24T15:27:59.468 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.452+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.468 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.452+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2492649959}) 2021-02-24T15:27:59.468 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.452+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=97} crc {osdmap=3077901353}) 2021-02-24T15:27:59.468 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.452+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.468 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.452+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2492649959}) 2021-02-24T15:27:59.469 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.452+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2342085891}) 2021-02-24T15:27:59.469 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.453+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:27:59.469 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.453+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=5} crc {osdmap=256330282}) 2021-02-24T15:27:59.470 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:27:59.453+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=4} crc {osdmap=90032681}) 2021-02-24T15:27:59.470 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2021-02-24T15:28:00.471 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:28:00.472 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:28:00.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.591+0000 7f2def1f2700 1 Processor -- start 2021-02-24T15:28:00.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.591+0000 7f2def1f2700 1 -- start start 2021-02-24T15:28:00.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.592+0000 7f2def1f2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de80637e0 con 0x7f2de8068390 2021-02-24T15:28:00.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.592+0000 7f2def1f2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de8097500 con 0x7f2de8131270 2021-02-24T15:28:00.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.592+0000 7f2def1f2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de8063d40 con 0x7f2de8063070 2021-02-24T15:28:00.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.592+0000 7f2decf8e700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2de8063070 0x7f2de80966e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37356/0 (socket says 172.21.15.152:37356) 2021-02-24T15:28:00.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.592+0000 7f2decf8e700 1 -- 172.21.15.152:0/1335077059 learned_addr learned my addr 172.21.15.152:0/1335077059 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:00.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.594+0000 7f2de7fff700 1 -- 172.21.15.152:0/1335077059 >> v1:172.21.15.152:6789/0 conn(0x7f2de8068390 legacy=0x7f2de8096df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:00.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.594+0000 7f2decf8e700 1 -- 172.21.15.152:0/1335077059 >> v1:172.21.15.152:6790/0 conn(0x7f2de8063070 legacy=0x7f2de80966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:00.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.594+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733431646 0 0) 0x7f2de8063d40 con 0x7f2de8063070 2021-02-24T15:28:00.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.594+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dcc003230 con 0x7f2de8063070 2021-02-24T15:28:00.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.594+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287545626 0 0) 0x7f2de80637e0 con 0x7f2de8068390 2021-02-24T15:28:00.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.594+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2de8063d40 con 0x7f2de8068390 2021-02-24T15:28:00.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2ded78f700 1 -- 172.21.15.152:0/1335077059 >> v1:172.21.15.181:6789/0 conn(0x7f2de8131270 legacy=0x7f2de8133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:00.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3803377708 0 0) 0x7f2de8063d40 con 0x7f2de8068390 2021-02-24T15:28:00.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 >> v1:172.21.15.152:6790/0 conn(0x7f2de8063070 legacy=0x7f2de80966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 >> v1:172.21.15.181:6789/0 conn(0x7f2de8131270 legacy=0x7f2de8133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de8063fe0 con 0x7f2de8068390 2021-02-24T15:28:00.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2dd4001a40 con 0x7f2de8068390 2021-02-24T15:28:00.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2dd4001c30 con 0x7f2de8068390 2021-02-24T15:28:00.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2de77fe700 1 -- 172.21.15.152:0/1335077059 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2dd4002060 con 0x7f2de8068390 2021-02-24T15:28:00.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2def1f2700 1 -- 172.21.15.152:0/1335077059 >> v1:172.21.15.152:6789/0 conn(0x7f2de8068390 legacy=0x7f2de8096df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2def1f2700 1 -- 172.21.15.152:0/1335077059 shutdown_connections 2021-02-24T15:28:00.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2def1f2700 1 -- 172.21.15.152:0/1335077059 >> 172.21.15.152:0/1335077059 conn(0x7f2de809ba40 msgr2=0x7f2de809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:00.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2def1f2700 1 -- 172.21.15.152:0/1335077059 shutdown_connections 2021-02-24T15:28:00.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.595+0000 7f2def1f2700 1 -- 172.21.15.152:0/1335077059 wait complete. 2021-02-24T15:28:00.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.596+0000 7f2def1f2700 1 librados: starting msgr at 2021-02-24T15:28:00.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.596+0000 7f2def1f2700 1 librados: starting objecter 2021-02-24T15:28:00.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.596+0000 7f2def1f2700 1 Processor -- start 2021-02-24T15:28:00.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.596+0000 7f2def1f2700 1 -- start start 2021-02-24T15:28:00.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.596+0000 7f2def1f2700 1 librados: setting wanted keys 2021-02-24T15:28:00.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.596+0000 7f2def1f2700 1 librados: calling monclient init 2021-02-24T15:28:00.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.597+0000 7f2def1f2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de8129dc0 con 0x7f2de8131270 2021-02-24T15:28:00.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.597+0000 7f2def1f2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de8113e20 con 0x7f2de8068390 2021-02-24T15:28:00.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.597+0000 7f2def1f2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de81140c0 con 0x7f2de8063070 2021-02-24T15:28:00.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.597+0000 7f2decf8e700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2de8063070 0x7f2de812fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37360/0 (socket says 172.21.15.152:37360) 2021-02-24T15:28:00.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.597+0000 7f2ded78f700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2de8131270 0x7f2de8141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48886/0 (socket says 172.21.15.152:48886) 2021-02-24T15:28:00.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.597+0000 7f2decf8e700 1 -- 172.21.15.152:0/1213944738 learned_addr learned my addr 172.21.15.152:0/1213944738 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:00.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2decf8e700 1 -- 172.21.15.152:0/1213944738 >> v1:172.21.15.152:6790/0 conn(0x7f2de8063070 legacy=0x7f2de812fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:00.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2ded78f700 1 -- 172.21.15.152:0/1213944738 >> v1:172.21.15.152:6789/0 conn(0x7f2de8131270 legacy=0x7f2de8141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:00.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 10 client.?.objecter ms_handle_connect 0x7f2de8063070 2021-02-24T15:28:00.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:00.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 10 client.?.objecter ms_handle_connect 0x7f2de8131270 2021-02-24T15:28:00.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:00.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749998993 0 0) 0x7f2de81140c0 con 0x7f2de8063070 2021-02-24T15:28:00.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc8004bd0 con 0x7f2de8063070 2021-02-24T15:28:00.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773530656 0 0) 0x7f2de8129dc0 con 0x7f2de8131270 2021-02-24T15:28:00.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2de81140c0 con 0x7f2de8131270 2021-02-24T15:28:00.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 10 client.?.objecter ms_handle_connect 0x7f2de8068390 2021-02-24T15:28:00.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de4ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:00.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.599+0000 7f2de7fff700 1 -- 172.21.15.152:0/1213944738 >> v1:172.21.15.181:6789/0 conn(0x7f2de8068390 legacy=0x7f2de81296b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:00.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1072892787 0 0) 0x7f2dc8004bd0 con 0x7f2de8063070 2021-02-24T15:28:00.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2de8129dc0 con 0x7f2de8063070 2021-02-24T15:28:00.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2ddc001d50 con 0x7f2de8063070 2021-02-24T15:28:00.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2467940610 0 0) 0x7f2de81140c0 con 0x7f2de8131270 2021-02-24T15:28:00.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2dc8004bd0 con 0x7f2de8131270 2021-02-24T15:28:00.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2de0001ee0 con 0x7f2de8131270 2021-02-24T15:28:00.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505952288 0 0) 0x7f2de8113e20 con 0x7f2de8068390 2021-02-24T15:28:00.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2de81140c0 con 0x7f2de8068390 2021-02-24T15:28:00.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2991335694 0 0) 0x7f2de8129dc0 con 0x7f2de8063070 2021-02-24T15:28:00.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 >> v1:172.21.15.181:6789/0 conn(0x7f2de8068390 legacy=0x7f2de81296b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 >> v1:172.21.15.152:6789/0 conn(0x7f2de8131270 legacy=0x7f2de8141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de812d510 con 0x7f2de8063070 2021-02-24T15:28:00.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de8112bf0 con 0x7f2de8063070 2021-02-24T15:28:00.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2def1f2700 10 client.84320.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:28:00.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de8130600 con 0x7f2de8063070 2021-02-24T15:28:00.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2def1f2700 1 librados: init done 2021-02-24T15:28:00.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2ddc004960 con 0x7f2de8063070 2021-02-24T15:28:00.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.600+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2ddc004c70 con 0x7f2de8063070 2021-02-24T15:28:00.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.601+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f2ddc00d770 con 0x7f2de8063070 2021-02-24T15:28:00.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.601+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(467..467 src has 230..467) v4 ==== 6507+0+0 (unknown 1963465955 0 0) 0x7f2ddc03b490 con 0x7f2de8063070 2021-02-24T15:28:00.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.601+0000 7f2de4ff9700 10 client.84320.objecter ms_dispatch 0x7f2de8001510 osd_map(467..467 src has 230..467) v4 2021-02-24T15:28:00.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.601+0000 7f2de4ff9700 3 client.84320.objecter handle_osd_map got epochs [467,467] > 0 2021-02-24T15:28:00.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.601+0000 7f2de4ff9700 3 client.84320.objecter handle_osd_map decoding full epoch 467 2021-02-24T15:28:00.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.601+0000 7f2de4ff9700 20 client.84320.objecter dump_active .. 0 homeless 2021-02-24T15:28:00.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.601+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc0004d60 con 0x7f2de8063070 2021-02-24T15:28:00.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.603+0000 7f2de4ff9700 10 client.84320.objecter ms_handle_connect 0x7f2dc8031700 2021-02-24T15:28:00.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.605+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f2ddc012920 con 0x7f2de8063070 2021-02-24T15:28:00.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.845+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2dc0005010 con 0x7f2de8063070 2021-02-24T15:28:00.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.845+0000 7f2de4ff9700 1 -- 172.21.15.152:0/1213944738 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 1445654182) 0x7f2ddc012920 con 0x7f2de8063070 2021-02-24T15:28:00.847 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:28:00.848 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.846+0000 7f2def1f2700 10 librados: watch_flush enter 2021-02-24T15:28:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.846+0000 7f2def1f2700 10 librados: watch_flush exit 2021-02-24T15:28:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.846+0000 7f2def1f2700 20 client.84320.objecter shutdown clearing up homeless session... 2021-02-24T15:28:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.847+0000 7f2def1f2700 10 client.84320.objecter successfully canceled tick 2021-02-24T15:28:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.847+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 >> v1:172.21.15.181:6812/33484 conn(0x7f2dc8031700 legacy=0x7f2dc8033bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.847+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 >> v1:172.21.15.152:6790/0 conn(0x7f2de8063070 legacy=0x7f2de812fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.847+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 shutdown_connections 2021-02-24T15:28:00.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.847+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 >> 172.21.15.152:0/1213944738 conn(0x7f2de809ba40 msgr2=0x7f2de812c440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:00.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.847+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 shutdown_connections 2021-02-24T15:28:00.850 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.847+0000 7f2def1f2700 1 -- 172.21.15.152:0/1213944738 wait complete. 2021-02-24T15:28:00.851 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.847+0000 7f2def1f2700 1 librados: shutdown 2021-02-24T15:28:00.862 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:28:00.862 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-02-24T15:28:00.863 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:28:00.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.982+0000 7f4a2094d700 1 Processor -- start 2021-02-24T15:28:00.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.982+0000 7f4a2094d700 1 -- start start 2021-02-24T15:28:00.984 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.982+0000 7f4a2094d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c129990 con 0x7f4a1c0974f0 2021-02-24T15:28:00.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.982+0000 7f4a2094d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c12a2c0 con 0x7f4a1c097b10 2021-02-24T15:28:00.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.982+0000 7f4a2094d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c09a300 con 0x7f4a1c097040 2021-02-24T15:28:00.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.983+0000 7f4a1bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4a1c0974f0 0x7f4a1c133160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48896/0 (socket says 172.21.15.152:48896) 2021-02-24T15:28:00.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.983+0000 7f4a1bfff700 1 -- 172.21.15.152:0/3089813555 learned_addr learned my addr 172.21.15.152:0/3089813555 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:00.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.983+0000 7f4a1affd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f4a1c097040 0x7f4a1c12fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37368/0 (socket says 172.21.15.152:37368) 2021-02-24T15:28:00.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1affd700 1 -- 172.21.15.152:0/3089813555 >> v1:172.21.15.152:6790/0 conn(0x7f4a1c097040 legacy=0x7f4a1c12fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:00.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1bfff700 1 -- 172.21.15.152:0/3089813555 >> v1:172.21.15.152:6789/0 conn(0x7f4a1c0974f0 legacy=0x7f4a1c133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:00.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200838794 0 0) 0x7f4a1c129990 con 0x7f4a1c0974f0 2021-02-24T15:28:00.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1b7fe700 1 -- 172.21.15.152:0/3089813555 >> v1:172.21.15.181:6789/0 conn(0x7f4a1c097b10 legacy=0x7f4a1c129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:00.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a08003230 con 0x7f4a1c0974f0 2021-02-24T15:28:00.989 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629730114 0 0) 0x7f4a1c09a300 con 0x7f4a1c097040 2021-02-24T15:28:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a1c129990 con 0x7f4a1c097040 2021-02-24T15:28:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014673273 0 0) 0x7f4a1c12a2c0 con 0x7f4a1c097b10 2021-02-24T15:28:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a1c09a300 con 0x7f4a1c097b10 2021-02-24T15:28:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3024781370 0 0) 0x7f4a08003230 con 0x7f4a1c0974f0 2021-02-24T15:28:00.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 >> v1:172.21.15.152:6790/0 conn(0x7f4a1c097040 legacy=0x7f4a1c12fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 >> v1:172.21.15.181:6789/0 conn(0x7f4a1c097b10 legacy=0x7f4a1c129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c08fb30 con 0x7f4a1c0974f0 2021-02-24T15:28:00.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4a14001be0 con 0x7f4a1c0974f0 2021-02-24T15:28:00.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4a14001ef0 con 0x7f4a1c0974f0 2021-02-24T15:28:00.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.985+0000 7f4a1a7fc700 1 -- 172.21.15.152:0/3089813555 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4a14004930 con 0x7f4a1c0974f0 2021-02-24T15:28:00.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.986+0000 7f4a2094d700 1 -- 172.21.15.152:0/3089813555 >> v1:172.21.15.152:6789/0 conn(0x7f4a1c0974f0 legacy=0x7f4a1c133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:00.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.986+0000 7f4a2094d700 1 -- 172.21.15.152:0/3089813555 shutdown_connections 2021-02-24T15:28:00.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.986+0000 7f4a2094d700 1 -- 172.21.15.152:0/3089813555 >> 172.21.15.152:0/3089813555 conn(0x7f4a1c09d9e0 msgr2=0x7f4a1c09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:00.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.986+0000 7f4a2094d700 1 -- 172.21.15.152:0/3089813555 shutdown_connections 2021-02-24T15:28:00.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.986+0000 7f4a2094d700 1 -- 172.21.15.152:0/3089813555 wait complete. 2021-02-24T15:28:00.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.986+0000 7f4a2094d700 1 librados: starting msgr at 2021-02-24T15:28:00.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a2094d700 1 librados: starting objecter 2021-02-24T15:28:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a2094d700 1 Processor -- start 2021-02-24T15:28:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a2094d700 1 -- start start 2021-02-24T15:28:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a2094d700 1 librados: setting wanted keys 2021-02-24T15:28:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a2094d700 1 librados: calling monclient init 2021-02-24T15:28:00.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a2094d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c0993d0 con 0x7f4a1c097b10 2021-02-24T15:28:00.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a2094d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c117e80 con 0x7f4a1c0974f0 2021-02-24T15:28:00.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a2094d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c118120 con 0x7f4a1c097040 2021-02-24T15:28:00.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a1b7fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f4a1c097040 0x7f4a1c1276b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37374/0 (socket says 172.21.15.152:37374) 2021-02-24T15:28:00.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.987+0000 7f4a1b7fe700 1 -- 172.21.15.152:0/3759146729 learned_addr learned my addr 172.21.15.152:0/3759146729 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:01.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.989+0000 7f4a1b7fe700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6790/0 conn(0x7f4a1c097040 legacy=0x7f4a1c1276b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.989+0000 7f4a1bfff700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6789/0 conn(0x7f4a1c097b10 legacy=0x7f4a1c1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.989+0000 7f4a037fe700 10 client.?.objecter ms_handle_connect 0x7f4a1c097040 2021-02-24T15:28:01.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.989+0000 7f4a037fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.989+0000 7f4a037fe700 10 client.?.objecter ms_handle_connect 0x7f4a1c097b10 2021-02-24T15:28:01.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.989+0000 7f4a037fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994407006 0 0) 0x7f4a1c118120 con 0x7f4a1c097040 2021-02-24T15:28:01.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49fc004bd0 con 0x7f4a1c097040 2021-02-24T15:28:01.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442839596 0 0) 0x7f4a1c0993d0 con 0x7f4a1c097b10 2021-02-24T15:28:01.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a1c118120 con 0x7f4a1c097b10 2021-02-24T15:28:01.005 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 10 client.?.objecter ms_handle_connect 0x7f4a1c0974f0 2021-02-24T15:28:01.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a1affd700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.181:6789/0 conn(0x7f4a1c0974f0 legacy=0x7f4a1c13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3848922642 0 0) 0x7f49fc004bd0 con 0x7f4a1c097040 2021-02-24T15:28:01.006 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4a1c0993d0 con 0x7f4a1c097040 2021-02-24T15:28:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4a0c001ec0 con 0x7f4a1c097040 2021-02-24T15:28:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 471796797 0 0) 0x7f4a1c118120 con 0x7f4a1c097b10 2021-02-24T15:28:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f49fc004bd0 con 0x7f4a1c097b10 2021-02-24T15:28:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4a14004870 con 0x7f4a1c097b10 2021-02-24T15:28:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821877681 0 0) 0x7f4a1c117e80 con 0x7f4a1c0974f0 2021-02-24T15:28:01.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a1c118120 con 0x7f4a1c0974f0 2021-02-24T15:28:01.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1030583090 0 0) 0x7f4a1c0993d0 con 0x7f4a1c097040 2021-02-24T15:28:01.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.181:6789/0 conn(0x7f4a1c0974f0 legacy=0x7f4a1c13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.008 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6789/0 conn(0x7f4a1c097b10 legacy=0x7f4a1c1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c116a90 con 0x7f4a1c097040 2021-02-24T15:28:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c1157e0 con 0x7f4a1c097040 2021-02-24T15:28:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a2094d700 10 client.84326.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:28:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c127f80 con 0x7f4a1c097040 2021-02-24T15:28:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a2094d700 1 librados: init done 2021-02-24T15:28:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4a0c002410 con 0x7f4a1c097040 2021-02-24T15:28:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.990+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4a0c002720 con 0x7f4a1c097040 2021-02-24T15:28:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.991+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f4a0c002930 con 0x7f4a1c097040 2021-02-24T15:28:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.991+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f49f4006550 con 0x7f49f40027f0 2021-02-24T15:28:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.991+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(468..468 src has 230..468) v4 ==== 6507+0+0 (unknown 2109364278 0 0) 0x7f4a0c03b630 con 0x7f4a1c097040 2021-02-24T15:28:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.991+0000 7f4a037fe700 10 client.84326.objecter ms_dispatch 0x7f4a1c001510 osd_map(468..468 src has 230..468) v4 2021-02-24T15:28:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.991+0000 7f4a037fe700 3 client.84326.objecter handle_osd_map got epochs [468,468] > 0 2021-02-24T15:28:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.991+0000 7f4a037fe700 3 client.84326.objecter handle_osd_map decoding full epoch 468 2021-02-24T15:28:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.991+0000 7f4a037fe700 20 client.84326.objecter dump_active .. 0 homeless 2021-02-24T15:28:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.993+0000 7f4a037fe700 10 client.84326.objecter ms_handle_connect 0x7f49f40027f0 2021-02-24T15:28:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.993+0000 7f4a037fe700 10 client.84326.objecter resend_mon_ops 2021-02-24T15:28:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.993+0000 7f4a1bfff700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6789/0 conn(0x7f49f40027f0 legacy=0x7f49f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.993+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002062613 0 0) 0x7f49f4006550 con 0x7f49f40027f0 2021-02-24T15:28:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.993+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a1c0993d0 con 0x7f49f40027f0 2021-02-24T15:28:01.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.993+0000 7f4a037fe700 10 client.84326.objecter ms_handle_connect 0x7f49fc031730 2021-02-24T15:28:01.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.993+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3467460768 0 0) 0x7f4a1c0993d0 con 0x7f49f40027f0 2021-02-24T15:28:01.013 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.993+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f49f4006550 con 0x7f49f40027f0 2021-02-24T15:28:01.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.993+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4a14001c30 con 0x7f49f40027f0 2021-02-24T15:28:01.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.994+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3092144857 0 0) 0x7f49f4006550 con 0x7f49f40027f0 2021-02-24T15:28:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.994+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49f4009df0 con 0x7f49f40027f0 2021-02-24T15:28:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.994+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f4a14005040 con 0x7f49f40027f0 2021-02-24T15:28:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.994+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6789/0 conn(0x7f49f40027f0 legacy=0x7f49f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:00.994+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6789/0 conn(0x7f49f40027f0 legacy=0x7f49f4004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.002+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f49f4007520 con 0x7f49f40068c0 2021-02-24T15:28:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.004+0000 7f4a1bfff700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6789/0 conn(0x7f49f40068c0 legacy=0x7f49f4006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.004+0000 7f4a037fe700 10 client.84326.objecter ms_handle_connect 0x7f49f40068c0 2021-02-24T15:28:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.004+0000 7f4a037fe700 10 client.84326.objecter resend_mon_ops 2021-02-24T15:28:01.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.004+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509931160 0 0) 0x7f49f4007520 con 0x7f49f40068c0 2021-02-24T15:28:01.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.004+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f4006550 con 0x7f49f40068c0 2021-02-24T15:28:01.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2088477389 0 0) 0x7f49f4006550 con 0x7f49f40068c0 2021-02-24T15:28:01.021 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f49f4007520 con 0x7f49f40068c0 2021-02-24T15:28:01.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4a140057c0 con 0x7f49f40068c0 2021-02-24T15:28:01.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 143932289 0 0) 0x7f49f4007520 con 0x7f49f40068c0 2021-02-24T15:28:01.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f49f4008720 con 0x7f49f40068c0 2021-02-24T15:28:01.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4112 (unknown 0 0 549110400) 0x7f4a14005be0 con 0x7f49f40068c0 2021-02-24T15:28:01.022 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6789/0 conn(0x7f49f40068c0 legacy=0x7f49f4006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a037fe700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6789/0 conn(0x7f49f40068c0 legacy=0x7f49f4006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:01.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 10 librados: watch_flush enter 2021-02-24T15:28:01.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 10 librados: watch_flush exit 2021-02-24T15:28:01.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 20 client.84326.objecter shutdown clearing up homeless session... 2021-02-24T15:28:01.023 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 10 client.84326.objecter successfully canceled tick 2021-02-24T15:28:01.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.181:6812/33484 conn(0x7f49fc031730 legacy=0x7f49fc033bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.024 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 >> v1:172.21.15.152:6790/0 conn(0x7f4a1c097040 legacy=0x7f4a1c1276b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a1bfff700 1 -- 172.21.15.152:0/3759146729 reap_dead start 2021-02-24T15:28:01.025 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a1bfff700 1 -- 172.21.15.152:0/3759146729 reap_dead start 2021-02-24T15:28:01.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 shutdown_connections 2021-02-24T15:28:01.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 >> 172.21.15.152:0/3759146729 conn(0x7f4a1c09d9e0 msgr2=0x7f4a1c0967e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:01.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 shutdown_connections 2021-02-24T15:28:01.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 1 -- 172.21.15.152:0/3759146729 wait complete. 2021-02-24T15:28:01.028 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.005+0000 7f4a2094d700 1 librados: shutdown 2021-02-24T15:28:01.029 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:28:01.029 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:28:01.029 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:28:01.029 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:28:01.030 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 56, 2021-02-24T15:28:01.030 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:28:01.030 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:28:01.030 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:28:01.030 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:28:01.031 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.031 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 2, 2021-02-24T15:28:01.031 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:01.031 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:28:01.032 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:28:01.032 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:01.032 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:01.032 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:01.032 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:01.033 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:01.033 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:01.033 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:01.033 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:01.033 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:01.034 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.034 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:28:01.034 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:28:01.034 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.037 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:28:01.037 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:28:01.037 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:28:01.037 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:28:01.037 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:28:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:28:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:28:01.039 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:28:01.039 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:28:01.039 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:28:01.039 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:28:01.040 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:01.040 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:28:01.040 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:01.040 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:01.040 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:01.041 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:01.041 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:01.041 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:01.041 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:01.042 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:01.042 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:01.042 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.042 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:28:01.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.043 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:28:01.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.043 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:28:01.043 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:28:01.044 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:01.044 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:01.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.044 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:01.045 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:28:01.045 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:01.045 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.045 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.045 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.046 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:28:01.046 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:28:01.046 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:01.046 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:01.047 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:01.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.047 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:28:01.047 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:28:01.048 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:01.048 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:01.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.048 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:01.048 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:28:01.049 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:01.049 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.049 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.050 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:28:01.050 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:28:01.050 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:01.050 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:01.051 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:01.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.051 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:28:01.051 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:28:01.052 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:01.052 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:01.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.052 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:01.053 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:28:01.053 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:01.053 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.053 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.054 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:28:01.054 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:28:01.054 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:01.054 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:01.054 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:01.055 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.055 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.055 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:28:01.055 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:28:01.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.056 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:01.056 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:01.056 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:28:01.057 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.057 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.057 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:28:01.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.057 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:01.058 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:01.058 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:28:01.058 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.058 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.059 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:28:01.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.059 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:01.059 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:01.059 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:28:01.060 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.060 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.060 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:28:01.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.060 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:01.061 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:01.061 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:28:01.061 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.061 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.062 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:28:01.062 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:28:01.063 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:28:01.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.178+0000 7fa7f61eb700 1 Processor -- start 2021-02-24T15:28:01.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.178+0000 7fa7f61eb700 1 -- start start 2021-02-24T15:28:01.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.179+0000 7fa7f61eb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f00639f0 con 0x7fa7f0131040 2021-02-24T15:28:01.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.179+0000 7fa7f61eb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f0063420 con 0x7fa7f00680e0 2021-02-24T15:28:01.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.179+0000 7fa7f61eb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f0098140 con 0x7fa7f0062fc0 2021-02-24T15:28:01.181 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.179+0000 7fa7f59ea700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa7f0131040 0x7fa7f0133430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48912/0 (socket says 172.21.15.152:48912) 2021-02-24T15:28:01.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.179+0000 7fa7f49e8700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fa7f0062fc0 0x7fa7f0097a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37390/0 (socket says 172.21.15.152:37390) 2021-02-24T15:28:01.182 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.179+0000 7fa7f59ea700 1 -- 172.21.15.152:0/3634201863 learned_addr learned my addr 172.21.15.152:0/3634201863 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:01.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.181+0000 7fa7f49e8700 1 -- 172.21.15.152:0/3634201863 >> v1:172.21.15.152:6790/0 conn(0x7fa7f0062fc0 legacy=0x7fa7f0097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.181+0000 7fa7f59ea700 1 -- 172.21.15.152:0/3634201863 >> v1:172.21.15.152:6789/0 conn(0x7fa7f0131040 legacy=0x7fa7f0133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456733386 0 0) 0x7fa7f00639f0 con 0x7fa7f0131040 2021-02-24T15:28:01.184 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7f51e9700 1 -- 172.21.15.152:0/3634201863 >> v1:172.21.15.181:6789/0 conn(0x7fa7f00680e0 legacy=0x7fa7f0097320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d8003230 con 0x7fa7f0131040 2021-02-24T15:28:01.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262802026 0 0) 0x7fa7f0098140 con 0x7fa7f0062fc0 2021-02-24T15:28:01.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f00639f0 con 0x7fa7f0062fc0 2021-02-24T15:28:01.185 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 551353451 0 0) 0x7fa7f00639f0 con 0x7fa7f0062fc0 2021-02-24T15:28:01.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 >> v1:172.21.15.181:6789/0 conn(0x7fa7f00680e0 legacy=0x7fa7f0097320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 >> v1:172.21.15.152:6789/0 conn(0x7fa7f0131040 legacy=0x7fa7f0133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0063c20 con 0x7fa7f0062fc0 2021-02-24T15:28:01.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa7e0001920 con 0x7fa7f0062fc0 2021-02-24T15:28:01.186 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa7e0001c30 con 0x7fa7f0062fc0 2021-02-24T15:28:01.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7dffff700 1 -- 172.21.15.152:0/3634201863 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa7e0004690 con 0x7fa7f0062fc0 2021-02-24T15:28:01.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7f61eb700 1 -- 172.21.15.152:0/3634201863 >> v1:172.21.15.152:6790/0 conn(0x7fa7f0062fc0 legacy=0x7fa7f0097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7f61eb700 1 -- 172.21.15.152:0/3634201863 shutdown_connections 2021-02-24T15:28:01.187 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.182+0000 7fa7f61eb700 1 -- 172.21.15.152:0/3634201863 >> 172.21.15.152:0/3634201863 conn(0x7fa7f009b810 msgr2=0x7fa7f009bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.183+0000 7fa7f61eb700 1 -- 172.21.15.152:0/3634201863 shutdown_connections 2021-02-24T15:28:01.188 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.183+0000 7fa7f61eb700 1 -- 172.21.15.152:0/3634201863 wait complete. 2021-02-24T15:28:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.183+0000 7fa7f61eb700 1 librados: starting msgr at 2021-02-24T15:28:01.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.183+0000 7fa7f61eb700 1 librados: starting objecter 2021-02-24T15:28:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.183+0000 7fa7f61eb700 1 Processor -- start 2021-02-24T15:28:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.183+0000 7fa7f61eb700 1 -- start start 2021-02-24T15:28:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.183+0000 7fa7f61eb700 1 librados: setting wanted keys 2021-02-24T15:28:01.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.183+0000 7fa7f61eb700 1 librados: calling monclient init 2021-02-24T15:28:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.184+0000 7fa7f61eb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f0130e10 con 0x7fa7f0131040 2021-02-24T15:28:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.184+0000 7fa7f61eb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f0095620 con 0x7fa7f0062fc0 2021-02-24T15:28:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.184+0000 7fa7f61eb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f011ae70 con 0x7fa7f00680e0 2021-02-24T15:28:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.184+0000 7fa7f59ea700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa7f0131040 0x7fa7f0141f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48920/0 (socket says 172.21.15.152:48920) 2021-02-24T15:28:01.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.184+0000 7fa7f49e8700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fa7f00680e0 0x7fa7f0130700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37394/0 (socket says 172.21.15.152:37394) 2021-02-24T15:28:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.184+0000 7fa7f59ea700 1 -- 172.21.15.152:0/1173902909 learned_addr learned my addr 172.21.15.152:0/1173902909 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7f59ea700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6789/0 conn(0x7fa7f0131040 legacy=0x7fa7f0141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7f49e8700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6790/0 conn(0x7fa7f00680e0 legacy=0x7fa7f0130700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7dd7fa700 10 client.?.objecter ms_handle_connect 0x7fa7f0131040 2021-02-24T15:28:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7dd7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7dd7fa700 10 client.?.objecter ms_handle_connect 0x7fa7f00680e0 2021-02-24T15:28:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7dd7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125947097 0 0) 0x7fa7f0130e10 con 0x7fa7f0131040 2021-02-24T15:28:01.196 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d0004bd0 con 0x7fa7f0131040 2021-02-24T15:28:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195319666 0 0) 0x7fa7f011ae70 con 0x7fa7f00680e0 2021-02-24T15:28:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.186+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f0130e10 con 0x7fa7f00680e0 2021-02-24T15:28:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 10 client.?.objecter ms_handle_connect 0x7fa7f0062fc0 2021-02-24T15:28:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7f51e9700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.181:6789/0 conn(0x7fa7f0062fc0 legacy=0x7fa7f0117940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1040493609 0 0) 0x7fa7f0130e10 con 0x7fa7f00680e0 2021-02-24T15:28:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa7f011ae70 con 0x7fa7f00680e0 2021-02-24T15:28:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4140054218 0 0) 0x7fa7d0004bd0 con 0x7fa7f0131040 2021-02-24T15:28:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa7f0130e10 con 0x7fa7f0131040 2021-02-24T15:28:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa7e0004690 con 0x7fa7f00680e0 2021-02-24T15:28:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa7e8001d10 con 0x7fa7f0131040 2021-02-24T15:28:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808294956 0 0) 0x7fa7f0095620 con 0x7fa7f0062fc0 2021-02-24T15:28:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d0004bd0 con 0x7fa7f0062fc0 2021-02-24T15:28:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1575796920 0 0) 0x7fa7f011ae70 con 0x7fa7f00680e0 2021-02-24T15:28:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.181:6789/0 conn(0x7fa7f0062fc0 legacy=0x7fa7f0117940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6789/0 conn(0x7fa7f0131040 legacy=0x7fa7f0141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f011b110 con 0x7fa7f00680e0 2021-02-24T15:28:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f0119c40 con 0x7fa7f00680e0 2021-02-24T15:28:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7f61eb700 10 client.84332.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:28:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f0118610 con 0x7fa7f00680e0 2021-02-24T15:28:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7f61eb700 1 librados: init done 2021-02-24T15:28:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa7e0001550 con 0x7fa7f00680e0 2021-02-24T15:28:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.187+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa7e0004e40 con 0x7fa7f00680e0 2021-02-24T15:28:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.188+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fa7e000d940 con 0x7fa7f00680e0 2021-02-24T15:28:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.188+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa7c8006550 con 0x7fa7c80027f0 2021-02-24T15:28:01.202 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.188+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(468..468 src has 230..468) v4 ==== 6507+0+0 (unknown 2109364278 0 0) 0x7fa7e003b570 con 0x7fa7f00680e0 2021-02-24T15:28:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.188+0000 7fa7dd7fa700 10 client.84332.objecter ms_dispatch 0x7fa7f0001510 osd_map(468..468 src has 230..468) v4 2021-02-24T15:28:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.188+0000 7fa7dd7fa700 3 client.84332.objecter handle_osd_map got epochs [468,468] > 0 2021-02-24T15:28:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.188+0000 7fa7dd7fa700 3 client.84332.objecter handle_osd_map decoding full epoch 468 2021-02-24T15:28:01.203 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.188+0000 7fa7dd7fa700 20 client.84332.objecter dump_active .. 0 homeless 2021-02-24T15:28:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7f51e9700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6790/0 conn(0x7fa7c80027f0 legacy=0x7fa7c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 10 client.84332.objecter ms_handle_connect 0x7fa7c80027f0 2021-02-24T15:28:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 10 client.84332.objecter resend_mon_ops 2021-02-24T15:28:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656832262 0 0) 0x7fa7c8006550 con 0x7fa7c80027f0 2021-02-24T15:28:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f011ae70 con 0x7fa7c80027f0 2021-02-24T15:28:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2649701709 0 0) 0x7fa7f011ae70 con 0x7fa7c80027f0 2021-02-24T15:28:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa7c8006550 con 0x7fa7c80027f0 2021-02-24T15:28:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa7ec001ac0 con 0x7fa7c80027f0 2021-02-24T15:28:01.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 10 client.84332.objecter ms_handle_connect 0x7fa7d0031750 2021-02-24T15:28:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3884870909 0 0) 0x7fa7c8006550 con 0x7fa7c80027f0 2021-02-24T15:28:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.190+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7c8009df0 con 0x7fa7c80027f0 2021-02-24T15:28:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.191+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fa7ec0054d0 con 0x7fa7c80027f0 2021-02-24T15:28:01.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.191+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6790/0 conn(0x7fa7c80027f0 legacy=0x7fa7c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.191+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6790/0 conn(0x7fa7c80027f0 legacy=0x7fa7c8004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:01.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.199+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa7c8007520 con 0x7fa7c80068c0 2021-02-24T15:28:01.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7dd7fa700 10 client.84332.objecter ms_handle_connect 0x7fa7c80068c0 2021-02-24T15:28:01.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7dd7fa700 10 client.84332.objecter resend_mon_ops 2021-02-24T15:28:01.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7f51e9700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6790/0 conn(0x7fa7c80068c0 legacy=0x7fa7c8006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011142423 0 0) 0x7fa7c8007520 con 0x7fa7c80068c0 2021-02-24T15:28:01.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c8006550 con 0x7fa7c80068c0 2021-02-24T15:28:01.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 687013179 0 0) 0x7fa7c8006550 con 0x7fa7c80068c0 2021-02-24T15:28:01.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa7c8007520 con 0x7fa7c80068c0 2021-02-24T15:28:01.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa7ec002380 con 0x7fa7c80068c0 2021-02-24T15:28:01.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2333754484 0 0) 0x7fa7c8007520 con 0x7fa7c80068c0 2021-02-24T15:28:01.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.201+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa7c8008720 con 0x7fa7c80068c0 2021-02-24T15:28:01.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3940 (unknown 0 0 176527791) 0x7fa7ec002730 con 0x7fa7c80068c0 2021-02-24T15:28:01.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6790/0 conn(0x7fa7c80068c0 legacy=0x7fa7c8006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7dd7fa700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6790/0 conn(0x7fa7c80068c0 legacy=0x7fa7c8006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:01.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 10 librados: watch_flush enter 2021-02-24T15:28:01.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 10 librados: watch_flush exit 2021-02-24T15:28:01.213 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 20 client.84332.objecter shutdown clearing up homeless session... 2021-02-24T15:28:01.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 10 client.84332.objecter successfully canceled tick 2021-02-24T15:28:01.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.181:6812/33484 conn(0x7fa7d0031750 legacy=0x7fa7d0033c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 >> v1:172.21.15.152:6790/0 conn(0x7fa7f00680e0 legacy=0x7fa7f0130700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f59ea700 1 -- 172.21.15.152:0/1173902909 reap_dead start 2021-02-24T15:28:01.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f59ea700 1 -- 172.21.15.152:0/1173902909 reap_dead start 2021-02-24T15:28:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 shutdown_connections 2021-02-24T15:28:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 >> 172.21.15.152:0/1173902909 conn(0x7fa7f009b810 msgr2=0x7fa7f0066560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 shutdown_connections 2021-02-24T15:28:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 1 -- 172.21.15.152:0/1173902909 wait complete. 2021-02-24T15:28:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.202+0000 7fa7f61eb700 1 librados: shutdown 2021-02-24T15:28:01.216 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:28:01.216 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:28:01.216 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:28:01.216 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:28:01.217 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 56, 2021-02-24T15:28:01.217 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:28:01.217 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:28:01.217 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:28:01.217 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:28:01.218 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.218 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 2, 2021-02-24T15:28:01.218 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:01.219 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:28:01.219 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:28:01.219 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:01.219 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:01.219 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:01.220 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:01.220 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:01.220 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:01.220 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:01.220 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:01.221 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:01.221 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.221 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:28:01.221 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:28:01.221 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:01.222 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:01.222 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:01.222 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:01.223 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:01.223 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:01.223 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:01.223 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:01.231 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:01.231 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.231 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:28:01.232 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:28:01.232 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:28:01.232 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:28:01.232 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:28:01.247 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:28:01.247 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:01.247 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:01.248 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:28:01.248 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:28:01.248 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:28:01.248 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:28:01.249 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:28:01.249 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:01.249 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:28:01.249 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:01.250 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:01.250 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:01.251 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:01.251 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:01.251 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:01.251 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:01.252 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:01.252 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:01.252 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.252 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:28:01.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.253 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:28:01.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.253 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:28:01.253 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:28:01.254 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:01.254 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:01.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.254 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:01.255 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:28:01.255 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:01.255 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.255 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.256 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:28:01.256 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:28:01.256 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:01.256 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:01.257 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:01.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.258 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:28:01.258 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:28:01.258 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:01.259 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:01.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.260 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:01.260 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:28:01.260 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:01.261 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.261 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.261 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:28:01.262 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:28:01.262 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:01.262 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:01.262 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:01.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.263 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:28:01.263 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:28:01.263 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:01.264 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:01.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.264 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:01.264 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:28:01.264 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:01.265 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.266 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.266 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:28:01.267 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:28:01.267 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:01.267 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:01.267 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:01.267 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.268 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.269 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:28:01.269 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:28:01.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.270 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:01.270 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:01.270 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:28:01.270 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.270 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.271 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:28:01.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.271 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:01.271 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:01.271 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:28:01.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.272 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.272 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:28:01.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.272 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:01.273 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:01.273 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:28:01.273 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.274 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.274 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:28:01.274 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:28:01.275 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:28:01.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.402+0000 7faa7e0c1700 1 Processor -- start 2021-02-24T15:28:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.402+0000 7faa7e0c1700 1 -- start start 2021-02-24T15:28:01.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.403+0000 7faa7e0c1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa78062660 con 0x7faa78095bb0 2021-02-24T15:28:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.403+0000 7faa7e0c1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa78063af0 con 0x7faa780966a0 2021-02-24T15:28:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.403+0000 7faa7e0c1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa78063d90 con 0x7faa78068410 2021-02-24T15:28:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.403+0000 7faa77fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7faa78068410 0x7faa78133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37408/0 (socket says 172.21.15.152:37408) 2021-02-24T15:28:01.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.403+0000 7faa76ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7faa78095bb0 0x7faa78130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48930/0 (socket says 172.21.15.152:48930) 2021-02-24T15:28:01.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.403+0000 7faa77fff700 1 -- 172.21.15.152:0/2265926071 learned_addr learned my addr 172.21.15.152:0/2265926071 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa76ffd700 1 -- 172.21.15.152:0/2265926071 >> v1:172.21.15.152:6789/0 conn(0x7faa78095bb0 legacy=0x7faa78130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa77fff700 1 -- 172.21.15.152:0/2265926071 >> v1:172.21.15.152:6790/0 conn(0x7faa78068410 legacy=0x7faa78133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720618171 0 0) 0x7faa78062660 con 0x7faa78095bb0 2021-02-24T15:28:01.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa64003230 con 0x7faa78095bb0 2021-02-24T15:28:01.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403611352 0 0) 0x7faa78063d90 con 0x7faa78068410 2021-02-24T15:28:01.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa78062660 con 0x7faa78068410 2021-02-24T15:28:01.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa777fe700 1 -- 172.21.15.152:0/2265926071 >> v1:172.21.15.181:6789/0 conn(0x7faa780966a0 legacy=0x7faa78096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4131684696 0 0) 0x7faa78062660 con 0x7faa78068410 2021-02-24T15:28:01.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 >> v1:172.21.15.181:6789/0 conn(0x7faa780966a0 legacy=0x7faa78096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 >> v1:172.21.15.152:6789/0 conn(0x7faa78095bb0 legacy=0x7faa78130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78064030 con 0x7faa78068410 2021-02-24T15:28:01.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.405+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa70001d70 con 0x7faa78068410 2021-02-24T15:28:01.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.406+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faa70001fd0 con 0x7faa78068410 2021-02-24T15:28:01.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.406+0000 7faa767fc700 1 -- 172.21.15.152:0/2265926071 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa70004ad0 con 0x7faa78068410 2021-02-24T15:28:01.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.406+0000 7faa7e0c1700 1 -- 172.21.15.152:0/2265926071 >> v1:172.21.15.152:6790/0 conn(0x7faa78068410 legacy=0x7faa78133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.406+0000 7faa7e0c1700 1 -- 172.21.15.152:0/2265926071 shutdown_connections 2021-02-24T15:28:01.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.406+0000 7faa7e0c1700 1 -- 172.21.15.152:0/2265926071 >> 172.21.15.152:0/2265926071 conn(0x7faa7809ba40 msgr2=0x7faa7809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:01.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.406+0000 7faa7e0c1700 1 -- 172.21.15.152:0/2265926071 shutdown_connections 2021-02-24T15:28:01.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.406+0000 7faa7e0c1700 1 -- 172.21.15.152:0/2265926071 wait complete. 2021-02-24T15:28:01.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.407+0000 7faa7e0c1700 1 librados: starting msgr at 2021-02-24T15:28:01.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.407+0000 7faa7e0c1700 1 librados: starting objecter 2021-02-24T15:28:01.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.407+0000 7faa7e0c1700 1 Processor -- start 2021-02-24T15:28:01.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.407+0000 7faa7e0c1700 1 -- start start 2021-02-24T15:28:01.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.407+0000 7faa7e0c1700 1 librados: setting wanted keys 2021-02-24T15:28:01.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.407+0000 7faa7e0c1700 1 librados: calling monclient init 2021-02-24T15:28:01.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.408+0000 7faa7e0c1700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa781346a0 con 0x7faa78095bb0 2021-02-24T15:28:01.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.408+0000 7faa7e0c1700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7811b970 con 0x7faa780966a0 2021-02-24T15:28:01.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.408+0000 7faa7e0c1700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7811aea0 con 0x7faa78068410 2021-02-24T15:28:01.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.408+0000 7faa76ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7faa78095bb0 0x7faa78133f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48936/0 (socket says 172.21.15.152:48936) 2021-02-24T15:28:01.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.408+0000 7faa76ffd700 1 -- 172.21.15.152:0/3514189908 learned_addr learned my addr 172.21.15.152:0/3514189908 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:01.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa76ffd700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.152:6789/0 conn(0x7faa78095bb0 legacy=0x7faa78133f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa777fe700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.152:6790/0 conn(0x7faa78068410 legacy=0x7faa7813a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 10 client.?.objecter ms_handle_connect 0x7faa78095bb0 2021-02-24T15:28:01.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 10 client.?.objecter ms_handle_connect 0x7faa78068410 2021-02-24T15:28:01.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105891161 0 0) 0x7faa781346a0 con 0x7faa78095bb0 2021-02-24T15:28:01.419 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa58004bd0 con 0x7faa78095bb0 2021-02-24T15:28:01.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 10 client.?.objecter ms_handle_connect 0x7faa780966a0 2021-02-24T15:28:01.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa77fff700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.181:6789/0 conn(0x7faa780966a0 legacy=0x7faa781423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922679145 0 0) 0x7faa7811aea0 con 0x7faa78068410 2021-02-24T15:28:01.420 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa781346a0 con 0x7faa78068410 2021-02-24T15:28:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766035453 0 0) 0x7faa7811b970 con 0x7faa780966a0 2021-02-24T15:28:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa7811aea0 con 0x7faa780966a0 2021-02-24T15:28:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4196952006 0 0) 0x7faa58004bd0 con 0x7faa78095bb0 2021-02-24T15:28:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa7811b970 con 0x7faa78095bb0 2021-02-24T15:28:01.421 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa6c001c60 con 0x7faa78095bb0 2021-02-24T15:28:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4014967373 0 0) 0x7faa781346a0 con 0x7faa78068410 2021-02-24T15:28:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa58004bd0 con 0x7faa78068410 2021-02-24T15:28:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa68001b60 con 0x7faa78068410 2021-02-24T15:28:01.422 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3081112810 0 0) 0x7faa7811b970 con 0x7faa78095bb0 2021-02-24T15:28:01.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.152:6790/0 conn(0x7faa78068410 legacy=0x7faa7813a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.181:6789/0 conn(0x7faa780966a0 legacy=0x7faa781423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78067480 con 0x7faa78095bb0 2021-02-24T15:28:01.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7811a4a0 con 0x7faa78095bb0 2021-02-24T15:28:01.423 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa7e0c1700 10 client.28404.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:28:01.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faa78118e00 con 0x7faa78095bb0 2021-02-24T15:28:01.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.410+0000 7faa7e0c1700 1 librados: init done 2021-02-24T15:28:01.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.411+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7faa78058400 con 0x7faa781140b0 2021-02-24T15:28:01.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.411+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7faa6c004920 con 0x7faa78095bb0 2021-02-24T15:28:01.424 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.411+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa6c004c30 con 0x7faa78095bb0 2021-02-24T15:28:01.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.411+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7faa6c004d90 con 0x7faa78095bb0 2021-02-24T15:28:01.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.412+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(468..468 src has 230..468) v4 ==== 6507+0+0 (unknown 2109364278 0 0) 0x7faa6c03b500 con 0x7faa78095bb0 2021-02-24T15:28:01.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.412+0000 7faa5f7fe700 10 client.28404.objecter ms_dispatch 0x7faa78001510 osd_map(468..468 src has 230..468) v4 2021-02-24T15:28:01.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.412+0000 7faa5f7fe700 3 client.28404.objecter handle_osd_map got epochs [468,468] > 0 2021-02-24T15:28:01.425 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.412+0000 7faa5f7fe700 3 client.28404.objecter handle_osd_map decoding full epoch 468 2021-02-24T15:28:01.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.412+0000 7faa5f7fe700 20 client.28404.objecter dump_active .. 0 homeless 2021-02-24T15:28:01.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.413+0000 7faa777fe700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.181:6789/0 conn(0x7faa781140b0 legacy=0x7faa78114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 10 client.28404.objecter ms_handle_connect 0x7faa781140b0 2021-02-24T15:28:01.426 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 10 client.28404.objecter resend_mon_ops 2021-02-24T15:28:01.427 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481822745 0 0) 0x7faa78058400 con 0x7faa781140b0 2021-02-24T15:28:01.427 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa7811b970 con 0x7faa781140b0 2021-02-24T15:28:01.427 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3441464216 0 0) 0x7faa7811b970 con 0x7faa781140b0 2021-02-24T15:28:01.427 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa78058400 con 0x7faa781140b0 2021-02-24T15:28:01.427 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa68002770 con 0x7faa781140b0 2021-02-24T15:28:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 10 client.28404.objecter ms_handle_connect 0x7faa580315f0 2021-02-24T15:28:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 483524701 0 0) 0x7faa78058400 con 0x7faa781140b0 2021-02-24T15:28:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.414+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa7811a690 con 0x7faa781140b0 2021-02-24T15:28:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.415+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7faa68002a60 con 0x7faa781140b0 2021-02-24T15:28:01.428 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.415+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.181:6789/0 conn(0x7faa781140b0 legacy=0x7faa78114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.429 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.415+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.181:6789/0 conn(0x7faa781140b0 legacy=0x7faa78114490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.422+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7faa781190b0 con 0x7faa78027010 2021-02-24T15:28:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.425+0000 7faa777fe700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.181:6789/0 conn(0x7faa78027010 legacy=0x7faa78147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.425+0000 7faa5f7fe700 10 client.28404.objecter ms_handle_connect 0x7faa78027010 2021-02-24T15:28:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.425+0000 7faa5f7fe700 10 client.28404.objecter resend_mon_ops 2021-02-24T15:28:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.425+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053709958 0 0) 0x7faa781190b0 con 0x7faa78027010 2021-02-24T15:28:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.425+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa78058400 con 0x7faa78027010 2021-02-24T15:28:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.426+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2089676079 0 0) 0x7faa78058400 con 0x7faa78027010 2021-02-24T15:28:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.426+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa781190b0 con 0x7faa78027010 2021-02-24T15:28:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.426+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7faa68005770 con 0x7faa78027010 2021-02-24T15:28:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.426+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2818393628 0 0) 0x7faa781190b0 con 0x7faa78027010 2021-02-24T15:28:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.426+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7faa78097190 con 0x7faa78027010 2021-02-24T15:28:01.433 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.426+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 505746379) 0x7faa68005a60 con 0x7faa78027010 2021-02-24T15:28:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.426+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.181:6789/0 conn(0x7faa78027010 legacy=0x7faa78147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.426+0000 7faa5f7fe700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.181:6789/0 conn(0x7faa78027010 legacy=0x7faa78147ae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 10 librados: watch_flush enter 2021-02-24T15:28:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 10 librados: watch_flush exit 2021-02-24T15:28:01.434 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 20 client.28404.objecter shutdown clearing up homeless session... 2021-02-24T15:28:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 10 client.28404.objecter successfully canceled tick 2021-02-24T15:28:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.181:6812/33484 conn(0x7faa580315f0 legacy=0x7faa58033ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 >> v1:172.21.15.152:6789/0 conn(0x7faa78095bb0 legacy=0x7faa78133f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa77fff700 1 -- 172.21.15.152:0/3514189908 reap_dead start 2021-02-24T15:28:01.435 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa77fff700 1 -- 172.21.15.152:0/3514189908 reap_dead start 2021-02-24T15:28:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 shutdown_connections 2021-02-24T15:28:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 >> 172.21.15.152:0/3514189908 conn(0x7faa7809ba40 msgr2=0x7faa7809a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 shutdown_connections 2021-02-24T15:28:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 1 -- 172.21.15.152:0/3514189908 wait complete. 2021-02-24T15:28:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.427+0000 7faa7e0c1700 1 librados: shutdown 2021-02-24T15:28:01.437 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:28:01.437 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:28:01.437 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:28:01.437 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:28:01.438 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 56, 2021-02-24T15:28:01.438 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:28:01.438 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:28:01.438 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:28:01.438 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:28:01.439 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.439 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:28:01.439 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:01.439 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:28:01.439 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:28:01.440 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:01.440 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:01.440 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:01.440 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:01.440 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:01.441 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:01.441 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:01.441 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:01.441 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:01.441 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.442 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:28:01.442 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:28:01.442 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:01.442 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:01.443 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:01.444 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:01.444 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:01.444 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.444 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:28:01.445 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:28:01.445 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:28:01.445 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:28:01.445 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:28:01.445 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:28:01.446 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:01.446 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:01.446 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:28:01.446 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:28:01.446 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:28:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:28:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:28:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:28:01.447 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:01.448 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:01.448 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:01.448 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:01.448 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:01.449 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.450 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:28:01.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.450 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:28:01.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.450 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:28:01.451 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:28:01.451 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:01.451 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:01.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.451 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:01.452 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:28:01.452 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:01.452 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.452 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.453 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:28:01.453 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:28:01.453 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:01.453 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:01.454 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:01.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.454 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:28:01.454 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:28:01.455 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:01.455 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:01.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.455 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:01.455 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:28:01.456 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:01.456 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.456 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.456 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:28:01.457 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:28:01.457 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:01.457 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:01.457 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:01.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.458 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:28:01.458 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:28:01.458 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:01.459 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:01.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.459 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:01.459 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:28:01.459 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:01.460 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.460 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.460 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:28:01.460 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:28:01.461 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:01.461 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:01.461 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:01.461 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.461 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.462 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:28:01.462 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:28:01.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.462 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:01.463 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:01.463 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:28:01.463 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.463 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:01.463 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:28:01.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:01.464 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:01.464 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:01.464 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:28:01.464 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:01.465 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:01.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:01.465 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:28:01.465 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:28:01.467 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2021-02-24T15:28:01.467 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2021-02-24T15:28:01.467 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2021-02-24T15:28:01.467 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2021-02-24T15:28:01.468 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-02-24T15:28:01.468 INFO:teuthology.orchestra.run:waiting for 300 2021-02-24T15:28:01.479 INFO:tasks.ceph.mon.b:Stopped 2021-02-24T15:28:01.480 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2021-02-24T15:28:01.480 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:28:01.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.594+0000 7f95189eb700 1 Processor -- start 2021-02-24T15:28:01.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.595+0000 7f95189eb700 1 -- start start 2021-02-24T15:28:01.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.595+0000 7f95189eb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9514063aa0 con 0x7f95140681d0 2021-02-24T15:28:01.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.595+0000 7f95189eb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9514093e50 con 0x7f951412d150 2021-02-24T15:28:01.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.595+0000 7f95189eb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9514063cf0 con 0x7f9514130c60 2021-02-24T15:28:01.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.595+0000 7f951359e700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f9514130c60 0x7f9514133050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37426/0 (socket says 172.21.15.152:37426) 2021-02-24T15:28:01.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.595+0000 7f9512d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f95140681d0 0x7f9514063070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48948/0 (socket says 172.21.15.152:48948) 2021-02-24T15:28:01.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.595+0000 7f951259c700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f951412d150 legacy=0x7f951412f540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:01.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.595+0000 7f951359e700 1 -- 172.21.15.152:0/1322230852 learned_addr learned my addr 172.21.15.152:0/1322230852 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.597+0000 7f9512d9d700 1 -- 172.21.15.152:0/1322230852 >> v1:172.21.15.152:6789/0 conn(0x7f95140681d0 legacy=0x7f9514063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.597+0000 7f951359e700 1 -- 172.21.15.152:0/1322230852 >> v1:172.21.15.152:6790/0 conn(0x7f9514130c60 legacy=0x7f9514133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f9511d9b700 1 -- 172.21.15.152:0/1322230852 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235108282 0 0) 0x7f9514063aa0 con 0x7f95140681d0 2021-02-24T15:28:01.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f9511d9b700 1 -- 172.21.15.152:0/1322230852 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9500003230 con 0x7f95140681d0 2021-02-24T15:28:01.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f9511d9b700 1 -- 172.21.15.152:0/1322230852 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4159865665 0 0) 0x7f9500003230 con 0x7f95140681d0 2021-02-24T15:28:01.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f9511d9b700 1 -- 172.21.15.152:0/1322230852 >> v1:172.21.15.152:6790/0 conn(0x7f9514130c60 legacy=0x7f9514133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f9511d9b700 1 -- 172.21.15.152:0/1322230852 >> v1:172.21.15.181:6789/0 conn(0x7f951412d150 legacy=0x7f951412f540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:28:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f9511d9b700 1 -- 172.21.15.152:0/1322230852 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514063fb0 con 0x7f95140681d0 2021-02-24T15:28:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f9511d9b700 1 -- 172.21.15.152:0/1322230852 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f95040019f0 con 0x7f95140681d0 2021-02-24T15:28:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f9511d9b700 1 -- 172.21.15.152:0/1322230852 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9504001ce0 con 0x7f95140681d0 2021-02-24T15:28:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f9511d9b700 1 -- 172.21.15.152:0/1322230852 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9504004690 con 0x7f95140681d0 2021-02-24T15:28:01.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f95189eb700 1 -- 172.21.15.152:0/1322230852 >> v1:172.21.15.152:6789/0 conn(0x7f95140681d0 legacy=0x7f9514063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f95189eb700 1 -- 172.21.15.152:0/1322230852 shutdown_connections 2021-02-24T15:28:01.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f95189eb700 1 -- 172.21.15.152:0/1322230852 >> 172.21.15.152:0/1322230852 conn(0x7f951409b950 msgr2=0x7f951409bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:01.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f95189eb700 1 -- 172.21.15.152:0/1322230852 shutdown_connections 2021-02-24T15:28:01.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.598+0000 7f95189eb700 1 -- 172.21.15.152:0/1322230852 wait complete. 2021-02-24T15:28:01.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.599+0000 7f95189eb700 1 librados: starting msgr at 2021-02-24T15:28:01.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.599+0000 7f95189eb700 1 librados: starting objecter 2021-02-24T15:28:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.599+0000 7f95189eb700 1 Processor -- start 2021-02-24T15:28:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.599+0000 7f95189eb700 1 -- start start 2021-02-24T15:28:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.599+0000 7f95189eb700 1 librados: setting wanted keys 2021-02-24T15:28:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.599+0000 7f95189eb700 1 librados: calling monclient init 2021-02-24T15:28:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.600+0000 7f95189eb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9514095700 con 0x7f95140681d0 2021-02-24T15:28:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.600+0000 7f95189eb700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9514128c70 con 0x7f9514130c60 2021-02-24T15:28:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.600+0000 7f95189eb700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9514128f10 con 0x7f951412d150 2021-02-24T15:28:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.600+0000 7f9512d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f95140681d0 0x7f9514139ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48952/0 (socket says 172.21.15.152:48952) 2021-02-24T15:28:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.600+0000 7f9512d9d700 1 -- 172.21.15.152:0/828112808 learned_addr learned my addr 172.21.15.152:0/828112808 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.600+0000 7f951359e700 1 -- 172.21.15.152:0/828112808 >> v1:172.21.15.181:6789/0 conn(0x7f9514130c60 legacy=0x7f9514141ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f951259c700 1 -- 172.21.15.152:0/828112808 >> v1:172.21.15.152:6790/0 conn(0x7f951412d150 legacy=0x7f951412c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 10 client.?.objecter ms_handle_connect 0x7f951412d150 2021-02-24T15:28:01.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 10 client.?.objecter ms_handle_connect 0x7f95140681d0 2021-02-24T15:28:01.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:01.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f9512d9d700 1 -- 172.21.15.152:0/828112808 >> v1:172.21.15.152:6789/0 conn(0x7f95140681d0 legacy=0x7f9514139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:01.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222421131 0 0) 0x7f9514128f10 con 0x7f951412d150 2021-02-24T15:28:01.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94f4004bd0 con 0x7f951412d150 2021-02-24T15:28:01.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763072210 0 0) 0x7f9514095700 con 0x7f95140681d0 2021-02-24T15:28:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9514128f10 con 0x7f95140681d0 2021-02-24T15:28:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1687346968 0 0) 0x7f9514128f10 con 0x7f95140681d0 2021-02-24T15:28:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9514095700 con 0x7f95140681d0 2021-02-24T15:28:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9504004690 con 0x7f95140681d0 2021-02-24T15:28:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.602+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4009257130 0 0) 0x7f94f4004bd0 con 0x7f951412d150 2021-02-24T15:28:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9514128f10 con 0x7f951412d150 2021-02-24T15:28:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9508004170 con 0x7f951412d150 2021-02-24T15:28:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4130744607 0 0) 0x7f9514095700 con 0x7f95140681d0 2021-02-24T15:28:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 >> v1:172.21.15.152:6790/0 conn(0x7f951412d150 legacy=0x7f951412c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 >> v1:172.21.15.181:6789/0 conn(0x7f9514130c60 legacy=0x7f9514141ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:28:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514133a40 con 0x7f95140681d0 2021-02-24T15:28:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951413a3b0 con 0x7f95140681d0 2021-02-24T15:28:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f95189eb700 10 client.28410.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:28:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f951412ccb0 con 0x7f95140681d0 2021-02-24T15:28:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f95189eb700 1 librados: init done 2021-02-24T15:28:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9504001560 con 0x7f95140681d0 2021-02-24T15:28:01.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9504005030 con 0x7f95140681d0 2021-02-24T15:28:01.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.603+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f950400db30 con 0x7f95140681d0 2021-02-24T15:28:01.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.604+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec004d60 con 0x7f95140681d0 2021-02-24T15:28:01.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.604+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(468..468 src has 230..468) v4 ==== 6507+0+0 (unknown 2109364278 0 0) 0x7f950403b700 con 0x7f95140681d0 2021-02-24T15:28:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.604+0000 7f94faffd700 10 client.28410.objecter ms_dispatch 0x7f9514001510 osd_map(468..468 src has 230..468) v4 2021-02-24T15:28:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.604+0000 7f94faffd700 3 client.28410.objecter handle_osd_map got epochs [468,468] > 0 2021-02-24T15:28:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.604+0000 7f94faffd700 3 client.28410.objecter handle_osd_map decoding full epoch 468 2021-02-24T15:28:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.604+0000 7f94faffd700 20 client.28410.objecter dump_active .. 0 homeless 2021-02-24T15:28:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.606+0000 7f94faffd700 10 client.28410.objecter ms_handle_connect 0x7f94f40314f0 2021-02-24T15:28:01.624 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.608+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f9504012a70 con 0x7f95140681d0 2021-02-24T15:28:01.842 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.841+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f94ec005010 con 0x7f95140681d0 2021-02-24T15:28:01.843 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.841+0000 7f94faffd700 1 -- 172.21.15.152:0/828112808 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 207761750) 0x7f9504012660 con 0x7f95140681d0 2021-02-24T15:28:01.843 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:28:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 10 librados: watch_flush enter 2021-02-24T15:28:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 10 librados: watch_flush exit 2021-02-24T15:28:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 20 client.28410.objecter shutdown clearing up homeless session... 2021-02-24T15:28:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 10 client.28410.objecter successfully canceled tick 2021-02-24T15:28:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 >> v1:172.21.15.181:6812/33484 conn(0x7f94f40314f0 legacy=0x7f94f40339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 >> v1:172.21.15.152:6789/0 conn(0x7f95140681d0 legacy=0x7f9514139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:01.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 shutdown_connections 2021-02-24T15:28:01.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 >> 172.21.15.152:0/828112808 conn(0x7f951409b950 msgr2=0x7f951412f540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:01.846 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 shutdown_connections 2021-02-24T15:28:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 1 -- 172.21.15.152:0/828112808 wait complete. 2021-02-24T15:28:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:01.843+0000 7f95189eb700 1 librados: shutdown 2021-02-24T15:28:04.857 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:28:04.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.984+0000 7f003a4b6700 1 Processor -- start 2021-02-24T15:28:04.985 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.984+0000 7f003a4b6700 1 -- start start 2021-02-24T15:28:04.986 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.984+0000 7f003a4b6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0034092280 con 0x7f0034093a40 2021-02-24T15:28:04.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.984+0000 7f003a4b6700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0034090840 con 0x7f0034094730 2021-02-24T15:28:04.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.984+0000 7f003a4b6700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340924b0 con 0x7f003412e1c0 2021-02-24T15:28:04.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.985+0000 7f00337fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0034093a40 0x7f0034090130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48966/0 (socket says 172.21.15.152:48966) 2021-02-24T15:28:04.987 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.985+0000 7f00337fe700 1 -- 172.21.15.152:0/3147823332 learned_addr learned my addr 172.21.15.152:0/3147823332 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:04.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.985+0000 7f0038a53700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f003412e1c0 0x7f00341305b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37444/0 (socket says 172.21.15.152:37444) 2021-02-24T15:28:04.988 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.985+0000 7f0033fff700 1 -- 172.21.15.152:0/3147823332 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f003408fa20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:04.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f00337fe700 1 -- 172.21.15.152:0/3147823332 >> v1:172.21.15.152:6789/0 conn(0x7f0034093a40 legacy=0x7f0034090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:04.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0038a53700 1 -- 172.21.15.152:0/3147823332 >> v1:172.21.15.152:6790/0 conn(0x7f003412e1c0 legacy=0x7f00341305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:04.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0032ffd700 1 -- 172.21.15.152:0/3147823332 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232846517 0 0) 0x7f0034092280 con 0x7f0034093a40 2021-02-24T15:28:04.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0032ffd700 1 -- 172.21.15.152:0/3147823332 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0020003230 con 0x7f0034093a40 2021-02-24T15:28:04.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0032ffd700 1 -- 172.21.15.152:0/3147823332 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2022979098 0 0) 0x7f0020003230 con 0x7f0034093a40 2021-02-24T15:28:04.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0032ffd700 1 -- 172.21.15.152:0/3147823332 >> v1:172.21.15.152:6790/0 conn(0x7f003412e1c0 legacy=0x7f00341305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:04.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0032ffd700 1 -- 172.21.15.152:0/3147823332 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f003408fa20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:28:04.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0032ffd700 1 -- 172.21.15.152:0/3147823332 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034092750 con 0x7f0034093a40 2021-02-24T15:28:04.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0032ffd700 1 -- 172.21.15.152:0/3147823332 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0028001930 con 0x7f0034093a40 2021-02-24T15:28:04.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0032ffd700 1 -- 172.21.15.152:0/3147823332 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0028001c40 con 0x7f0034093a40 2021-02-24T15:28:04.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.987+0000 7f0032ffd700 1 -- 172.21.15.152:0/3147823332 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0028004750 con 0x7f0034093a40 2021-02-24T15:28:04.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.988+0000 7f003a4b6700 1 -- 172.21.15.152:0/3147823332 >> v1:172.21.15.152:6789/0 conn(0x7f0034093a40 legacy=0x7f0034090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:04.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.988+0000 7f003a4b6700 1 -- 172.21.15.152:0/3147823332 shutdown_connections 2021-02-24T15:28:04.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.988+0000 7f003a4b6700 1 -- 172.21.15.152:0/3147823332 >> 172.21.15.152:0/3147823332 conn(0x7f00340999a0 msgr2=0x7f0034099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:04.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.988+0000 7f003a4b6700 1 -- 172.21.15.152:0/3147823332 shutdown_connections 2021-02-24T15:28:04.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.988+0000 7f003a4b6700 1 -- 172.21.15.152:0/3147823332 wait complete. 2021-02-24T15:28:04.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.988+0000 7f003a4b6700 1 librados: starting msgr at 2021-02-24T15:28:04.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.988+0000 7f003a4b6700 1 librados: starting objecter 2021-02-24T15:28:04.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f003a4b6700 1 Processor -- start 2021-02-24T15:28:04.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f003a4b6700 1 -- start start 2021-02-24T15:28:04.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f003a4b6700 1 librados: setting wanted keys 2021-02-24T15:28:04.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f003a4b6700 1 librados: calling monclient init 2021-02-24T15:28:04.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f003a4b6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0034066600 con 0x7f003412e1c0 2021-02-24T15:28:04.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f003a4b6700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340668a0 con 0x7f0034094730 2021-02-24T15:28:04.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f003a4b6700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0034066b40 con 0x7f0034093a40 2021-02-24T15:28:04.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f0033fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f0034093a40 0x7f00340671a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37446/0 (socket says 172.21.15.152:37446) 2021-02-24T15:28:04.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f0033fff700 1 -- 172.21.15.152:0/202934595 learned_addr learned my addr 172.21.15.152:0/202934595 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:04.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.989+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f0034125150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:04.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.991+0000 7f0033fff700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6790/0 conn(0x7f0034093a40 legacy=0x7f00340671a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:04.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.992+0000 7f0038a53700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f003412e1c0 legacy=0x7f0034125860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:04.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.992+0000 7f001bfff700 10 client.?.objecter ms_handle_connect 0x7f0034093a40 2021-02-24T15:28:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.992+0000 7f001bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.992+0000 7f001bfff700 10 client.?.objecter ms_handle_connect 0x7f003412e1c0 2021-02-24T15:28:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.992+0000 7f001bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:05.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.992+0000 7f0038a53700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f003412e1c0 legacy=0x7f0034125860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-02-24T15:28:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.992+0000 7f0038a53700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f003412e1c0 legacy=0x7f0034125860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:28:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.992+0000 7f0038a53700 1 --1- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f003412e1c0 0x7f0034125860 :-1 s=OPENED pgs=9214 cs=1 l=1).handle_message read tag failed 2021-02-24T15:28:05.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:04.992+0000 7f0038a53700 1 --1- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f003412e1c0 0x7f0034125860 :-1 s=OPENED pgs=9214 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:28:05.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:05.191+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f0034125150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:05.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:05.592+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f0034125150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:06.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:06.393+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f0034125150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.990+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6790/0 conn(0x7f0034093a40 legacy=0x7f00340671a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:08.172 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.990+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f0034125150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:28:08.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.990+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f003412e1c0 legacy=0x7f0034125860 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:08.173 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.990+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0034065720 con 0x7f003412e1c0 2021-02-24T15:28:08.174 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.990+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340668a0 con 0x7f0034094730 2021-02-24T15:28:08.175 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.990+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c010080 con 0x7f000c003380 2021-02-24T15:28:08.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.990+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:08.176 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.992+0000 7f001bfff700 10 client.?.objecter ms_handle_connect 0x7f000c003380 2021-02-24T15:28:08.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.992+0000 7f001bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:08.177 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.992+0000 7f0033fff700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6790/0 conn(0x7f000c003380 legacy=0x7f000c0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:08.178 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.992+0000 7f001bfff700 10 client.?.objecter ms_handle_connect 0x7f003412e1c0 2021-02-24T15:28:08.179 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.992+0000 7f001bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:08.180 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:07.992+0000 7f0038a53700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f003412e1c0 legacy=0x7f000c00c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:08.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:08.191+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:08.592 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:08.592+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:09.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:09.393+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:10.991 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6790/0 conn(0x7f000c003380 legacy=0x7f000c0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:10.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:28:10.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f003412e1c0 legacy=0x7f000c00c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:10.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0112f0 con 0x7f000c00e250 2021-02-24T15:28:10.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340668a0 con 0x7f0034094730 2021-02-24T15:28:10.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c010ae0 con 0x7f000c003380 2021-02-24T15:28:10.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.991+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:10.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.993+0000 7f0033fff700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f000c00e250 legacy=0x7f000c010210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:10.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.993+0000 7f001bfff700 10 client.?.objecter ms_handle_connect 0x7f000c00e250 2021-02-24T15:28:10.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.993+0000 7f001bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:10.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.993+0000 7f001bfff700 10 client.?.objecter ms_handle_connect 0x7f000c003380 2021-02-24T15:28:10.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.993+0000 7f001bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:10.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:10.993+0000 7f0038a53700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6790/0 conn(0x7f000c003380 legacy=0x7f000c0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:11.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:11.192+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:11.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:11.593+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:12.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:12.394+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:13.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6790/0 conn(0x7f000c003380 legacy=0x7f000c0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:13.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:28:13.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f000c00e250 legacy=0x7f000c010210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:13.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c010ce0 con 0x7f000c00e250 2021-02-24T15:28:13.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.991+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340668a0 con 0x7f0034094730 2021-02-24T15:28:13.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.992+0000 7f001affd700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c00fa70 con 0x7f000c00f640 2021-02-24T15:28:13.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.992+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:13.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.994+0000 7f001bfff700 10 client.?.objecter ms_handle_connect 0x7f000c00f640 2021-02-24T15:28:13.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.994+0000 7f001bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:13.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.994+0000 7f001bfff700 10 client.?.objecter ms_handle_connect 0x7f000c00e250 2021-02-24T15:28:13.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.994+0000 7f001bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:13.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.994+0000 7f0033fff700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6790/0 conn(0x7f000c00f640 legacy=0x7f000c00c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:13.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:13.994+0000 7f0038a53700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f000c00e250 legacy=0x7f000c0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:14.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:14.193+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:14.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:14.594+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:15.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.395+0000 7f00337fe700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:15.992 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.991+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563294769 0 0) 0x7f000c00fa70 con 0x7f000c00f640 2021-02-24T15:28:15.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.991+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0014004bd0 con 0x7f000c00f640 2021-02-24T15:28:15.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.992+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 36073774 0 0) 0x7f0014004bd0 con 0x7f000c00f640 2021-02-24T15:28:15.993 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.992+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f000c00fa70 con 0x7f000c00f640 2021-02-24T15:28:15.994 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.992+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f00240040d0 con 0x7f000c00f640 2021-02-24T15:28:15.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.995+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666961806 0 0) 0x7f000c010ce0 con 0x7f000c00e250 2021-02-24T15:28:15.995 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.995+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0014004bd0 con 0x7f000c00e250 2021-02-24T15:28:15.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.995+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3134542336 0 0) 0x7f0014004bd0 con 0x7f000c00e250 2021-02-24T15:28:15.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.995+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f000c010ce0 con 0x7f000c00e250 2021-02-24T15:28:15.996 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.995+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f002c001de0 con 0x7f000c00e250 2021-02-24T15:28:15.997 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2516216633 0 0) 0x7f000c010ce0 con 0x7f000c00e250 2021-02-24T15:28:15.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6790/0 conn(0x7f000c00f640 legacy=0x7f000c00c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:15.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6789/0 conn(0x7f0034094730 legacy=0x7f000c009050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:28:15.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c00fc50 con 0x7f000c00e250 2021-02-24T15:28:15.998 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00340649d0 con 0x7f000c00e250 2021-02-24T15:28:15.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f003a4b6700 10 client.28416.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:28:15.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0034067360 con 0x7f000c00e250 2021-02-24T15:28:15.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f003a4b6700 1 librados: init done 2021-02-24T15:28:15.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f002c004b20 con 0x7f000c00e250 2021-02-24T15:28:15.999 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.997+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f002c004e30 con 0x7f000c00e250 2021-02-24T15:28:16.000 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.998+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f002c00d930 con 0x7f000c00e250 2021-02-24T15:28:16.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.998+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(469..469 src has 230..469) v4 ==== 6507+0+0 (unknown 3392871596 0 0) 0x7f002c03b3e0 con 0x7f000c00e250 2021-02-24T15:28:16.001 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.998+0000 7f001bfff700 10 client.28416.objecter ms_dispatch 0x7f0034001510 osd_map(469..469 src has 230..469) v4 2021-02-24T15:28:16.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.998+0000 7f001bfff700 3 client.28416.objecter handle_osd_map got epochs [469,469] > 0 2021-02-24T15:28:16.002 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.998+0000 7f001bfff700 3 client.28416.objecter handle_osd_map decoding full epoch 469 2021-02-24T15:28:16.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.998+0000 7f001bfff700 20 client.28416.objecter dump_active .. 0 homeless 2021-02-24T15:28:16.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:15.999+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0034097150 con 0x7f000c00e250 2021-02-24T15:28:16.003 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.001+0000 7f001bfff700 10 client.28416.objecter ms_handle_connect 0x7f00140313b0 2021-02-24T15:28:16.004 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.003+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f002c012690 con 0x7f000c00e250 2021-02-24T15:28:16.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.239+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0034097150 con 0x7f000c00e250 2021-02-24T15:28:16.240 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.240+0000 7f001bfff700 1 -- 172.21.15.152:0/202934595 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1336 (unknown 254746657 0 445913290) 0x7f002c012280 con 0x7f000c00e250 2021-02-24T15:28:16.240 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":60,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:28:16.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 10 librados: watch_flush enter 2021-02-24T15:28:16.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 10 librados: watch_flush exit 2021-02-24T15:28:16.242 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 20 client.28416.objecter shutdown clearing up homeless session... 2021-02-24T15:28:16.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 10 client.28416.objecter successfully canceled tick 2021-02-24T15:28:16.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.181:6812/33484 conn(0x7f00140313b0 legacy=0x7f0014033870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.243 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 >> v1:172.21.15.152:6789/0 conn(0x7f000c00e250 legacy=0x7f000c0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 shutdown_connections 2021-02-24T15:28:16.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 >> 172.21.15.152:0/202934595 conn(0x7f00340999a0 msgr2=0x7f003412da60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:16.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 shutdown_connections 2021-02-24T15:28:16.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.241+0000 7f003a4b6700 1 -- 172.21.15.152:0/202934595 wait complete. 2021-02-24T15:28:16.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.242+0000 7f003a4b6700 1 librados: shutdown 2021-02-24T15:28:16.253 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2021-02-24T15:28:16.253 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:28:16.372 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.372+0000 7f48b3055700 1 Processor -- start 2021-02-24T15:28:16.373 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.372+0000 7f48b3055700 1 -- start start 2021-02-24T15:28:16.373 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.372+0000 7f48b3055700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac092e60 con 0x7f48ac094e40 2021-02-24T15:28:16.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.372+0000 7f48b3055700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac091f30 con 0x7f48ac091110 2021-02-24T15:28:16.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.372+0000 7f48b3055700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac0921d0 con 0x7f48ac095930 2021-02-24T15:28:16.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.372+0000 7f48abfff700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f48ac091110 legacy=0x7f48ac095220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:16.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.372+0000 7f48b15f2700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f48ac095930 0x7f48ac12f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37504/0 (socket says 172.21.15.152:37504) 2021-02-24T15:28:16.375 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.372+0000 7f48b0df1700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f48ac094e40 0x7f48ac092750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49024/0 (socket says 172.21.15.152:49024) 2021-02-24T15:28:16.376 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.372+0000 7f48b15f2700 1 -- 172.21.15.152:0/2018445594 learned_addr learned my addr 172.21.15.152:0/2018445594 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:16.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.374+0000 7f48b15f2700 1 -- 172.21.15.152:0/2018445594 >> v1:172.21.15.152:6790/0 conn(0x7f48ac095930 legacy=0x7f48ac12f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.374+0000 7f48b0df1700 1 -- 172.21.15.152:0/2018445594 >> v1:172.21.15.152:6789/0 conn(0x7f48ac094e40 legacy=0x7f48ac092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368680988 0 0) 0x7f48ac0921d0 con 0x7f48ac095930 2021-02-24T15:28:16.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4890003230 con 0x7f48ac095930 2021-02-24T15:28:16.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833218870 0 0) 0x7f48ac092e60 con 0x7f48ac094e40 2021-02-24T15:28:16.384 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48ac0921d0 con 0x7f48ac094e40 2021-02-24T15:28:16.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 654686192 0 0) 0x7f48ac0921d0 con 0x7f48ac094e40 2021-02-24T15:28:16.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 >> v1:172.21.15.152:6790/0 conn(0x7f48ac095930 legacy=0x7f48ac12f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.385 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 >> v1:172.21.15.181:6789/0 conn(0x7f48ac091110 legacy=0x7f48ac095220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:28:16.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac091590 con 0x7f48ac094e40 2021-02-24T15:28:16.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f48a0001930 con 0x7f48ac094e40 2021-02-24T15:28:16.386 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f48a0001c40 con 0x7f48ac094e40 2021-02-24T15:28:16.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48ab7fe700 1 -- 172.21.15.152:0/2018445594 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f48a0004690 con 0x7f48ac094e40 2021-02-24T15:28:16.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48b3055700 1 -- 172.21.15.152:0/2018445594 >> v1:172.21.15.152:6789/0 conn(0x7f48ac094e40 legacy=0x7f48ac092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.387 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48b3055700 1 -- 172.21.15.152:0/2018445594 shutdown_connections 2021-02-24T15:28:16.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48b3055700 1 -- 172.21.15.152:0/2018445594 >> 172.21.15.152:0/2018445594 conn(0x7f48ac0999a0 msgr2=0x7f48ac099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:16.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48b3055700 1 -- 172.21.15.152:0/2018445594 shutdown_connections 2021-02-24T15:28:16.388 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.375+0000 7f48b3055700 1 -- 172.21.15.152:0/2018445594 wait complete. 2021-02-24T15:28:16.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.376+0000 7f48b3055700 1 librados: starting msgr at 2021-02-24T15:28:16.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.376+0000 7f48b3055700 1 librados: starting objecter 2021-02-24T15:28:16.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.376+0000 7f48b3055700 1 Processor -- start 2021-02-24T15:28:16.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.376+0000 7f48b3055700 1 -- start start 2021-02-24T15:28:16.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.376+0000 7f48b3055700 1 librados: setting wanted keys 2021-02-24T15:28:16.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.376+0000 7f48b3055700 1 librados: calling monclient init 2021-02-24T15:28:16.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.377+0000 7f48b3055700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac067a50 con 0x7f48ac095930 2021-02-24T15:28:16.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.377+0000 7f48b3055700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac11abf0 con 0x7f48ac091110 2021-02-24T15:28:16.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.377+0000 7f48b3055700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac067040 con 0x7f48ac094e40 2021-02-24T15:28:16.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.377+0000 7f48b0df1700 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f48ac091110 legacy=0x7f48ac13a220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:16.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.377+0000 7f48abfff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f48ac094e40 0x7f48ac133ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37508/0 (socket says 172.21.15.152:37508) 2021-02-24T15:28:16.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.377+0000 7f48abfff700 1 -- 172.21.15.152:0/2358533993 learned_addr learned my addr 172.21.15.152:0/2358533993 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:16.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.377+0000 7f48b15f2700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f48ac095930 0x7f48ac1420f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49032/0 (socket says 172.21.15.152:49032) 2021-02-24T15:28:16.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48abfff700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6790/0 conn(0x7f48ac094e40 legacy=0x7f48ac133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.394 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48a8ff9700 10 client.?.objecter ms_handle_connect 0x7f48ac094e40 2021-02-24T15:28:16.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48a8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:16.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48a8ff9700 10 client.?.objecter ms_handle_connect 0x7f48ac095930 2021-02-24T15:28:16.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48a8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:16.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48b15f2700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6789/0 conn(0x7f48ac095930 legacy=0x7f48ac1420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216334455 0 0) 0x7f48ac067040 con 0x7f48ac094e40 2021-02-24T15:28:16.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f488c004bd0 con 0x7f48ac094e40 2021-02-24T15:28:16.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913180018 0 0) 0x7f48ac067a50 con 0x7f48ac095930 2021-02-24T15:28:16.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.379+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48ac067040 con 0x7f48ac095930 2021-02-24T15:28:16.397 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3674292243 0 0) 0x7f488c004bd0 con 0x7f48ac094e40 2021-02-24T15:28:16.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f48ac067a50 con 0x7f48ac094e40 2021-02-24T15:28:16.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4898004280 con 0x7f48ac094e40 2021-02-24T15:28:16.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1936144595 0 0) 0x7f48ac067040 con 0x7f48ac095930 2021-02-24T15:28:16.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f488c004bd0 con 0x7f48ac095930 2021-02-24T15:28:16.398 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f48a4001fe0 con 0x7f48ac095930 2021-02-24T15:28:16.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2784313220 0 0) 0x7f48ac067a50 con 0x7f48ac094e40 2021-02-24T15:28:16.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.181:6789/0 conn(0x7f48ac091110 legacy=0x7f48ac13a220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:28:16.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6789/0 conn(0x7f48ac095930 legacy=0x7f48ac1420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac1343f0 con 0x7f48ac094e40 2021-02-24T15:28:16.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac11a1f0 con 0x7f48ac094e40 2021-02-24T15:28:16.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48b3055700 10 client.84356.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:28:16.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac118c40 con 0x7f48ac094e40 2021-02-24T15:28:16.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48b3055700 1 librados: init done 2021-02-24T15:28:16.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f48980045a0 con 0x7f48ac094e40 2021-02-24T15:28:16.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f48980048b0 con 0x7f48ac094e40 2021-02-24T15:28:16.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.380+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f4898004ac0 con 0x7f48ac094e40 2021-02-24T15:28:16.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.381+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4884006550 con 0x7f48840027f0 2021-02-24T15:28:16.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.381+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(469..469 src has 230..469) v4 ==== 6507+0+0 (unknown 3392871596 0 0) 0x7f489803b5f0 con 0x7f48ac094e40 2021-02-24T15:28:16.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.381+0000 7f48a8ff9700 10 client.84356.objecter ms_dispatch 0x7f48ac001510 osd_map(469..469 src has 230..469) v4 2021-02-24T15:28:16.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.381+0000 7f48a8ff9700 3 client.84356.objecter handle_osd_map got epochs [469,469] > 0 2021-02-24T15:28:16.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.381+0000 7f48a8ff9700 3 client.84356.objecter handle_osd_map decoding full epoch 469 2021-02-24T15:28:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.381+0000 7f48a8ff9700 20 client.84356.objecter dump_active .. 0 homeless 2021-02-24T15:28:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48b15f2700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6789/0 conn(0x7f48840027f0 legacy=0x7f4884004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 10 client.84356.objecter ms_handle_connect 0x7f48840027f0 2021-02-24T15:28:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 10 client.84356.objecter resend_mon_ops 2021-02-24T15:28:16.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354070836 0 0) 0x7f4884006550 con 0x7f48840027f0 2021-02-24T15:28:16.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48ac067a50 con 0x7f48840027f0 2021-02-24T15:28:16.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4212560187 0 0) 0x7f48ac067a50 con 0x7f48840027f0 2021-02-24T15:28:16.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4884006550 con 0x7f48840027f0 2021-02-24T15:28:16.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f48a4004cb0 con 0x7f48840027f0 2021-02-24T15:28:16.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 791416831 0 0) 0x7f4884006550 con 0x7f48840027f0 2021-02-24T15:28:16.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4884009df0 con 0x7f48840027f0 2021-02-24T15:28:16.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.383+0000 7f48a8ff9700 10 client.84356.objecter ms_handle_connect 0x7f488c031490 2021-02-24T15:28:16.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.384+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f48a4005000 con 0x7f48840027f0 2021-02-24T15:28:16.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.384+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6789/0 conn(0x7f48840027f0 legacy=0x7f4884004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.384+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6789/0 conn(0x7f48840027f0 legacy=0x7f4884004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:16.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.391+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4884007520 con 0x7f48840068c0 2021-02-24T15:28:16.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 10 client.84356.objecter ms_handle_connect 0x7f48840068c0 2021-02-24T15:28:16.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 10 client.84356.objecter resend_mon_ops 2021-02-24T15:28:16.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48b15f2700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6789/0 conn(0x7f48840068c0 legacy=0x7f4884006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670437184 0 0) 0x7f4884007520 con 0x7f48840068c0 2021-02-24T15:28:16.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4884006550 con 0x7f48840068c0 2021-02-24T15:28:16.413 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 781443357 0 0) 0x7f4884006550 con 0x7f48840068c0 2021-02-24T15:28:16.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4884007520 con 0x7f48840068c0 2021-02-24T15:28:16.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f48a4005670 con 0x7f48840068c0 2021-02-24T15:28:16.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 801992846 0 0) 0x7f4884007520 con 0x7f48840068c0 2021-02-24T15:28:16.414 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4884008720 con 0x7f48840068c0 2021-02-24T15:28:16.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4101 (unknown 0 0 3997055577) 0x7f48a4006b30 con 0x7f48840068c0 2021-02-24T15:28:16.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.394+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6789/0 conn(0x7f48840068c0 legacy=0x7f4884006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48a8ff9700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6789/0 conn(0x7f48840068c0 legacy=0x7f4884006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:16.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 10 librados: watch_flush enter 2021-02-24T15:28:16.415 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 10 librados: watch_flush exit 2021-02-24T15:28:16.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 20 client.84356.objecter shutdown clearing up homeless session... 2021-02-24T15:28:16.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 10 client.84356.objecter successfully canceled tick 2021-02-24T15:28:16.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.181:6812/33484 conn(0x7f488c031490 legacy=0x7f488c033950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 >> v1:172.21.15.152:6790/0 conn(0x7f48ac094e40 legacy=0x7f48ac133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b15f2700 1 -- 172.21.15.152:0/2358533993 reap_dead start 2021-02-24T15:28:16.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b15f2700 1 -- 172.21.15.152:0/2358533993 reap_dead start 2021-02-24T15:28:16.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 shutdown_connections 2021-02-24T15:28:16.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 >> 172.21.15.152:0/2358533993 conn(0x7f48ac0999a0 msgr2=0x7f48ac067250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:16.417 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 shutdown_connections 2021-02-24T15:28:16.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 1 -- 172.21.15.152:0/2358533993 wait complete. 2021-02-24T15:28:16.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.395+0000 7f48b3055700 1 librados: shutdown 2021-02-24T15:28:16.418 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:28:16.419 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:28:16.419 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:28:16.419 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:28:16.419 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 60, 2021-02-24T15:28:16.420 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:28:16.420 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:28:16.420 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:28:16.420 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.421 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:28:16.421 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:16.421 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:28:16.421 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:28:16.421 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:16.422 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:16.422 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:16.422 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:16.423 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:16.423 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:16.423 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:16.424 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:16.424 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:16.424 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.425 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:28:16.425 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:28:16.425 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:16.426 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:16.426 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:16.426 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:16.426 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:16.426 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:16.427 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:16.427 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:16.427 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:16.427 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.428 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:28:16.428 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:28:16.429 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:28:16.429 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:28:16.429 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:28:16.429 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:28:16.430 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:16.430 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:16.430 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:28:16.431 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:28:16.431 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:28:16.431 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:28:16.431 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:28:16.432 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:16.432 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:28:16.432 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:16.432 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:16.432 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:16.433 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:16.433 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:16.433 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:16.433 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:16.433 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:16.434 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:16.434 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.434 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:28:16.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.435 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:28:16.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.435 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:28:16.435 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:28:16.435 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:16.436 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:16.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.436 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:16.436 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:28:16.436 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:16.437 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.437 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.437 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:28:16.437 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:28:16.438 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:16.438 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:16.438 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:16.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.439 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:28:16.439 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:28:16.440 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:16.440 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:16.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.440 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:28:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.442 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:28:16.442 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:28:16.442 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:16.443 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:16.443 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:16.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.443 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:28:16.444 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:28:16.444 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:16.444 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:16.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.444 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:16.445 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:28:16.445 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:16.445 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.445 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.446 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:28:16.446 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:28:16.446 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:16.447 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:16.447 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:16.447 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.447 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.448 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:28:16.448 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:28:16.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.448 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:16.449 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:16.449 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:28:16.449 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.449 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.449 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:28:16.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.450 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:16.450 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:16.450 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:28:16.451 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.451 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:28:16.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.452 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:16.452 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:16.452 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:28:16.452 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.453 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.453 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:28:16.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.453 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:16.454 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:16.454 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:28:16.454 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.454 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.455 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:28:16.455 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:28:16.456 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:28:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.573+0000 7fa95f2b9700 1 Processor -- start 2021-02-24T15:28:16.573 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.573+0000 7fa95f2b9700 1 -- start start 2021-02-24T15:28:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.573+0000 7fa95f2b9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa958094e70 con 0x7fa95812b4e0 2021-02-24T15:28:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.573+0000 7fa95f2b9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa958095110 con 0x7fa95812ac50 2021-02-24T15:28:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.573+0000 7fa95f2b9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9580953b0 con 0x7fa95812b030 2021-02-24T15:28:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.574+0000 7fa95c854700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fa95812b030 0x7fa95812fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37520/0 (socket says 172.21.15.152:37520) 2021-02-24T15:28:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.574+0000 7fa95d856700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa95812b4e0 0x7fa9581335f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49046/0 (socket says 172.21.15.152:49046) 2021-02-24T15:28:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.574+0000 7fa95c854700 1 -- 172.21.15.152:0/1942484837 learned_addr learned my addr 172.21.15.152:0/1942484837 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.574+0000 7fa95d055700 1 -- 172.21.15.152:0/1942484837 >> v1:172.21.15.181:6789/0 conn(0x7fa95812ac50 legacy=0x7fa958095e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa95d856700 1 -- 172.21.15.152:0/1942484837 >> v1:172.21.15.152:6789/0 conn(0x7fa95812b4e0 legacy=0x7fa9581335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa95c854700 1 -- 172.21.15.152:0/1942484837 >> v1:172.21.15.152:6790/0 conn(0x7fa95812b030 legacy=0x7fa95812fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490892895 0 0) 0x7fa958094e70 con 0x7fa95812b4e0 2021-02-24T15:28:16.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa940003230 con 0x7fa95812b4e0 2021-02-24T15:28:16.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223808971 0 0) 0x7fa9580953b0 con 0x7fa95812b030 2021-02-24T15:28:16.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa958094e70 con 0x7fa95812b030 2021-02-24T15:28:16.579 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2350420206 0 0) 0x7fa940003230 con 0x7fa95812b4e0 2021-02-24T15:28:16.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 >> v1:172.21.15.152:6790/0 conn(0x7fa95812b030 legacy=0x7fa95812fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 >> v1:172.21.15.181:6789/0 conn(0x7fa95812ac50 legacy=0x7fa958095e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:28:16.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958094800 con 0x7fa95812b4e0 2021-02-24T15:28:16.580 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa950001cb0 con 0x7fa95812b4e0 2021-02-24T15:28:16.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa950001fc0 con 0x7fa95812b4e0 2021-02-24T15:28:16.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.576+0000 7fa947fff700 1 -- 172.21.15.152:0/1942484837 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa950004a10 con 0x7fa95812b4e0 2021-02-24T15:28:16.581 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.577+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1942484837 >> v1:172.21.15.152:6789/0 conn(0x7fa95812b4e0 legacy=0x7fa9581335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.577+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1942484837 shutdown_connections 2021-02-24T15:28:16.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.577+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1942484837 >> 172.21.15.152:0/1942484837 conn(0x7fa9580966f0 msgr2=0x7fa958096b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:16.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.577+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1942484837 shutdown_connections 2021-02-24T15:28:16.582 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.577+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1942484837 wait complete. 2021-02-24T15:28:16.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95f2b9700 1 librados: starting msgr at 2021-02-24T15:28:16.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95f2b9700 1 librados: starting objecter 2021-02-24T15:28:16.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95f2b9700 1 Processor -- start 2021-02-24T15:28:16.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95f2b9700 1 -- start start 2021-02-24T15:28:16.583 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95f2b9700 1 librados: setting wanted keys 2021-02-24T15:28:16.584 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95f2b9700 1 librados: calling monclient init 2021-02-24T15:28:16.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95f2b9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9581251f0 con 0x7fa95812ac50 2021-02-24T15:28:16.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95f2b9700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95811f1b0 con 0x7fa95812b030 2021-02-24T15:28:16.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95f2b9700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa958125420 con 0x7fa95812b4e0 2021-02-24T15:28:16.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95d055700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa95812ac50 0x7fa958125a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49048/0 (socket says 172.21.15.152:49048) 2021-02-24T15:28:16.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95d055700 1 -- 172.21.15.152:0/1275921334 learned_addr learned my addr 172.21.15.152:0/1275921334 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:28:16.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.578+0000 7fa95c854700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.181:6789/0 conn(0x7fa95812b030 legacy=0x7fa95811e390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2021-02-24T15:28:16.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa95d055700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6789/0 conn(0x7fa95812ac50 legacy=0x7fa958125a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 10 client.?.objecter ms_handle_connect 0x7fa95812ac50 2021-02-24T15:28:16.596 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:16.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 10 client.?.objecter ms_handle_connect 0x7fa95812b4e0 2021-02-24T15:28:16.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 10 client.?.objecter resend_mon_ops 2021-02-24T15:28:16.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa95d856700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6790/0 conn(0x7fa95812b4e0 legacy=0x7fa95811eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.597 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363303945 0 0) 0x7fa9581251f0 con 0x7fa95812ac50 2021-02-24T15:28:16.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa938004bd0 con 0x7fa95812ac50 2021-02-24T15:28:16.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066662151 0 0) 0x7fa958125420 con 0x7fa95812b4e0 2021-02-24T15:28:16.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9581251f0 con 0x7fa95812b4e0 2021-02-24T15:28:16.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2227556562 0 0) 0x7fa938004bd0 con 0x7fa95812ac50 2021-02-24T15:28:16.598 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa958125420 con 0x7fa95812ac50 2021-02-24T15:28:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa948004230 con 0x7fa95812ac50 2021-02-24T15:28:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1154942576 0 0) 0x7fa9581251f0 con 0x7fa95812b4e0 2021-02-24T15:28:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa938004bd0 con 0x7fa95812b4e0 2021-02-24T15:28:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa950001c70 con 0x7fa95812b4e0 2021-02-24T15:28:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3618277761 0 0) 0x7fa958125420 con 0x7fa95812ac50 2021-02-24T15:28:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6790/0 conn(0x7fa95812b4e0 legacy=0x7fa95811eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.181:6789/0 conn(0x7fa95812b030 legacy=0x7fa95811e390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:28:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958068050 con 0x7fa95812ac50 2021-02-24T15:28:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa958099c40 con 0x7fa95812ac50 2021-02-24T15:28:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa95f2b9700 10 client.28434.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:28:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa958143560 con 0x7fa95812ac50 2021-02-24T15:28:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa95f2b9700 1 librados: init done 2021-02-24T15:28:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa948004990 con 0x7fa95812ac50 2021-02-24T15:28:16.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.581+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa948004ca0 con 0x7fa95812ac50 2021-02-24T15:28:16.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.582+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fa94800d820 con 0x7fa95812ac50 2021-02-24T15:28:16.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.582+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(469..469 src has 230..469) v4 ==== 6507+0+0 (unknown 3392871596 0 0) 0x7fa94803b5a0 con 0x7fa95812ac50 2021-02-24T15:28:16.602 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.582+0000 7fa9457fa700 10 client.28434.objecter ms_dispatch 0x7fa958001510 osd_map(469..469 src has 230..469) v4 2021-02-24T15:28:16.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.582+0000 7fa9457fa700 3 client.28434.objecter handle_osd_map got epochs [469,469] > 0 2021-02-24T15:28:16.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.582+0000 7fa9457fa700 3 client.28434.objecter handle_osd_map decoding full epoch 469 2021-02-24T15:28:16.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.582+0000 7fa9457fa700 20 client.28434.objecter dump_active .. 0 homeless 2021-02-24T15:28:16.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.582+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa930006550 con 0x7fa9300027f0 2021-02-24T15:28:16.603 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.584+0000 7fa95d856700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6790/0 conn(0x7fa9300027f0 legacy=0x7fa930004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.584+0000 7fa9457fa700 10 client.28434.objecter ms_handle_connect 0x7fa9300027f0 2021-02-24T15:28:16.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.584+0000 7fa9457fa700 10 client.28434.objecter resend_mon_ops 2021-02-24T15:28:16.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766556749 0 0) 0x7fa930006550 con 0x7fa9300027f0 2021-02-24T15:28:16.604 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa958125420 con 0x7fa9300027f0 2021-02-24T15:28:16.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 10 client.28434.objecter ms_handle_connect 0x7fa9380315c0 2021-02-24T15:28:16.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1666660682 0 0) 0x7fa958125420 con 0x7fa9300027f0 2021-02-24T15:28:16.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa930006550 con 0x7fa9300027f0 2021-02-24T15:28:16.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa950001660 con 0x7fa9300027f0 2021-02-24T15:28:16.605 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 160315514 0 0) 0x7fa930006550 con 0x7fa9300027f0 2021-02-24T15:28:16.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa930009df0 con 0x7fa9300027f0 2021-02-24T15:28:16.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fa950005120 con 0x7fa9300027f0 2021-02-24T15:28:16.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6790/0 conn(0x7fa9300027f0 legacy=0x7fa930004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.606 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.585+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6790/0 conn(0x7fa9300027f0 legacy=0x7fa930004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:16.607 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.593+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fa930009a60 con 0x7fa930008d80 2021-02-24T15:28:16.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.595+0000 7fa95d856700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6790/0 conn(0x7fa930008d80 legacy=0x7fa930009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:28:16.609 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.595+0000 7fa9457fa700 10 client.28434.objecter ms_handle_connect 0x7fa930008d80 2021-02-24T15:28:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.595+0000 7fa9457fa700 10 client.28434.objecter resend_mon_ops 2021-02-24T15:28:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.595+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388196146 0 0) 0x7fa930009a60 con 0x7fa930008d80 2021-02-24T15:28:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.595+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa930006550 con 0x7fa930008d80 2021-02-24T15:28:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 3387940516 0 0) 0x7fa930006550 con 0x7fa930008d80 2021-02-24T15:28:16.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa930009a60 con 0x7fa930008d80 2021-02-24T15:28:16.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fa950005880 con 0x7fa930008d80 2021-02-24T15:28:16.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3700881518 0 0) 0x7fa930009a60 con 0x7fa930008d80 2021-02-24T15:28:16.611 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa9300086f0 con 0x7fa930008d80 2021-02-24T15:28:16.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3929 (unknown 0 0 2465959427) 0x7fa950007b80 con 0x7fa930008d80 2021-02-24T15:28:16.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6790/0 conn(0x7fa930008d80 legacy=0x7fa930009210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa9457fa700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6790/0 conn(0x7fa930008d80 legacy=0x7fa930009210 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:28:16.612 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa95f2b9700 10 librados: watch_flush enter 2021-02-24T15:28:16.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa95f2b9700 10 librados: watch_flush exit 2021-02-24T15:28:16.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa95f2b9700 20 client.28434.objecter shutdown clearing up homeless session... 2021-02-24T15:28:16.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa95f2b9700 10 client.28434.objecter successfully canceled tick 2021-02-24T15:28:16.613 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.181:6812/33484 conn(0x7fa9380315c0 legacy=0x7fa938033a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 >> v1:172.21.15.152:6789/0 conn(0x7fa95812ac50 legacy=0x7fa958125a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:28:16.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.596+0000 7fa95d856700 1 -- 172.21.15.152:0/1275921334 reap_dead start 2021-02-24T15:28:16.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.597+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 shutdown_connections 2021-02-24T15:28:16.614 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.597+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 >> 172.21.15.152:0/1275921334 conn(0x7fa9580966f0 msgr2=0x7fa95808fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:28:16.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.597+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 shutdown_connections 2021-02-24T15:28:16.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.597+0000 7fa95f2b9700 1 -- 172.21.15.152:0/1275921334 wait complete. 2021-02-24T15:28:16.615 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:28:16.597+0000 7fa95f2b9700 1 librados: shutdown 2021-02-24T15:28:16.615 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:28:16.615 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:28:16.616 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:28:16.616 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:28:16.616 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 60, 2021-02-24T15:28:16.616 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:28:16.617 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:28:16.617 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:28:16.617 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.617 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:28:16.618 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:16.618 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:28:16.618 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:28:16.618 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:16.618 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:16.619 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:16.619 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:16.619 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:16.619 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:16.620 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:16.620 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:16.620 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:16.620 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.621 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:28:16.621 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:28:16.621 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:16.621 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:16.622 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:16.622 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:16.622 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:16.622 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:16.623 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:16.623 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:16.623 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:16.623 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.624 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:28:16.624 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:28:16.624 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:28:16.624 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:28:16.625 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:28:16.625 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:28:16.625 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:16.625 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:28:16.625 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:28:16.626 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:28:16.626 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:28:16.626 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:28:16.626 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:28:16.627 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:28:16.628 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:28:16.628 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:28:16.628 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:28:16.629 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:28:16.629 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:28:16.629 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:28:16.630 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:28:16.630 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:28:16.630 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:28:16.630 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:28:16.631 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.631 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:28:16.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.632 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:28:16.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.632 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:28:16.633 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:28:16.633 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:16.633 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:16.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.633 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:16.634 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:28:16.634 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:16.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.635 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.636 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:28:16.636 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:28:16.636 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:16.636 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:16.637 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:16.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.637 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:28:16.638 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:28:16.638 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:16.638 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:16.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.638 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:16.639 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:28:16.639 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:16.639 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.639 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.640 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:28:16.640 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:28:16.641 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:16.641 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:16.641 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:16.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.642 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:28:16.642 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:28:16.642 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:28:16.643 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:28:16.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.643 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:28:16.644 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:28:16.644 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:28:16.644 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.644 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.645 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:28:16.645 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:28:16.645 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:28:16.645 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:28:16.645 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:28:16.646 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.646 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.646 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:28:16.647 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:28:16.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.647 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:16.647 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:16.648 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:28:16.648 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.648 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.648 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:28:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:28:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.650 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:28:16.650 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:28:16.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:28:16.651 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:28:16.651 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:28:16.651 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:28:16.651 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:28:16.652 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:28:16.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:28:16.652 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:28:16.653 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:28:16.653 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-02-24T15:29:05.988 INFO:tasks.ceph.osd.0.smithi152.stderr:2021-02-24T15:29:05.986+0000 7f7bd4fa8700 -1 osd.0 pg_epoch: 504 pg[225.c( v 503'2 (0'0,503'2] local-lis/les=498/499 n=2 ec=498/498 lis/c=498/498 les/c/f=499/499/0 sis=498) [0,1] r=0 lpr=498 crt=503'2 lcod 503'1 mlcod 503'1 active+clean+snaptrim trimq=[2~1]] removing snap head 2021-02-24T15:29:05.992 INFO:tasks.ceph.osd.2.smithi152.stderr:2021-02-24T15:29:05.990+0000 7fe1d0c17700 -1 osd.2 pg_epoch: 504 pg[222.4s0( v 500'4 (0'0,500'4] local-lis/les=482/483 n=3 ec=482/482 lis/c=482/482 les/c/f=483/483/0 sis=482) [2,3,5]p2(0) r=0 lpr=482 crt=500'4 lcod 499'2 mlcod 499'2 active+clean+snaptrim trimq=[2~1]] removing snap head 2021-02-24T15:29:42.047 INFO:tasks.ceph.osd.3.smithi181.stderr:2021-02-24T15:29:42.046+0000 7f67fd3a4700 -1 osd.3 pg_epoch: 540 pg[222.0s0( v 536'3 (0'0,536'3] local-lis/les=482/483 n=2 ec=482/482 lis/c=482/482 les/c/f=483/483/0 sis=482) [3,2,0]p3(0) r=0 lpr=482 crt=536'3 lcod 535'1 mlcod 535'1 active+clean+snaptrim trimq=[6~1]] removing snap head 2021-02-24T15:29:46.654 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2021-02-24T15:29:46.654 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2021-02-24T15:29:46.655 INFO:tasks.ceph.mon.b:Restarting daemon 2021-02-24T15:29:46.655 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-02-24T15:29:46.661 INFO:tasks.ceph.mon.b:Started 2021-02-24T15:29:46.662 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:29:46.662 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:29:46.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.794+0000 7fc4bd79d700 1 Processor -- start 2021-02-24T15:29:46.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.795+0000 7fc4bd79d700 1 -- start start 2021-02-24T15:29:46.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.795+0000 7fc4bd79d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b80639d0 con 0x7fc4b80974f0 2021-02-24T15:29:46.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.795+0000 7fc4bd79d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b809a060 con 0x7fc4b80635f0 2021-02-24T15:29:46.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.795+0000 7fc4bd79d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b809a300 con 0x7fc4b8097040 2021-02-24T15:29:46.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.795+0000 7fc4b77fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc4b8097040 0x7fc4b812fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37630/0 (socket says 172.21.15.152:37630) 2021-02-24T15:29:46.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.795+0000 7fc4b77fe700 1 -- 172.21.15.152:0/3346894452 learned_addr learned my addr 172.21.15.152:0/3346894452 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:46.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.795+0000 7fc4bcf9c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc4b80974f0 0x7fc4b8133180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49158/0 (socket says 172.21.15.152:49158) 2021-02-24T15:29:46.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.797+0000 7fc4b77fe700 1 -- 172.21.15.152:0/3346894452 >> v1:172.21.15.152:6790/0 conn(0x7fc4b8097040 legacy=0x7fc4b812fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:46.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.797+0000 7fc4bcf9c700 1 -- 172.21.15.152:0/3346894452 >> v1:172.21.15.152:6789/0 conn(0x7fc4b80974f0 legacy=0x7fc4b8133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:46.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.797+0000 7fc4b7fff700 1 -- 172.21.15.152:0/3346894452 >> v1:172.21.15.181:6789/0 conn(0x7fc4b80635f0 legacy=0x7fc4b812abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:46.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.797+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993020709 0 0) 0x7fc4b809a300 con 0x7fc4b8097040 2021-02-24T15:29:46.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a4003230 con 0x7fc4b8097040 2021-02-24T15:29:46.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131158628 0 0) 0x7fc4b80639d0 con 0x7fc4b80974f0 2021-02-24T15:29:46.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b809a300 con 0x7fc4b80974f0 2021-02-24T15:29:46.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1513306978 0 0) 0x7fc4a4003230 con 0x7fc4b8097040 2021-02-24T15:29:46.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 >> v1:172.21.15.181:6789/0 conn(0x7fc4b80635f0 legacy=0x7fc4b812abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:46.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 >> v1:172.21.15.152:6789/0 conn(0x7fc4b80974f0 legacy=0x7fc4b8133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:46.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b808fb30 con 0x7fc4b8097040 2021-02-24T15:29:46.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc4a8001930 con 0x7fc4b8097040 2021-02-24T15:29:46.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc4a8001c40 con 0x7fc4b8097040 2021-02-24T15:29:46.805 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4b6ffd700 1 -- 172.21.15.152:0/3346894452 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc4a8004750 con 0x7fc4b8097040 2021-02-24T15:29:46.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.798+0000 7fc4bd79d700 1 -- 172.21.15.152:0/3346894452 >> v1:172.21.15.152:6790/0 conn(0x7fc4b8097040 legacy=0x7fc4b812fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:46.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.799+0000 7fc4bd79d700 1 -- 172.21.15.152:0/3346894452 shutdown_connections 2021-02-24T15:29:46.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.799+0000 7fc4bd79d700 1 -- 172.21.15.152:0/3346894452 >> 172.21.15.152:0/3346894452 conn(0x7fc4b809d9e0 msgr2=0x7fc4b809ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:46.806 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.799+0000 7fc4bd79d700 1 -- 172.21.15.152:0/3346894452 shutdown_connections 2021-02-24T15:29:46.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.799+0000 7fc4bd79d700 1 -- 172.21.15.152:0/3346894452 wait complete. 2021-02-24T15:29:46.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.799+0000 7fc4bd79d700 1 librados: starting msgr at 2021-02-24T15:29:46.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.799+0000 7fc4bd79d700 1 librados: starting objecter 2021-02-24T15:29:46.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.799+0000 7fc4bd79d700 1 Processor -- start 2021-02-24T15:29:46.807 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.800+0000 7fc4bd79d700 1 -- start start 2021-02-24T15:29:46.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.800+0000 7fc4bd79d700 1 librados: setting wanted keys 2021-02-24T15:29:46.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.800+0000 7fc4bd79d700 1 librados: calling monclient init 2021-02-24T15:29:46.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.800+0000 7fc4bd79d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b8091a90 con 0x7fc4b8097040 2021-02-24T15:29:46.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.800+0000 7fc4bd79d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b8091d30 con 0x7fc4b80635f0 2021-02-24T15:29:46.808 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.800+0000 7fc4bd79d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b8091fd0 con 0x7fc4b80974f0 2021-02-24T15:29:46.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.800+0000 7fc4b77fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc4b8097040 0x7fc4b8139d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49162/0 (socket says 172.21.15.152:49162) 2021-02-24T15:29:46.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.800+0000 7fc4bcf9c700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc4b80974f0 0x7fc4b81420e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37640/0 (socket says 172.21.15.152:37640) 2021-02-24T15:29:46.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.800+0000 7fc4b77fe700 1 -- 172.21.15.152:0/478023931 learned_addr learned my addr 172.21.15.152:0/478023931 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:46.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.802+0000 7fc4b77fe700 1 -- 172.21.15.152:0/478023931 >> v1:172.21.15.152:6789/0 conn(0x7fc4b8097040 legacy=0x7fc4b8139d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:46.809 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.802+0000 7fc49ffff700 10 client.?.objecter ms_handle_connect 0x7fc4b8097040 2021-02-24T15:29:46.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.802+0000 7fc49ffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:46.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.802+0000 7fc49ffff700 10 client.?.objecter ms_handle_connect 0x7fc4b80974f0 2021-02-24T15:29:46.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.802+0000 7fc49ffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:46.810 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.802+0000 7fc4bcf9c700 1 -- 172.21.15.152:0/478023931 >> v1:172.21.15.152:6790/0 conn(0x7fc4b80974f0 legacy=0x7fc4b81420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:46.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730753132 0 0) 0x7fc4b8091a90 con 0x7fc4b8097040 2021-02-24T15:29:46.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc498004bd0 con 0x7fc4b8097040 2021-02-24T15:29:46.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443391404 0 0) 0x7fc4b8091fd0 con 0x7fc4b80974f0 2021-02-24T15:29:46.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b8091a90 con 0x7fc4b80974f0 2021-02-24T15:29:46.811 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 10 client.?.objecter ms_handle_connect 0x7fc4b80635f0 2021-02-24T15:29:46.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:46.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc4b7fff700 1 -- 172.21.15.152:0/478023931 >> v1:172.21.15.181:6789/0 conn(0x7fc4b80635f0 legacy=0x7fc4b80964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:46.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1888636089 0 0) 0x7fc498004bd0 con 0x7fc4b8097040 2021-02-24T15:29:46.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc4b8091fd0 con 0x7fc4b8097040 2021-02-24T15:29:46.812 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc4a80018f0 con 0x7fc4b8097040 2021-02-24T15:29:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 272684027 0 0) 0x7fc4b8091fd0 con 0x7fc4b8097040 2021-02-24T15:29:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 >> v1:172.21.15.152:6790/0 conn(0x7fc4b80974f0 legacy=0x7fc4b81420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 >> v1:172.21.15.181:6789/0 conn(0x7fc4b80635f0 legacy=0x7fc4b80964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:46.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b8096bc0 con 0x7fc4b8097040 2021-02-24T15:29:46.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b8096e90 con 0x7fc4b8097040 2021-02-24T15:29:46.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc4bd79d700 10 client.28446.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:46.814 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b813a600 con 0x7fc4b8097040 2021-02-24T15:29:46.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc4bd79d700 1 librados: init done 2021-02-24T15:29:46.815 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc4a8001560 con 0x7fc4b8097040 2021-02-24T15:29:46.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.803+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc4a8004f40 con 0x7fc4b8097040 2021-02-24T15:29:46.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.804+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fc4a800da40 con 0x7fc4b8097040 2021-02-24T15:29:46.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.804+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc490004d60 con 0x7fc4b8097040 2021-02-24T15:29:46.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.804+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(544..544 src has 330..544) v4 ==== 5721+0+0 (unknown 3536340899 0 0) 0x7fc4a803b410 con 0x7fc4b8097040 2021-02-24T15:29:46.816 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.804+0000 7fc49ffff700 10 client.28446.objecter ms_dispatch 0x7fc4b8001510 osd_map(544..544 src has 330..544) v4 2021-02-24T15:29:46.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.804+0000 7fc49ffff700 3 client.28446.objecter handle_osd_map got epochs [544,544] > 0 2021-02-24T15:29:46.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.804+0000 7fc49ffff700 3 client.28446.objecter handle_osd_map decoding full epoch 544 2021-02-24T15:29:46.817 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.805+0000 7fc49ffff700 20 client.28446.objecter dump_active .. 0 homeless 2021-02-24T15:29:46.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.807+0000 7fc49ffff700 10 client.28446.objecter ms_handle_connect 0x7fc4980314f0 2021-02-24T15:29:46.818 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:46.809+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7fc4a8012810 con 0x7fc4b8097040 2021-02-24T15:29:47.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.047+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc490005590 con 0x7fc4b8097040 2021-02-24T15:29:47.048 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.048+0000 7fc49ffff700 1 -- 172.21.15.152:0/478023931 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 2094038884) 0x7fc4a8012630 con 0x7fc4b8097040 2021-02-24T15:29:47.049 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:29:47.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 10 librados: watch_flush enter 2021-02-24T15:29:47.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 10 librados: watch_flush exit 2021-02-24T15:29:47.050 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 20 client.28446.objecter shutdown clearing up homeless session... 2021-02-24T15:29:47.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 10 client.28446.objecter successfully canceled tick 2021-02-24T15:29:47.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 >> v1:172.21.15.181:6812/33484 conn(0x7fc4980314f0 legacy=0x7fc4980339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 >> v1:172.21.15.152:6789/0 conn(0x7fc4b8097040 legacy=0x7fc4b8139d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 shutdown_connections 2021-02-24T15:29:47.051 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 >> 172.21.15.152:0/478023931 conn(0x7fc4b809d9e0 msgr2=0x7fc4b809b810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:47.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 shutdown_connections 2021-02-24T15:29:47.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 1 -- 172.21.15.152:0/478023931 wait complete. 2021-02-24T15:29:47.052 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.049+0000 7fc4bd79d700 1 librados: shutdown 2021-02-24T15:29:47.061 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:29:47.061 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:29:47.192 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.190+0000 7f24f5bf4700 1 Processor -- start 2021-02-24T15:29:47.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.190+0000 7f24f5bf4700 1 -- start start 2021-02-24T15:29:47.193 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.190+0000 7f24f5bf4700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f00639f0 con 0x7f24f0131040 2021-02-24T15:29:47.194 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.190+0000 7f24f5bf4700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f0063420 con 0x7f24f0062fc0 2021-02-24T15:29:47.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.190+0000 7f24f5bf4700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f0098140 con 0x7f24f00680e0 2021-02-24T15:29:47.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.190+0000 7f24f4bf2700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f24f00680e0 0x7f24f0097320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37656/0 (socket says 172.21.15.152:37656) 2021-02-24T15:29:47.195 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.190+0000 7f24f4bf2700 1 -- 172.21.15.152:0/476861946 learned_addr learned my addr 172.21.15.152:0/476861946 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:47.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.192+0000 7f24f4bf2700 1 -- 172.21.15.152:0/476861946 >> v1:172.21.15.152:6790/0 conn(0x7f24f00680e0 legacy=0x7f24f0097320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.204 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.192+0000 7f24f53f3700 1 -- 172.21.15.152:0/476861946 >> v1:172.21.15.152:6789/0 conn(0x7f24f0131040 legacy=0x7f24f0133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24effff700 1 -- 172.21.15.152:0/476861946 >> v1:172.21.15.181:6789/0 conn(0x7f24f0062fc0 legacy=0x7f24f0097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821733120 0 0) 0x7f24f0098140 con 0x7f24f00680e0 2021-02-24T15:29:47.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24d4003230 con 0x7f24f00680e0 2021-02-24T15:29:47.205 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267951628 0 0) 0x7f24f00639f0 con 0x7f24f0131040 2021-02-24T15:29:47.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f0098140 con 0x7f24f0131040 2021-02-24T15:29:47.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1196436082 0 0) 0x7f24f0098140 con 0x7f24f0131040 2021-02-24T15:29:47.206 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 >> v1:172.21.15.152:6790/0 conn(0x7f24f00680e0 legacy=0x7f24f0097320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 >> v1:172.21.15.181:6789/0 conn(0x7f24f0062fc0 legacy=0x7f24f0097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.207 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f0063c20 con 0x7f24f0131040 2021-02-24T15:29:47.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f24e8001d00 con 0x7f24f0131040 2021-02-24T15:29:47.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.193+0000 7f24f53f3700 1 --1- 172.21.15.152:0/476861946 >> v1:172.21.15.152:6789/0 conn(0x7f24f0131040 0x7f24f0133430 :-1 s=OPENED pgs=9248 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f24e80023e0 mon_map magic: 0 v1 2021-02-24T15:29:47.208 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.194+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f24e8002010 con 0x7f24f0131040 2021-02-24T15:29:47.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.194+0000 7f24f5bf4700 1 -- 172.21.15.152:0/476861946 >> v1:172.21.15.152:6789/0 conn(0x7f24f0131040 legacy=0x7f24f0133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.194+0000 7f24ef7fe700 1 -- 172.21.15.152:0/476861946 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f24e80023e0 con 0x7f24f0131040 2021-02-24T15:29:47.209 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.194+0000 7f24f5bf4700 1 -- 172.21.15.152:0/476861946 shutdown_connections 2021-02-24T15:29:47.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.194+0000 7f24f5bf4700 1 -- 172.21.15.152:0/476861946 >> 172.21.15.152:0/476861946 conn(0x7f24f009b810 msgr2=0x7f24f009bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:47.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.194+0000 7f24f5bf4700 1 -- 172.21.15.152:0/476861946 shutdown_connections 2021-02-24T15:29:47.210 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.194+0000 7f24f5bf4700 1 -- 172.21.15.152:0/476861946 wait complete. 2021-02-24T15:29:47.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.195+0000 7f24f5bf4700 1 librados: starting msgr at 2021-02-24T15:29:47.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.195+0000 7f24f5bf4700 1 librados: starting objecter 2021-02-24T15:29:47.211 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.195+0000 7f24f5bf4700 1 Processor -- start 2021-02-24T15:29:47.212 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.195+0000 7f24f5bf4700 1 -- start start 2021-02-24T15:29:47.214 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.195+0000 7f24f5bf4700 1 librados: setting wanted keys 2021-02-24T15:29:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.195+0000 7f24f5bf4700 1 librados: calling monclient init 2021-02-24T15:29:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.196+0000 7f24f5bf4700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f0118400 con 0x7f24f00680e0 2021-02-24T15:29:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.196+0000 7f24f5bf4700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f011af60 con 0x7f24f0131040 2021-02-24T15:29:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.196+0000 7f24f5bf4700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f011b200 con 0x7f24f0062fc0 2021-02-24T15:29:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.196+0000 7f24f4bf2700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f24f0062fc0 0x7f24f01175e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37662/0 (socket says 172.21.15.152:37662) 2021-02-24T15:29:47.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.196+0000 7f24f4bf2700 1 -- 172.21.15.152:0/3375530615 learned_addr learned my addr 172.21.15.152:0/3375530615 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:47.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24f4bf2700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6790/0 conn(0x7f24f0062fc0 legacy=0x7f24f01175e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 10 client.?.objecter ms_handle_connect 0x7f24f0062fc0 2021-02-24T15:29:47.217 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.218 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 10 client.?.objecter ms_handle_connect 0x7f24f00680e0 2021-02-24T15:29:47.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24effff700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6789/0 conn(0x7f24f00680e0 legacy=0x7f24f0117cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.219 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24f53f3700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.181:6789/0 conn(0x7f24f0131040 legacy=0x7f24f0142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 10 client.?.objecter ms_handle_connect 0x7f24f0131040 2021-02-24T15:29:47.220 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835747284 0 0) 0x7f24f0118400 con 0x7f24f00680e0 2021-02-24T15:29:47.221 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24d0004bd0 con 0x7f24f00680e0 2021-02-24T15:29:47.222 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180207905 0 0) 0x7f24f011af60 con 0x7f24f0131040 2021-02-24T15:29:47.222 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f0118400 con 0x7f24f0131040 2021-02-24T15:29:47.223 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 535986076 0 0) 0x7f24d0004bd0 con 0x7f24f00680e0 2021-02-24T15:29:47.224 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24f011af60 con 0x7f24f00680e0 2021-02-24T15:29:47.224 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f24dc001b60 con 0x7f24f00680e0 2021-02-24T15:29:47.224 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 7909590 0 0) 0x7f24f0118400 con 0x7f24f0131040 2021-02-24T15:29:47.224 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24d0004bd0 con 0x7f24f0131040 2021-02-24T15:29:47.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f24e80023e0 con 0x7f24f0131040 2021-02-24T15:29:47.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1181816974 0 0) 0x7f24f011af60 con 0x7f24f00680e0 2021-02-24T15:29:47.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6790/0 conn(0x7f24f0062fc0 legacy=0x7f24f01175e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.225 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.181:6789/0 conn(0x7f24f0131040 legacy=0x7f24f0142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.198+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f0095620 con 0x7f24f00680e0 2021-02-24T15:29:47.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.199+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f0119020 con 0x7f24f00680e0 2021-02-24T15:29:47.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.199+0000 7f24f5bf4700 10 client.28452.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:47.226 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.199+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f0130b60 con 0x7f24f00680e0 2021-02-24T15:29:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.199+0000 7f24f5bf4700 1 librados: init done 2021-02-24T15:29:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.199+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f24dc002230 con 0x7f24f00680e0 2021-02-24T15:29:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.199+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f24dc002540 con 0x7f24f00680e0 2021-02-24T15:29:47.227 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.199+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f24dc0026a0 con 0x7f24f00680e0 2021-02-24T15:29:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.199+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f24c8006550 con 0x7f24c80027f0 2021-02-24T15:29:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.200+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(545..545 src has 330..545) v4 ==== 5734+0+0 (unknown 4108916491 0 0) 0x7f24dc03b140 con 0x7f24f00680e0 2021-02-24T15:29:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.200+0000 7f24ecff9700 10 client.28452.objecter ms_dispatch 0x7f24f0001510 osd_map(545..545 src has 330..545) v4 2021-02-24T15:29:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.200+0000 7f24ecff9700 3 client.28452.objecter handle_osd_map got epochs [545,545] > 0 2021-02-24T15:29:47.228 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.200+0000 7f24ecff9700 3 client.28452.objecter handle_osd_map decoding full epoch 545 2021-02-24T15:29:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.200+0000 7f24ecff9700 20 client.28452.objecter dump_active .. 0 homeless 2021-02-24T15:29:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 10 client.28452.objecter ms_handle_connect 0x7f24c80027f0 2021-02-24T15:29:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 10 client.28452.objecter resend_mon_ops 2021-02-24T15:29:47.229 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24f4bf2700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6789/0 conn(0x7f24c80027f0 legacy=0x7f24c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824523226 0 0) 0x7f24c8006550 con 0x7f24c80027f0 2021-02-24T15:29:47.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f011af60 con 0x7f24c80027f0 2021-02-24T15:29:47.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 465993988 0 0) 0x7f24f011af60 con 0x7f24c80027f0 2021-02-24T15:29:47.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24c8006550 con 0x7f24c80027f0 2021-02-24T15:29:47.230 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f24e4001c70 con 0x7f24c80027f0 2021-02-24T15:29:47.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 10 client.28452.objecter ms_handle_connect 0x7f24d00315b0 2021-02-24T15:29:47.231 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1024855199 0 0) 0x7f24c8006550 con 0x7f24c80027f0 2021-02-24T15:29:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24c8009df0 con 0x7f24c80027f0 2021-02-24T15:29:47.235 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f24e4006550 con 0x7f24c80027f0 2021-02-24T15:29:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6789/0 conn(0x7f24c80027f0 legacy=0x7f24c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.236 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.202+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6789/0 conn(0x7f24c80027f0 legacy=0x7f24c8004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:47.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.210+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f24c8009a80 con 0x7f24c8008da0 2021-02-24T15:29:47.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24f4bf2700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6789/0 conn(0x7f24c8008da0 legacy=0x7f24c8009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.244 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24ecff9700 10 client.28452.objecter ms_handle_connect 0x7f24c8008da0 2021-02-24T15:29:47.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24ecff9700 10 client.28452.objecter resend_mon_ops 2021-02-24T15:29:47.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891263155 0 0) 0x7f24c8009a80 con 0x7f24c8008da0 2021-02-24T15:29:47.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c8006550 con 0x7f24c8008da0 2021-02-24T15:29:47.245 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2048538685 0 0) 0x7f24c8006550 con 0x7f24c8008da0 2021-02-24T15:29:47.246 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24c8009a80 con 0x7f24c8008da0 2021-02-24T15:29:47.246 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f24e4004ae0 con 0x7f24c8008da0 2021-02-24T15:29:47.247 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2168772138 0 0) 0x7f24c8009a80 con 0x7f24c8008da0 2021-02-24T15:29:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.213+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f24c80086f0 con 0x7f24c8008da0 2021-02-24T15:29:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4112 (unknown 0 0 776457528) 0x7f24e4006760 con 0x7f24c8008da0 2021-02-24T15:29:47.248 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6789/0 conn(0x7f24c8008da0 legacy=0x7f24c8009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24ecff9700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6789/0 conn(0x7f24c8008da0 legacy=0x7f24c8009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 10 librados: watch_flush enter 2021-02-24T15:29:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 10 librados: watch_flush exit 2021-02-24T15:29:47.249 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 20 client.28452.objecter shutdown clearing up homeless session... 2021-02-24T15:29:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 10 client.28452.objecter successfully canceled tick 2021-02-24T15:29:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.181:6812/33484 conn(0x7f24d00315b0 legacy=0x7f24d0033a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.250 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 >> v1:172.21.15.152:6789/0 conn(0x7f24f00680e0 legacy=0x7f24f0117cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f53f3700 1 -- 172.21.15.152:0/3375530615 reap_dead start 2021-02-24T15:29:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f53f3700 1 -- 172.21.15.152:0/3375530615 reap_dead start 2021-02-24T15:29:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 shutdown_connections 2021-02-24T15:29:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 >> 172.21.15.152:0/3375530615 conn(0x7f24f009b810 msgr2=0x7f24f00971a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:47.251 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 shutdown_connections 2021-02-24T15:29:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 1 -- 172.21.15.152:0/3375530615 wait complete. 2021-02-24T15:29:47.252 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.214+0000 7f24f5bf4700 1 librados: shutdown 2021-02-24T15:29:47.253 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:29:47.253 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:29:47.253 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:29:47.253 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:29:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 66, 2021-02-24T15:29:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:29:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:29:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:29:47.255 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:29:47.255 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.255 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:29:47.255 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:47.256 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:29:47.256 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:29:47.256 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:47.256 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:47.257 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:47.257 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:47.257 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:47.258 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:47.258 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:47.258 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:47.259 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:47.259 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.259 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:29:47.260 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:29:47.261 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:47.261 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:47.261 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:47.262 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:47.262 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:47.262 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:47.262 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:47.263 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:29:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:29:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:29:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:29:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:29:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:29:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:29:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:29:47.281 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:29:47.281 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:29:47.282 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:29:47.282 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:47.282 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:29:47.282 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:47.283 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:47.283 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:47.283 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:47.283 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:47.283 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:47.284 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:47.284 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:47.284 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:47.284 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.284 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:29:47.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.285 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:29:47.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.285 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:29:47.285 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:29:47.286 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:47.286 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:47.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.286 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:47.286 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:29:47.287 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:47.287 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.298 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.299 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:29:47.299 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:29:47.299 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:47.299 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:47.300 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:47.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.300 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.300 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:29:47.300 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:29:47.301 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:47.301 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:47.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.301 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:47.302 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:29:47.302 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:47.302 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.302 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.303 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:29:47.303 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:29:47.303 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:47.303 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:47.303 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:47.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.304 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:29:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:29:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:29:47.309 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:47.309 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.309 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.310 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:29:47.310 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:29:47.310 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:47.310 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:47.310 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:47.311 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.311 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.311 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:29:47.312 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:29:47.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.312 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:47.312 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:47.312 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:47.313 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.313 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.313 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:29:47.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.313 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:29:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:29:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:29:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:29:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:29:47.318 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:29:47.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:29:47.456 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.455+0000 7ff6dd2f2700 1 Processor -- start 2021-02-24T15:29:47.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.455+0000 7ff6dd2f2700 1 -- start start 2021-02-24T15:29:47.457 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.456+0000 7ff6dd2f2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d8129990 con 0x7ff6d8097040 2021-02-24T15:29:47.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.456+0000 7ff6dd2f2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d812a2c0 con 0x7ff6d8097b10 2021-02-24T15:29:47.458 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.456+0000 7ff6dd2f2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d809a300 con 0x7ff6d80974f0 2021-02-24T15:29:47.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.456+0000 7ff6dcaf1700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff6d80974f0 0x7ff6d8133160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37674/0 (socket says 172.21.15.152:37674) 2021-02-24T15:29:47.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.456+0000 7ff6dcaf1700 1 -- 172.21.15.152:0/2611899549 learned_addr learned my addr 172.21.15.152:0/2611899549 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:47.459 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.456+0000 7ff6d77fe700 1 --1- 172.21.15.152:0/2611899549 >> v1:172.21.15.152:6789/0 conn(0x7ff6d8097040 0x7ff6d812fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49198/0 (socket says 172.21.15.152:49198) 2021-02-24T15:29:47.462 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d77fe700 1 -- 172.21.15.152:0/2611899549 >> v1:172.21.15.152:6789/0 conn(0x7ff6d8097040 legacy=0x7ff6d812fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.463 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6dcaf1700 1 -- 172.21.15.152:0/2611899549 >> v1:172.21.15.152:6790/0 conn(0x7ff6d80974f0 legacy=0x7ff6d8133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d7fff700 1 -- 172.21.15.152:0/2611899549 >> v1:172.21.15.181:6789/0 conn(0x7ff6d8097b10 legacy=0x7ff6d8129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682661469 0 0) 0x7ff6d809a300 con 0x7ff6d80974f0 2021-02-24T15:29:47.464 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b8003230 con 0x7ff6d80974f0 2021-02-24T15:29:47.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731176002 0 0) 0x7ff6d8129990 con 0x7ff6d8097040 2021-02-24T15:29:47.465 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d809a300 con 0x7ff6d8097040 2021-02-24T15:29:47.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d7fff700 1 -- 172.21.15.152:0/2611899549 >> v1:172.21.15.181:6789/0 conn(0x7ff6d8097b10 legacy=0x7ff6d8129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2021-02-24T15:29:47.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d7fff700 1 -- 172.21.15.152:0/2611899549 >> v1:172.21.15.181:6789/0 conn(0x7ff6d8097b10 legacy=0x7ff6d8129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-24T15:29:47.466 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d7fff700 1 --1- 172.21.15.152:0/2611899549 >> v1:172.21.15.181:6789/0 conn(0x7ff6d8097b10 0x7ff6d8129bb0 :-1 s=OPENED pgs=818 cs=1 l=1).handle_message read tag failed 2021-02-24T15:29:47.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d7fff700 1 --1- 172.21.15.152:0/2611899549 >> v1:172.21.15.181:6789/0 conn(0x7ff6d8097b10 0x7ff6d8129bb0 :-1 s=OPENED pgs=818 cs=1 l=1).fault on lossy channel, failing 2021-02-24T15:29:47.467 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4066396408 0 0) 0x7ff6b8003230 con 0x7ff6d80974f0 2021-02-24T15:29:47.468 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 >> v1:172.21.15.181:6789/0 conn(0x7ff6d8097b10 legacy=0x7ff6d8129bb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:47.468 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 >> v1:172.21.15.152:6789/0 conn(0x7ff6d8097040 legacy=0x7ff6d812fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.468 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d808fb30 con 0x7ff6d80974f0 2021-02-24T15:29:47.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6d0001d70 con 0x7ff6d80974f0 2021-02-24T15:29:47.469 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6d0001fe0 con 0x7ff6d80974f0 2021-02-24T15:29:47.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.458+0000 7ff6d6ffd700 1 -- 172.21.15.152:0/2611899549 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6d0004ad0 con 0x7ff6d80974f0 2021-02-24T15:29:47.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.459+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2611899549 >> v1:172.21.15.152:6790/0 conn(0x7ff6d80974f0 legacy=0x7ff6d8133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.470 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.459+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2611899549 shutdown_connections 2021-02-24T15:29:47.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.459+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2611899549 >> 172.21.15.152:0/2611899549 conn(0x7ff6d809d9e0 msgr2=0x7ff6d809ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:47.471 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.459+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2611899549 shutdown_connections 2021-02-24T15:29:47.472 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.459+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2611899549 wait complete. 2021-02-24T15:29:47.472 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dd2f2700 1 librados: starting msgr at 2021-02-24T15:29:47.472 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dd2f2700 1 librados: starting objecter 2021-02-24T15:29:47.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dd2f2700 1 Processor -- start 2021-02-24T15:29:47.473 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dd2f2700 1 -- start start 2021-02-24T15:29:47.474 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dd2f2700 1 librados: setting wanted keys 2021-02-24T15:29:47.474 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dd2f2700 1 librados: calling monclient init 2021-02-24T15:29:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dd2f2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80993d0 con 0x7ff6d8097040 2021-02-24T15:29:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dd2f2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d8095620 con 0x7ff6d80974f0 2021-02-24T15:29:47.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dd2f2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d81140e0 con 0x7ff6d8097b10 2021-02-24T15:29:47.476 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6d7fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff6d8097040 0x7ff6d8125690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49204/0 (socket says 172.21.15.152:49204) 2021-02-24T15:29:47.477 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6dcaf1700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff6d8097b10 0x7ff6d81423b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37682/0 (socket says 172.21.15.152:37682) 2021-02-24T15:29:47.477 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.460+0000 7ff6d7fff700 1 -- 172.21.15.152:0/2139733406 learned_addr learned my addr 172.21.15.152:0/2139733406 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:47.487 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6d7fff700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6789/0 conn(0x7ff6d8097040 legacy=0x7ff6d8125690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.487 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 10 client.?.objecter ms_handle_connect 0x7ff6d8097040 2021-02-24T15:29:47.487 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.487 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 10 client.?.objecter ms_handle_connect 0x7ff6d8097b10 2021-02-24T15:29:47.488 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.488 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6dcaf1700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6790/0 conn(0x7ff6d8097b10 legacy=0x7ff6d81423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.488 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400942952 0 0) 0x7ff6d80993d0 con 0x7ff6d8097040 2021-02-24T15:29:47.488 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc004bd0 con 0x7ff6d8097040 2021-02-24T15:29:47.488 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408616012 0 0) 0x7ff6d81140e0 con 0x7ff6d8097b10 2021-02-24T15:29:47.489 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d80993d0 con 0x7ff6d8097b10 2021-02-24T15:29:47.489 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 10 client.?.objecter ms_handle_connect 0x7ff6d80974f0 2021-02-24T15:29:47.489 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.489 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6d77fe700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.181:6789/0 conn(0x7ff6d80974f0 legacy=0x7ff6d813a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.489 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312464056 0 0) 0x7ff6c0001c30 con 0x7ff6d80974f0 2021-02-24T15:29:47.490 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d81140e0 con 0x7ff6d80974f0 2021-02-24T15:29:47.490 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 496003283 0 0) 0x7ff6bc004bd0 con 0x7ff6d8097040 2021-02-24T15:29:47.490 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6c0001c30 con 0x7ff6d8097040 2021-02-24T15:29:47.490 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6c8001ec0 con 0x7ff6d8097040 2021-02-24T15:29:47.490 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1472117395 0 0) 0x7ff6d80993d0 con 0x7ff6d8097b10 2021-02-24T15:29:47.491 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6bc004bd0 con 0x7ff6d8097b10 2021-02-24T15:29:47.491 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6d0001d30 con 0x7ff6d8097b10 2021-02-24T15:29:47.491 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 64020614 0 0) 0x7ff6d81140e0 con 0x7ff6d80974f0 2021-02-24T15:29:47.491 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6d80993d0 con 0x7ff6d80974f0 2021-02-24T15:29:47.491 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3434827516 0 0) 0x7ff6c0001c30 con 0x7ff6d8097040 2021-02-24T15:29:47.492 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6790/0 conn(0x7ff6d8097b10 legacy=0x7ff6d81423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.492 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.181:6789/0 conn(0x7ff6d80974f0 legacy=0x7ff6d813a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.492 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8096db0 con 0x7ff6d8097040 2021-02-24T15:29:47.492 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d8125da0 con 0x7ff6d8097040 2021-02-24T15:29:47.492 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6dd2f2700 10 client.28464.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:47.493 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d813a8d0 con 0x7ff6d8097040 2021-02-24T15:29:47.493 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6dd2f2700 1 librados: init done 2021-02-24T15:29:47.493 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6c8002470 con 0x7ff6d8097040 2021-02-24T15:29:47.493 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.463+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6c8002780 con 0x7ff6d8097040 2021-02-24T15:29:47.493 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.464+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff6b0006550 con 0x7ff6b00027f0 2021-02-24T15:29:47.494 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.464+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff6c8002960 con 0x7ff6d8097040 2021-02-24T15:29:47.494 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.464+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(545..545 src has 330..545) v4 ==== 5734+0+0 (unknown 4108916491 0 0) 0x7ff6c803b2a0 con 0x7ff6d8097040 2021-02-24T15:29:47.494 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.464+0000 7ff6cffff700 10 client.28464.objecter ms_dispatch 0x7ff6d8001510 osd_map(545..545 src has 330..545) v4 2021-02-24T15:29:47.495 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.464+0000 7ff6cffff700 3 client.28464.objecter handle_osd_map got epochs [545,545] > 0 2021-02-24T15:29:47.495 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.464+0000 7ff6cffff700 3 client.28464.objecter handle_osd_map decoding full epoch 545 2021-02-24T15:29:47.495 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.464+0000 7ff6cffff700 20 client.28464.objecter dump_active .. 0 homeless 2021-02-24T15:29:47.495 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.466+0000 7ff6cffff700 10 client.28464.objecter ms_handle_connect 0x7ff6b00027f0 2021-02-24T15:29:47.496 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.466+0000 7ff6d77fe700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6790/0 conn(0x7ff6b00027f0 legacy=0x7ff6b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.496 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.466+0000 7ff6cffff700 10 client.28464.objecter resend_mon_ops 2021-02-24T15:29:47.496 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.466+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372507793 0 0) 0x7ff6b0006550 con 0x7ff6b00027f0 2021-02-24T15:29:47.496 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.466+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c0001c30 con 0x7ff6b00027f0 2021-02-24T15:29:47.496 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.466+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1254120896 0 0) 0x7ff6c0001c30 con 0x7ff6b00027f0 2021-02-24T15:29:47.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.467+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6b0006550 con 0x7ff6b00027f0 2021-02-24T15:29:47.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.467+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6c00019d0 con 0x7ff6b00027f0 2021-02-24T15:29:47.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.467+0000 7ff6cffff700 10 client.28464.objecter ms_handle_connect 0x7ff6bc0317b0 2021-02-24T15:29:47.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.467+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3665645202 0 0) 0x7ff6b0006550 con 0x7ff6b00027f0 2021-02-24T15:29:47.497 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.467+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b0009df0 con 0x7ff6b00027f0 2021-02-24T15:29:47.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.467+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7ff6c0006ad0 con 0x7ff6b00027f0 2021-02-24T15:29:47.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.467+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6790/0 conn(0x7ff6b00027f0 legacy=0x7ff6b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.467+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6790/0 conn(0x7ff6b00027f0 legacy=0x7ff6b0004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:47.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.475+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7ff6b0009a80 con 0x7ff6b0008da0 2021-02-24T15:29:47.498 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.477+0000 7ff6cffff700 10 client.28464.objecter ms_handle_connect 0x7ff6b0008da0 2021-02-24T15:29:47.499 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.477+0000 7ff6cffff700 10 client.28464.objecter resend_mon_ops 2021-02-24T15:29:47.499 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.477+0000 7ff6d77fe700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6790/0 conn(0x7ff6b0008da0 legacy=0x7ff6b0009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.499 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299501422 0 0) 0x7ff6b0009a80 con 0x7ff6b0008da0 2021-02-24T15:29:47.499 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b0006550 con 0x7ff6b0008da0 2021-02-24T15:29:47.499 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4210475729 0 0) 0x7ff6b0006550 con 0x7ff6b0008da0 2021-02-24T15:29:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6b0009a80 con 0x7ff6b0008da0 2021-02-24T15:29:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff6c0004f70 con 0x7ff6b0008da0 2021-02-24T15:29:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2429993926 0 0) 0x7ff6b0009a80 con 0x7ff6b0008da0 2021-02-24T15:29:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff6b00086f0 con 0x7ff6b0008da0 2021-02-24T15:29:47.500 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3940 (unknown 0 0 3452579998) 0x7ff6c0006430 con 0x7ff6b0008da0 2021-02-24T15:29:47.501 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6790/0 conn(0x7ff6b0008da0 legacy=0x7ff6b0009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.501 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6cffff700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6790/0 conn(0x7ff6b0008da0 legacy=0x7ff6b0009230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:47.501 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6dd2f2700 10 librados: watch_flush enter 2021-02-24T15:29:47.501 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6dd2f2700 10 librados: watch_flush exit 2021-02-24T15:29:47.501 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6dd2f2700 20 client.28464.objecter shutdown clearing up homeless session... 2021-02-24T15:29:47.502 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6dd2f2700 10 client.28464.objecter successfully canceled tick 2021-02-24T15:29:47.503 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.181:6812/33484 conn(0x7ff6bc0317b0 legacy=0x7ff6bc033c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.503 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 >> v1:172.21.15.152:6789/0 conn(0x7ff6d8097040 legacy=0x7ff6d8125690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.503 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.478+0000 7ff6dcaf1700 1 -- 172.21.15.152:0/2139733406 reap_dead start 2021-02-24T15:29:47.503 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.479+0000 7ff6dcaf1700 1 -- 172.21.15.152:0/2139733406 reap_dead start 2021-02-24T15:29:47.503 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.479+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 shutdown_connections 2021-02-24T15:29:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.479+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 >> 172.21.15.152:0/2139733406 conn(0x7ff6d809d9e0 msgr2=0x7ff6d8128d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.479+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 shutdown_connections 2021-02-24T15:29:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.479+0000 7ff6dd2f2700 1 -- 172.21.15.152:0/2139733406 wait complete. 2021-02-24T15:29:47.504 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.479+0000 7ff6dd2f2700 1 librados: shutdown 2021-02-24T15:29:47.505 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:29:47.505 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:29:47.505 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:29:47.505 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:29:47.506 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 66, 2021-02-24T15:29:47.506 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:29:47.506 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:29:47.506 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:29:47.506 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:29:47.507 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.507 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:29:47.507 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:47.507 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:29:47.507 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:29:47.508 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:47.508 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:47.508 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:47.508 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:47.508 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:47.509 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:47.509 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:47.509 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:47.509 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:47.509 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.510 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:29:47.510 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:29:47.510 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:47.510 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:47.510 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:47.511 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:47.511 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:47.511 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:47.511 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:47.511 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:47.512 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:47.512 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.512 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:29:47.512 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:29:47.513 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:29:47.513 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:29:47.513 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:29:47.513 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:29:47.513 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:47.514 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:47.514 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:29:47.514 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:29:47.514 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:29:47.515 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:29:47.515 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:29:47.515 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:47.515 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:29:47.515 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:47.516 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:47.516 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:47.516 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:47.516 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:47.516 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:47.517 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:47.517 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:47.517 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:47.517 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.517 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:29:47.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.518 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:29:47.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.518 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:29:47.518 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:29:47.519 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:47.519 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:47.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.519 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:47.519 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:29:47.520 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:47.520 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.520 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.521 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:29:47.521 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:29:47.521 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:47.521 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:47.521 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:47.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.522 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:29:47.522 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:29:47.522 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:47.523 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:47.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.523 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:47.523 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:29:47.523 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:47.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.524 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.524 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:29:47.524 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:29:47.525 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:47.525 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:47.525 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:47.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.526 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:29:47.526 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:29:47.526 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:47.527 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:47.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.527 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:47.527 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:29:47.527 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:47.528 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.528 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.528 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:29:47.528 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:29:47.529 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:47.529 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:47.529 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:47.529 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.529 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.530 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:29:47.530 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:29:47.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.531 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:47.531 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:47.531 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:47.531 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.531 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.532 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:29:47.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.532 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:47.532 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:47.532 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:47.533 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.533 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.533 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:29:47.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.533 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:47.534 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:47.534 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:47.534 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.534 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.535 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:29:47.535 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:29:47.536 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:29:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.653+0000 7f2849741700 1 Processor -- start 2021-02-24T15:29:47.654 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.653+0000 7f2849741700 1 -- start start 2021-02-24T15:29:47.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.654+0000 7f2849741700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440922a0 con 0x7f28440945b0 2021-02-24T15:29:47.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.654+0000 7f2849741700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2844092540 con 0x7f28440939f0 2021-02-24T15:29:47.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.654+0000 7f2849741700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440927e0 con 0x7f284412e1c0 2021-02-24T15:29:47.655 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.654+0000 7f28437fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f284412e1c0 0x7f28441305b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37692/0 (socket says 172.21.15.152:37692) 2021-02-24T15:29:47.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.654+0000 7f28437fe700 1 -- 172.21.15.152:0/34972538 learned_addr learned my addr 172.21.15.152:0/34972538 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:47.656 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.654+0000 7f2842ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f28440945b0 0x7f284408fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49216/0 (socket says 172.21.15.152:49216) 2021-02-24T15:29:47.659 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f28437fe700 1 -- 172.21.15.152:0/34972538 >> v1:172.21.15.152:6790/0 conn(0x7f284412e1c0 legacy=0x7f28441305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2842ffd700 1 -- 172.21.15.152:0/34972538 >> v1:172.21.15.152:6789/0 conn(0x7f28440945b0 legacy=0x7f284408fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534554174 0 0) 0x7f28440927e0 con 0x7f284412e1c0 2021-02-24T15:29:47.660 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2830003230 con 0x7f284412e1c0 2021-02-24T15:29:47.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201822974 0 0) 0x7f28440922a0 con 0x7f28440945b0 2021-02-24T15:29:47.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f28427fc700 1 -- 172.21.15.152:0/34972538 >> v1:172.21.15.181:6789/0 conn(0x7f28440939f0 legacy=0x7f2844090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.661 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28440927e0 con 0x7f28440945b0 2021-02-24T15:29:47.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582164590 0 0) 0x7f2844092540 con 0x7f28440939f0 2021-02-24T15:29:47.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28440922a0 con 0x7f28440939f0 2021-02-24T15:29:47.662 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 437247112 0 0) 0x7f2830003230 con 0x7f284412e1c0 2021-02-24T15:29:47.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 >> v1:172.21.15.181:6789/0 conn(0x7f28440939f0 legacy=0x7f2844090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.656+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 >> v1:172.21.15.152:6789/0 conn(0x7f28440945b0 legacy=0x7f284408fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.657+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844092a80 con 0x7f284412e1c0 2021-02-24T15:29:47.663 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.657+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f283c001d70 con 0x7f284412e1c0 2021-02-24T15:29:47.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.657+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f283c002020 con 0x7f284412e1c0 2021-02-24T15:29:47.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.657+0000 7f2841ffb700 1 -- 172.21.15.152:0/34972538 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f283c004ad0 con 0x7f284412e1c0 2021-02-24T15:29:47.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.657+0000 7f2849741700 1 -- 172.21.15.152:0/34972538 >> v1:172.21.15.152:6790/0 conn(0x7f284412e1c0 legacy=0x7f28441305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.664 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.657+0000 7f2849741700 1 -- 172.21.15.152:0/34972538 shutdown_connections 2021-02-24T15:29:47.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.657+0000 7f2849741700 1 -- 172.21.15.152:0/34972538 >> 172.21.15.152:0/34972538 conn(0x7f28440999a0 msgr2=0x7f2844099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:47.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.657+0000 7f2849741700 1 -- 172.21.15.152:0/34972538 shutdown_connections 2021-02-24T15:29:47.665 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.657+0000 7f2849741700 1 -- 172.21.15.152:0/34972538 wait complete. 2021-02-24T15:29:47.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.658+0000 7f2849741700 1 librados: starting msgr at 2021-02-24T15:29:47.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.658+0000 7f2849741700 1 librados: starting objecter 2021-02-24T15:29:47.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.658+0000 7f2849741700 1 Processor -- start 2021-02-24T15:29:47.666 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.658+0000 7f2849741700 1 -- start start 2021-02-24T15:29:47.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.658+0000 7f2849741700 1 librados: setting wanted keys 2021-02-24T15:29:47.667 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.658+0000 7f2849741700 1 librados: calling monclient init 2021-02-24T15:29:47.669 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.659+0000 7f2849741700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440655f0 con 0x7f28440945b0 2021-02-24T15:29:47.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.659+0000 7f2849741700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440917d0 con 0x7f284412e1c0 2021-02-24T15:29:47.670 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.659+0000 7f2849741700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2844065d40 con 0x7f28440939f0 2021-02-24T15:29:47.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.659+0000 7f2842ffd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f28440939f0 0x7f2844126840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37696/0 (socket says 172.21.15.152:37696) 2021-02-24T15:29:47.671 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.659+0000 7f2842ffd700 1 -- 172.21.15.152:0/569069282 learned_addr learned my addr 172.21.15.152:0/569069282 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:47.687 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f28427fc700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.152:6789/0 conn(0x7f28440945b0 legacy=0x7f284413f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.688 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f2842ffd700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.152:6790/0 conn(0x7f28440939f0 legacy=0x7f2844126840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 10 client.?.objecter ms_handle_connect 0x7f28440945b0 2021-02-24T15:29:47.689 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.690 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 10 client.?.objecter ms_handle_connect 0x7f28440939f0 2021-02-24T15:29:47.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203560108 0 0) 0x7f28440655f0 con 0x7f28440945b0 2021-02-24T15:29:47.691 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f28437fe700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.181:6789/0 conn(0x7f284412e1c0 legacy=0x7f28441427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.693 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2824004bd0 con 0x7f28440945b0 2021-02-24T15:29:47.694 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 10 client.?.objecter ms_handle_connect 0x7f284412e1c0 2021-02-24T15:29:47.694 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.695 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165475501 0 0) 0x7f2844065d40 con 0x7f28440939f0 2021-02-24T15:29:47.696 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28440655f0 con 0x7f28440939f0 2021-02-24T15:29:47.697 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015843508 0 0) 0x7f28440917d0 con 0x7f284412e1c0 2021-02-24T15:29:47.697 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2844065d40 con 0x7f284412e1c0 2021-02-24T15:29:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 167574336 0 0) 0x7f2824004bd0 con 0x7f28440945b0 2021-02-24T15:29:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f28440917d0 con 0x7f28440945b0 2021-02-24T15:29:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2838001c60 con 0x7f28440945b0 2021-02-24T15:29:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1743555263 0 0) 0x7f28440655f0 con 0x7f28440939f0 2021-02-24T15:29:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2824004bd0 con 0x7f28440939f0 2021-02-24T15:29:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2834001c60 con 0x7f28440939f0 2021-02-24T15:29:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2457493909 0 0) 0x7f2844065d40 con 0x7f284412e1c0 2021-02-24T15:29:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f28440655f0 con 0x7f284412e1c0 2021-02-24T15:29:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f283c004a10 con 0x7f284412e1c0 2021-02-24T15:29:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 993466928 0 0) 0x7f28440917d0 con 0x7f28440945b0 2021-02-24T15:29:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.152:6790/0 conn(0x7f28440939f0 legacy=0x7f2844126840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.181:6789/0 conn(0x7f284412e1c0 legacy=0x7f28441427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844066d80 con 0x7f28440945b0 2021-02-24T15:29:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28440959d0 con 0x7f28440945b0 2021-02-24T15:29:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f2849741700 10 client.28470.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2844094e40 con 0x7f28440945b0 2021-02-24T15:29:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.661+0000 7f2849741700 1 librados: init done 2021-02-24T15:29:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.662+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2838002320 con 0x7f28440945b0 2021-02-24T15:29:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.662+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2838002490 con 0x7f28440945b0 2021-02-24T15:29:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.662+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f28380025f0 con 0x7f28440945b0 2021-02-24T15:29:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.662+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f281c006550 con 0x7f281c0027f0 2021-02-24T15:29:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.662+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(545..545 src has 330..545) v4 ==== 5734+0+0 (unknown 4108916491 0 0) 0x7f283803b050 con 0x7f28440945b0 2021-02-24T15:29:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.662+0000 7f282affd700 10 client.28470.objecter ms_dispatch 0x7f2844001510 osd_map(545..545 src has 330..545) v4 2021-02-24T15:29:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.662+0000 7f282affd700 3 client.28470.objecter handle_osd_map got epochs [545,545] > 0 2021-02-24T15:29:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.662+0000 7f282affd700 3 client.28470.objecter handle_osd_map decoding full epoch 545 2021-02-24T15:29:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.662+0000 7f282affd700 20 client.28470.objecter dump_active .. 0 homeless 2021-02-24T15:29:47.704 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 10 client.28470.objecter ms_handle_connect 0x7f281c0027f0 2021-02-24T15:29:47.704 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f2842ffd700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.181:6789/0 conn(0x7f281c0027f0 legacy=0x7f281c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.704 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 10 client.28470.objecter resend_mon_ops 2021-02-24T15:29:47.704 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249857348 0 0) 0x7f281c006550 con 0x7f281c0027f0 2021-02-24T15:29:47.705 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28440917d0 con 0x7f281c0027f0 2021-02-24T15:29:47.705 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 10 client.28470.objecter ms_handle_connect 0x7f2824031790 2021-02-24T15:29:47.705 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2497649574 0 0) 0x7f28440917d0 con 0x7f281c0027f0 2021-02-24T15:29:47.706 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f281c006550 con 0x7f281c0027f0 2021-02-24T15:29:47.706 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f28340049f0 con 0x7f281c0027f0 2021-02-24T15:29:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3216136072 0 0) 0x7f281c006550 con 0x7f281c0027f0 2021-02-24T15:29:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.665+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f281c009df0 con 0x7f281c0027f0 2021-02-24T15:29:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.666+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f2834004e10 con 0x7f281c0027f0 2021-02-24T15:29:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.666+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.181:6789/0 conn(0x7f281c0027f0 legacy=0x7f281c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.666+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.181:6789/0 conn(0x7f281c0027f0 legacy=0x7f281c004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.673+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f281c007520 con 0x7f281c0068c0 2021-02-24T15:29:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f2842ffd700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.181:6789/0 conn(0x7f281c0068c0 legacy=0x7f281c006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f282affd700 10 client.28470.objecter ms_handle_connect 0x7f281c0068c0 2021-02-24T15:29:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f282affd700 10 client.28470.objecter resend_mon_ops 2021-02-24T15:29:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206429745 0 0) 0x7f281c007520 con 0x7f281c0068c0 2021-02-24T15:29:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f281c006550 con 0x7f281c0068c0 2021-02-24T15:29:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 319430261 0 0) 0x7f281c006550 con 0x7f281c0068c0 2021-02-24T15:29:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f281c007520 con 0x7f281c0068c0 2021-02-24T15:29:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f28340055d0 con 0x7f281c0068c0 2021-02-24T15:29:47.716 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 492693600 0 0) 0x7f281c007520 con 0x7f281c0068c0 2021-02-24T15:29:47.716 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.676+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f281c008720 con 0x7f281c0068c0 2021-02-24T15:29:47.716 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 1841740011) 0x7f28340069a0 con 0x7f281c0068c0 2021-02-24T15:29:47.716 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.181:6789/0 conn(0x7f281c0068c0 legacy=0x7f281c006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.716 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f282affd700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.181:6789/0 conn(0x7f281c0068c0 legacy=0x7f281c006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:47.717 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 10 librados: watch_flush enter 2021-02-24T15:29:47.717 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 10 librados: watch_flush exit 2021-02-24T15:29:47.717 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 20 client.28470.objecter shutdown clearing up homeless session... 2021-02-24T15:29:47.717 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 10 client.28470.objecter successfully canceled tick 2021-02-24T15:29:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.181:6812/33484 conn(0x7f2824031790 legacy=0x7f2824033c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 >> v1:172.21.15.152:6789/0 conn(0x7f28440945b0 legacy=0x7f284413f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f28437fe700 1 -- 172.21.15.152:0/569069282 reap_dead start 2021-02-24T15:29:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f28437fe700 1 -- 172.21.15.152:0/569069282 reap_dead start 2021-02-24T15:29:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 shutdown_connections 2021-02-24T15:29:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 >> 172.21.15.152:0/569069282 conn(0x7f28440999a0 msgr2=0x7f28440977d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 shutdown_connections 2021-02-24T15:29:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 1 -- 172.21.15.152:0/569069282 wait complete. 2021-02-24T15:29:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.677+0000 7f2849741700 1 librados: shutdown 2021-02-24T15:29:47.720 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:29:47.720 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:29:47.720 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:29:47.720 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:29:47.721 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 66, 2021-02-24T15:29:47.721 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:29:47.721 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:29:47.721 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:29:47.722 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:29:47.722 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.738 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:29:47.739 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:47.739 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:29:47.739 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:29:47.739 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:47.739 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:47.740 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:47.740 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:47.740 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:47.740 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:47.740 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:47.741 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:47.741 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:47.741 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.741 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:29:47.742 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:29:47.742 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:47.742 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:47.742 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:47.742 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:47.743 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:47.743 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:47.743 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:47.743 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:47.743 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:47.744 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.744 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:29:47.744 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:29:47.745 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:29:47.745 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:29:47.745 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:29:47.745 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:29:47.745 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:47.746 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:47.746 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:29:47.746 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:29:47.746 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:29:47.746 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:29:47.747 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:29:47.747 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:47.747 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:29:47.747 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:47.747 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:47.748 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:47.748 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:47.748 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:47.748 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:47.748 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:47.749 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:47.749 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:47.749 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.749 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:29:47.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.750 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:29:47.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.750 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:29:47.750 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:29:47.751 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:47.751 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:47.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.751 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:47.751 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:29:47.752 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:47.752 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.752 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.753 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:29:47.753 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:29:47.753 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:47.753 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:47.753 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:47.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.755 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:29:47.755 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:29:47.756 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:47.756 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:47.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.756 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:47.756 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:29:47.757 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:47.757 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.757 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.757 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:29:47.758 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:29:47.758 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:47.758 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:47.758 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:47.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.759 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:29:47.759 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:29:47.759 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:47.760 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:47.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.760 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:47.760 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:29:47.761 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:47.761 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.761 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.762 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:29:47.762 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:29:47.762 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:47.762 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:47.762 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:47.763 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.763 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.763 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:29:47.763 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:29:47.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.764 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:47.764 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:47.764 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:47.764 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.765 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:47.765 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:29:47.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:47.765 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:47.765 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:47.766 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:47.766 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:47.766 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:47.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:47.767 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:29:47.767 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:29:47.768 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2021-02-24T15:29:47.768 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2021-02-24T15:29:47.884 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.884+0000 7f0f1a46d700 1 Processor -- start 2021-02-24T15:29:47.885 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.885+0000 7f0f1a46d700 1 -- start start 2021-02-24T15:29:47.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.885+0000 7f0f1a46d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f14092280 con 0x7f0f14093a40 2021-02-24T15:29:47.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.885+0000 7f0f1a46d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f14090840 con 0x7f0f1412e1c0 2021-02-24T15:29:47.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.885+0000 7f0f1a46d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f140924b0 con 0x7f0f14094730 2021-02-24T15:29:47.886 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.885+0000 7f0f137fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0f14093a40 0x7f0f14090130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49234/0 (socket says 172.21.15.152:49234) 2021-02-24T15:29:47.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.885+0000 7f0f13fff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f0f14094730 0x7f0f1408fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37708/0 (socket says 172.21.15.152:37708) 2021-02-24T15:29:47.887 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.885+0000 7f0f137fe700 1 -- 172.21.15.152:0/2504928842 learned_addr learned my addr 172.21.15.152:0/2504928842 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:47.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.887+0000 7f0f137fe700 1 -- 172.21.15.152:0/2504928842 >> v1:172.21.15.152:6789/0 conn(0x7f0f14093a40 legacy=0x7f0f14090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.887+0000 7f0f13fff700 1 -- 172.21.15.152:0/2504928842 >> v1:172.21.15.152:6790/0 conn(0x7f0f14094730 legacy=0x7f0f1408fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.889 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.887+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231520586 0 0) 0x7f0f14092280 con 0x7f0f14093a40 2021-02-24T15:29:47.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef4003230 con 0x7f0f14093a40 2021-02-24T15:29:47.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391410262 0 0) 0x7f0f140924b0 con 0x7f0f14094730 2021-02-24T15:29:47.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f14092280 con 0x7f0f14094730 2021-02-24T15:29:47.890 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f18a0a700 1 -- 172.21.15.152:0/2504928842 >> v1:172.21.15.181:6789/0 conn(0x7f0f1412e1c0 legacy=0x7f0f141305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1562732477 0 0) 0x7f0f14092280 con 0x7f0f14094730 2021-02-24T15:29:47.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 >> v1:172.21.15.181:6789/0 conn(0x7f0f1412e1c0 legacy=0x7f0f141305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 >> v1:172.21.15.152:6789/0 conn(0x7f0f14093a40 legacy=0x7f0f14090130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14092750 con 0x7f0f14094730 2021-02-24T15:29:47.891 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0f04001930 con 0x7f0f14094730 2021-02-24T15:29:47.892 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f13fff700 1 --1- 172.21.15.152:0/2504928842 >> v1:172.21.15.152:6790/0 conn(0x7f0f14094730 0x7f0f1408fa20 :-1 s=OPENED pgs=8548 cs=1 l=1).queue_received will delay after 1.61418e+09 on 0x7f0f04004690 mon_map magic: 0 v1 2021-02-24T15:29:47.892 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0f04001c40 con 0x7f0f14094730 2021-02-24T15:29:47.892 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f1a46d700 1 -- 172.21.15.152:0/2504928842 >> v1:172.21.15.152:6790/0 conn(0x7f0f14094730 legacy=0x7f0f1408fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.892 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f12ffd700 1 -- 172.21.15.152:0/2504928842 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0f04004690 con 0x7f0f14094730 2021-02-24T15:29:47.893 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f1a46d700 1 -- 172.21.15.152:0/2504928842 shutdown_connections 2021-02-24T15:29:47.893 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f1a46d700 1 -- 172.21.15.152:0/2504928842 >> 172.21.15.152:0/2504928842 conn(0x7f0f140999a0 msgr2=0x7f0f14099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:47.893 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f1a46d700 1 -- 172.21.15.152:0/2504928842 shutdown_connections 2021-02-24T15:29:47.893 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.888+0000 7f0f1a46d700 1 -- 172.21.15.152:0/2504928842 wait complete. 2021-02-24T15:29:47.893 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.889+0000 7f0f1a46d700 1 librados: starting msgr at 2021-02-24T15:29:47.894 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.889+0000 7f0f1a46d700 1 librados: starting objecter 2021-02-24T15:29:47.894 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.889+0000 7f0f1a46d700 1 Processor -- start 2021-02-24T15:29:47.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.889+0000 7f0f1a46d700 1 -- start start 2021-02-24T15:29:47.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.889+0000 7f0f1a46d700 1 librados: setting wanted keys 2021-02-24T15:29:47.897 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.889+0000 7f0f1a46d700 1 librados: calling monclient init 2021-02-24T15:29:47.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.890+0000 7f0f1a46d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f14136760 con 0x7f0f14094730 2021-02-24T15:29:47.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.890+0000 7f0f1a46d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f14127de0 con 0x7f0f14093a40 2021-02-24T15:29:47.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.890+0000 7f0f1a46d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f14111e40 con 0x7f0f1412e1c0 2021-02-24T15:29:47.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.890+0000 7f0f18a0a700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f0f1412e1c0 0x7f0f1413eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37718/0 (socket says 172.21.15.152:37718) 2021-02-24T15:29:47.898 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.890+0000 7f0f137fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0f14094730 0x7f0f141276d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49240/0 (socket says 172.21.15.152:49240) 2021-02-24T15:29:47.899 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.890+0000 7f0f18a0a700 1 -- 172.21.15.152:0/1385892168 learned_addr learned my addr 172.21.15.152:0/1385892168 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:47.899 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f18a0a700 1 -- 172.21.15.152:0/1385892168 >> v1:172.21.15.152:6790/0 conn(0x7f0f1412e1c0 legacy=0x7f0f1413eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.899 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 10 client.?.objecter ms_handle_connect 0x7f0f1412e1c0 2021-02-24T15:29:47.899 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f137fe700 1 -- 172.21.15.152:0/1385892168 >> v1:172.21.15.152:6789/0 conn(0x7f0f14094730 legacy=0x7f0f141276d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 10 client.?.objecter ms_handle_connect 0x7f0f14094730 2021-02-24T15:29:47.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.900 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830554542 0 0) 0x7f0f14136760 con 0x7f0f14094730 2021-02-24T15:29:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef8004bd0 con 0x7f0f14094730 2021-02-24T15:29:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683259052 0 0) 0x7f0f14111e40 con 0x7f0f1412e1c0 2021-02-24T15:29:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f14136760 con 0x7f0f1412e1c0 2021-02-24T15:29:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 10 client.?.objecter ms_handle_connect 0x7f0f14093a40 2021-02-24T15:29:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f0bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:47.902 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.892+0000 7f0f13fff700 1 -- 172.21.15.152:0/1385892168 >> v1:172.21.15.181:6789/0 conn(0x7f0f14093a40 legacy=0x7f0f14136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:47.902 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3198044715 0 0) 0x7f0ef8004bd0 con 0x7f0f14094730 2021-02-24T15:29:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0f14111e40 con 0x7f0f14094730 2021-02-24T15:29:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0efc001c60 con 0x7f0f14094730 2021-02-24T15:29:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2704143109 0 0) 0x7f0f14136760 con 0x7f0f1412e1c0 2021-02-24T15:29:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0ef8004bd0 con 0x7f0f1412e1c0 2021-02-24T15:29:47.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705019642 0 0) 0x7f0f14127de0 con 0x7f0f14093a40 2021-02-24T15:29:47.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f14136760 con 0x7f0f14093a40 2021-02-24T15:29:47.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0f0c001fc0 con 0x7f0f1412e1c0 2021-02-24T15:29:47.904 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2193386905 0 0) 0x7f0f14111e40 con 0x7f0f14094730 2021-02-24T15:29:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 >> v1:172.21.15.152:6790/0 conn(0x7f0f1412e1c0 legacy=0x7f0f1413eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 >> v1:172.21.15.181:6789/0 conn(0x7f0f14093a40 legacy=0x7f0f14136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f141120e0 con 0x7f0f14094730 2021-02-24T15:29:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f14110c30 con 0x7f0f14094730 2021-02-24T15:29:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f1a46d700 10 client.28476.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:47.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f140660a0 con 0x7f0f14094730 2021-02-24T15:29:47.906 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f1a46d700 1 librados: init done 2021-02-24T15:29:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0efc004860 con 0x7f0f14094730 2021-02-24T15:29:47.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.893+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f0efc004b70 con 0x7f0f14094730 2021-02-24T15:29:47.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.894+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f0efc004d10 con 0x7f0f14094730 2021-02-24T15:29:47.908 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.894+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(545..545 src has 330..545) v4 ==== 5734+0+0 (unknown 4108916491 0 0) 0x7f0efc03b1e0 con 0x7f0f14094730 2021-02-24T15:29:47.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.894+0000 7f0f0bfff700 10 client.28476.objecter ms_dispatch 0x7f0f14001510 osd_map(545..545 src has 330..545) v4 2021-02-24T15:29:47.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.894+0000 7f0f0bfff700 3 client.28476.objecter handle_osd_map got epochs [545,545] > 0 2021-02-24T15:29:47.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.894+0000 7f0f0bfff700 3 client.28476.objecter handle_osd_map decoding full epoch 545 2021-02-24T15:29:47.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.894+0000 7f0f0bfff700 20 client.28476.objecter dump_active .. 0 homeless 2021-02-24T15:29:47.909 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.894+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec004d60 con 0x7f0f14094730 2021-02-24T15:29:47.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.896+0000 7f0f0bfff700 10 client.28476.objecter ms_handle_connect 0x7f0ef80316e0 2021-02-24T15:29:47.910 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:47.898+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f0efc006290 con 0x7f0f14094730 2021-02-24T15:29:48.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.135+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f0eec005820 con 0x7f0f14094730 2021-02-24T15:29:48.147 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.136+0000 7f0f0bfff700 1 -- 172.21.15.152:0/1385892168 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (unknown 246732539 0 0) 0x7f0efc012330 con 0x7f0f14094730 2021-02-24T15:29:48.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 10 librados: watch_flush enter 2021-02-24T15:29:48.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 10 librados: watch_flush exit 2021-02-24T15:29:48.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 20 client.28476.objecter shutdown clearing up homeless session... 2021-02-24T15:29:48.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 10 client.28476.objecter successfully canceled tick 2021-02-24T15:29:48.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 >> v1:172.21.15.181:6812/33484 conn(0x7f0ef80316e0 legacy=0x7f0ef8033ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:48.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 >> v1:172.21.15.152:6789/0 conn(0x7f0f14094730 legacy=0x7f0f141276d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:48.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 shutdown_connections 2021-02-24T15:29:48.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 >> 172.21.15.152:0/1385892168 conn(0x7f0f140999a0 msgr2=0x7f0f140977d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:48.161 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 shutdown_connections 2021-02-24T15:29:48.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 1 -- 172.21.15.152:0/1385892168 wait complete. 2021-02-24T15:29:48.162 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0f1a46d700 1 librados: shutdown 2021-02-24T15:29:48.163 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.136+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.164 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.136+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=20,config=2,health=12,kv=6,logm=60} crc {auth=2258105353,config=3140514009,health=2895557514,kv=2558848642,logm=2329281147}) 2021-02-24T15:29:48.164 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.136+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=725341668,config=3140514009,health=3493826305,kv=2558848642,logm=2999414459}) 2021-02-24T15:29:48.164 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.136+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.165 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.136+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=20,config=2,health=12,kv=6,logm=60} crc {auth=2258105353,config=3140514009,health=2895557514,kv=2558848642,logm=2329281147}) 2021-02-24T15:29:48.165 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.136+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=6,logm=61} crc {auth=3678137208,config=3140514009,health=2895557514,kv=2558848642,logm=3496137811}) 2021-02-24T15:29:48.165 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.137+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.166 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.137+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081454489}) 2021-02-24T15:29:48.166 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.137+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4145529000}) 2021-02-24T15:29:48.167 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.137+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.168 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.137+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081454489}) 2021-02-24T15:29:48.168 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.137+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3808713825}) 2021-02-24T15:29:48.168 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.169 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1534280531}) 2021-02-24T15:29:48.177 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1845270862}) 2021-02-24T15:29:48.178 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.178 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1534280531}) 2021-02-24T15:29:48.178 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.138+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3832547884}) 2021-02-24T15:29:48.178 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.139+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.179 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.139+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2168030208}) 2021-02-24T15:29:48.179 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.139+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2198423045}) 2021-02-24T15:29:48.179 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.139+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.179 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.139+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2168030208}) 2021-02-24T15:29:48.179 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.139+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3680174732}) 2021-02-24T15:29:48.180 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.140+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.180 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.140+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719825987}) 2021-02-24T15:29:48.180 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.140+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=199245621}) 2021-02-24T15:29:48.180 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.140+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.181 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.140+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719825987}) 2021-02-24T15:29:48.181 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.140+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=24423232}) 2021-02-24T15:29:48.181 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.142+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.181 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.142+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3796701733}) 2021-02-24T15:29:48.181 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.142+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2651992780}) 2021-02-24T15:29:48.182 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.142+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.182 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.142+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3796701733}) 2021-02-24T15:29:48.182 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.142+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1542284915}) 2021-02-24T15:29:48.182 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.145+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.183 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.145+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=779643056}) 2021-02-24T15:29:48.183 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.145+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2251584265}) 2021-02-24T15:29:48.183 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.145+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.183 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.145+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=779643056}) 2021-02-24T15:29:48.183 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.145+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=327273}) 2021-02-24T15:29:48.194 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.147+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.195 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.147+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3948257959}) 2021-02-24T15:29:48.195 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.147+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=143365761}) 2021-02-24T15:29:48.195 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.148+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.196 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.148+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3948257959}) 2021-02-24T15:29:48.196 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.148+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2173026583}) 2021-02-24T15:29:48.197 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.150+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.197 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.150+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4009932390}) 2021-02-24T15:29:48.197 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.150+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2004423505}) 2021-02-24T15:29:48.198 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.150+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.198 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.150+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4009932390}) 2021-02-24T15:29:48.198 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.150+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4242877190}) 2021-02-24T15:29:48.199 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.156+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.199 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.156+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3122225331}) 2021-02-24T15:29:48.199 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.156+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3170873710}) 2021-02-24T15:29:48.200 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.156+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.200 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.156+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3122225331}) 2021-02-24T15:29:48.200 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.156+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=189532189}) 2021-02-24T15:29:48.200 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.201 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=9,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=39,osdmap=17} crc {logm=945652076,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=2280863436,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=4020367640,osd_snap=3026204160,osdmap=2196155275}) 2021-02-24T15:29:48.201 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=9,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=42,osdmap=14} crc {logm=945652076,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=1151018705,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=4020367640,osd_snap=3429452836,osdmap=702631042}) 2021-02-24T15:29:48.201 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.202 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=9,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=39,osdmap=17} crc {logm=945652076,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=2280863436,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=4020367640,osd_snap=3026204160,osdmap=2196155275}) 2021-02-24T15:29:48.202 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=9,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=4,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=40,osdmap=14} crc {logm=945652076,mdsmap=1531151339,mgr=1851299134,mgr_command_descs=550363828,mgr_metadata=3511068172,mgrstat=4082558308,mon_config_key=3951946154,monmap=2538103691,osd_metadata=4080698752,osd_pg_creating=4020367640,osd_snap=518183960,osdmap=222168603}) 2021-02-24T15:29:48.202 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.202 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4069159525}) 2021-02-24T15:29:48.203 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3291446091}) 2021-02-24T15:29:48.203 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.203 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4069159525}) 2021-02-24T15:29:48.203 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.157+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1701733791}) 2021-02-24T15:29:48.204 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.158+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.205 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.158+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4173259015}) 2021-02-24T15:29:48.205 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.158+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1402606090}) 2021-02-24T15:29:48.205 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.158+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.208 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.158+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4173259015}) 2021-02-24T15:29:48.208 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.158+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2116863172}) 2021-02-24T15:29:48.208 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.159+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.208 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.159+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=618224096}) 2021-02-24T15:29:48.209 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.159+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=576155197}) 2021-02-24T15:29:48.209 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.159+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.209 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.159+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=618224096}) 2021-02-24T15:29:48.209 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.159+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3648977132}) 2021-02-24T15:29:48.210 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.160+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.210 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.160+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=17} crc {osdmap=1928344345}) 2021-02-24T15:29:48.210 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.160+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=16} crc {osdmap=668561988}) 2021-02-24T15:29:48.211 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.160+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-24T15:29:48.211 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.160+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=17} crc {osdmap=1928344345}) 2021-02-24T15:29:48.211 INFO:tasks.ceph.mon.a.smithi152.stderr:2021-02-24T15:29:48.160+0000 7f0836b2e700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=17} crc {osdmap=1493149591}) 2021-02-24T15:29:48.212 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2021-02-24T15:29:49.213 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2021-02-24T15:29:49.213 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:29:49.340 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.340+0000 7f89e4106700 1 Processor -- start 2021-02-24T15:29:49.341 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.341+0000 7f89e4106700 1 -- start start 2021-02-24T15:29:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.341+0000 7f89e4106700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc092e60 con 0x7f89dc094e40 2021-02-24T15:29:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.341+0000 7f89e4106700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc091f30 con 0x7f89dc095930 2021-02-24T15:29:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.341+0000 7f89e4106700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc0921d0 con 0x7f89dc091110 2021-02-24T15:29:49.342 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.341+0000 7f89e16a1700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f89dc091110 0x7f89dc095220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37722/0 (socket says 172.21.15.152:37722) 2021-02-24T15:29:49.343 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.341+0000 7f89e16a1700 1 -- 172.21.15.152:0/193413846 learned_addr learned my addr 172.21.15.152:0/193413846 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:49.343 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.341+0000 7f89e1ea2700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f89dc094e40 0x7f89dc092750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49246/0 (socket says 172.21.15.152:49246) 2021-02-24T15:29:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.343+0000 7f89e1ea2700 1 -- 172.21.15.152:0/193413846 >> v1:172.21.15.152:6789/0 conn(0x7f89dc094e40 legacy=0x7f89dc092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.345 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.343+0000 7f89e16a1700 1 -- 172.21.15.152:0/193413846 >> v1:172.21.15.152:6790/0 conn(0x7f89dc091110 legacy=0x7f89dc095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784683295 0 0) 0x7f89dc0921d0 con 0x7f89dc091110 2021-02-24T15:29:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e26a3700 1 -- 172.21.15.152:0/193413846 >> v1:172.21.15.181:6789/0 conn(0x7f89dc095930 legacy=0x7f89dc12f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c4003230 con 0x7f89dc091110 2021-02-24T15:29:49.346 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677070042 0 0) 0x7f89dc092e60 con 0x7f89dc094e40 2021-02-24T15:29:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc0921d0 con 0x7f89dc094e40 2021-02-24T15:29:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097285085 0 0) 0x7f89dc091f30 con 0x7f89dc095930 2021-02-24T15:29:49.347 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc092e60 con 0x7f89dc095930 2021-02-24T15:29:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3461680202 0 0) 0x7f89dc0921d0 con 0x7f89dc094e40 2021-02-24T15:29:49.351 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 >> v1:172.21.15.152:6790/0 conn(0x7f89dc091110 legacy=0x7f89dc095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 >> v1:172.21.15.181:6789/0 conn(0x7f89dc095930 legacy=0x7f89dc12f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc091590 con 0x7f89dc094e40 2021-02-24T15:29:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89d8001930 con 0x7f89dc094e40 2021-02-24T15:29:49.352 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f89d8001c40 con 0x7f89dc094e40 2021-02-24T15:29:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e0ea0700 1 -- 172.21.15.152:0/193413846 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89d8004690 con 0x7f89dc094e40 2021-02-24T15:29:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e4106700 1 -- 172.21.15.152:0/193413846 >> v1:172.21.15.152:6789/0 conn(0x7f89dc094e40 legacy=0x7f89dc092750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e4106700 1 -- 172.21.15.152:0/193413846 shutdown_connections 2021-02-24T15:29:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.344+0000 7f89e4106700 1 -- 172.21.15.152:0/193413846 >> 172.21.15.152:0/193413846 conn(0x7f89dc0999a0 msgr2=0x7f89dc099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:49.353 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.345+0000 7f89e4106700 1 -- 172.21.15.152:0/193413846 shutdown_connections 2021-02-24T15:29:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.345+0000 7f89e4106700 1 -- 172.21.15.152:0/193413846 wait complete. 2021-02-24T15:29:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.345+0000 7f89e4106700 1 librados: starting msgr at 2021-02-24T15:29:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.345+0000 7f89e4106700 1 librados: starting objecter 2021-02-24T15:29:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.345+0000 7f89e4106700 1 Processor -- start 2021-02-24T15:29:49.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.345+0000 7f89e4106700 1 -- start start 2021-02-24T15:29:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.345+0000 7f89e4106700 1 librados: setting wanted keys 2021-02-24T15:29:49.355 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.345+0000 7f89e4106700 1 librados: calling monclient init 2021-02-24T15:29:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.346+0000 7f89e4106700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc067a50 con 0x7f89dc091110 2021-02-24T15:29:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.346+0000 7f89e4106700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc11ada0 con 0x7f89dc095930 2021-02-24T15:29:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.346+0000 7f89e4106700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc067170 con 0x7f89dc094e40 2021-02-24T15:29:49.359 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.346+0000 7f89e1ea2700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f89dc091110 0x7f89dc13a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49252/0 (socket says 172.21.15.152:49252) 2021-02-24T15:29:49.360 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.346+0000 7f89e1ea2700 1 -- 172.21.15.152:0/3437995383 learned_addr learned my addr 172.21.15.152:0/3437995383 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:49.362 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.348+0000 7f89e1ea2700 1 -- 172.21.15.152:0/3437995383 >> v1:172.21.15.152:6789/0 conn(0x7f89dc091110 legacy=0x7f89dc13a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.348+0000 7f89c9ffb700 10 client.?.objecter ms_handle_connect 0x7f89dc091110 2021-02-24T15:29:49.363 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.348+0000 7f89e16a1700 1 -- 172.21.15.152:0/3437995383 >> v1:172.21.15.152:6790/0 conn(0x7f89dc094e40 legacy=0x7f89dc133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.348+0000 7f89c9ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:49.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.348+0000 7f89c9ffb700 10 client.?.objecter ms_handle_connect 0x7f89dc094e40 2021-02-24T15:29:49.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.348+0000 7f89c9ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:49.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.348+0000 7f89c9ffb700 10 client.?.objecter ms_handle_connect 0x7f89dc095930 2021-02-24T15:29:49.365 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.348+0000 7f89c9ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:49.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.348+0000 7f89e26a3700 1 -- 172.21.15.152:0/3437995383 >> v1:172.21.15.181:6789/0 conn(0x7f89dc095930 legacy=0x7f89dc1422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290029731 0 0) 0x7f89dc067a50 con 0x7f89dc091110 2021-02-24T15:29:49.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89bc004bd0 con 0x7f89dc091110 2021-02-24T15:29:49.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730972561 0 0) 0x7f89dc11ada0 con 0x7f89dc095930 2021-02-24T15:29:49.366 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc067a50 con 0x7f89dc095930 2021-02-24T15:29:49.367 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407539737 0 0) 0x7f89dc067170 con 0x7f89dc094e40 2021-02-24T15:29:49.367 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc11ada0 con 0x7f89dc094e40 2021-02-24T15:29:49.367 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2426939304 0 0) 0x7f89bc004bd0 con 0x7f89dc091110 2021-02-24T15:29:49.367 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89dc067170 con 0x7f89dc091110 2021-02-24T15:29:49.368 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89d80018f0 con 0x7f89dc091110 2021-02-24T15:29:49.368 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 155921730 0 0) 0x7f89dc067a50 con 0x7f89dc095930 2021-02-24T15:29:49.368 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89bc004bd0 con 0x7f89dc095930 2021-02-24T15:29:49.368 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89d4001f60 con 0x7f89dc095930 2021-02-24T15:29:49.369 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3064613007 0 0) 0x7f89dc11ada0 con 0x7f89dc094e40 2021-02-24T15:29:49.369 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89dc067a50 con 0x7f89dc094e40 2021-02-24T15:29:49.369 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89cc001c60 con 0x7f89dc094e40 2021-02-24T15:29:49.370 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2740828027 0 0) 0x7f89dc067170 con 0x7f89dc091110 2021-02-24T15:29:49.370 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 >> v1:172.21.15.152:6790/0 conn(0x7f89dc094e40 legacy=0x7f89dc133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.370 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 >> v1:172.21.15.181:6789/0 conn(0x7f89dc095930 legacy=0x7f89dc1422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.370 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc1345a0 con 0x7f89dc091110 2021-02-24T15:29:49.371 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc11a3a0 con 0x7f89dc091110 2021-02-24T15:29:49.371 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f89d8004d40 con 0x7f89dc091110 2021-02-24T15:29:49.371 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f89d8005050 con 0x7f89dc091110 2021-02-24T15:29:49.372 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89e4106700 10 client.28482.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:49.372 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc118d60 con 0x7f89dc091110 2021-02-24T15:29:49.372 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.349+0000 7f89e4106700 1 librados: init done 2021-02-24T15:29:49.372 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.350+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f89d800dc10 con 0x7f89dc091110 2021-02-24T15:29:49.372 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.350+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(547..547 src has 330..547) v4 ==== 5742+0+0 (unknown 317122179 0 0) 0x7f89d803b320 con 0x7f89dc091110 2021-02-24T15:29:49.373 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.350+0000 7f89c9ffb700 10 client.28482.objecter ms_dispatch 0x7f89dc001510 osd_map(547..547 src has 330..547) v4 2021-02-24T15:29:49.373 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.350+0000 7f89c9ffb700 3 client.28482.objecter handle_osd_map got epochs [547,547] > 0 2021-02-24T15:29:49.373 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.350+0000 7f89c9ffb700 3 client.28482.objecter handle_osd_map decoding full epoch 547 2021-02-24T15:29:49.373 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.350+0000 7f89c9ffb700 20 client.28482.objecter dump_active .. 0 homeless 2021-02-24T15:29:49.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.350+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc119700 con 0x7f89dc091110 2021-02-24T15:29:49.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.353+0000 7f89c9ffb700 10 client.28482.objecter ms_handle_connect 0x7f89bc031930 2021-02-24T15:29:49.374 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.354+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f89d8012990 con 0x7f89dc091110 2021-02-24T15:29:49.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.591+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 --> v1:172.21.15.152:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f89dc058400 con 0x7f89dc091110 2021-02-24T15:29:49.591 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.591+0000 7f89c9ffb700 1 -- 172.21.15.152:0/3437995383 <== mon.0 v1:172.21.15.152:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 3359752324) 0x7f89d8012580 con 0x7f89dc091110 2021-02-24T15:29:49.592 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:29:49.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 10 librados: watch_flush enter 2021-02-24T15:29:49.593 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 10 librados: watch_flush exit 2021-02-24T15:29:49.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 20 client.28482.objecter shutdown clearing up homeless session... 2021-02-24T15:29:49.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 10 client.28482.objecter successfully canceled tick 2021-02-24T15:29:49.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 >> v1:172.21.15.181:6812/33484 conn(0x7f89bc031930 legacy=0x7f89bc033df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.594 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 >> v1:172.21.15.152:6789/0 conn(0x7f89dc091110 legacy=0x7f89dc13a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 shutdown_connections 2021-02-24T15:29:49.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 >> 172.21.15.152:0/3437995383 conn(0x7f89dc0999a0 msgr2=0x7f89dc064930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:49.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 shutdown_connections 2021-02-24T15:29:49.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 1 -- 172.21.15.152:0/3437995383 wait complete. 2021-02-24T15:29:49.595 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.593+0000 7f89e4106700 1 librados: shutdown 2021-02-24T15:29:49.604 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2021-02-24T15:29:49.605 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2021-02-24T15:29:49.605 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2021-02-24T15:29:49.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.722+0000 7f96c2a2a700 1 Processor -- start 2021-02-24T15:29:49.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.722+0000 7f96c2a2a700 1 -- start start 2021-02-24T15:29:49.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.723+0000 7f96c2a2a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc062660 con 0x7f96bc068410 2021-02-24T15:29:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.723+0000 7f96c2a2a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc063af0 con 0x7f96bc095bb0 2021-02-24T15:29:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.723+0000 7f96c2a2a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc063d90 con 0x7f96bc0966a0 2021-02-24T15:29:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.723+0000 7f96bbfff700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f96bc0966a0 0x7f96bc096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37736/0 (socket says 172.21.15.152:37736) 2021-02-24T15:29:49.724 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.723+0000 7f96bbfff700 1 -- 172.21.15.152:0/3579384812 learned_addr learned my addr 172.21.15.152:0/3579384812 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:49.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.723+0000 7f96c0fc7700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f96bc068410 0x7f96bc133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49260/0 (socket says 172.21.15.152:49260) 2021-02-24T15:29:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96bbfff700 1 -- 172.21.15.152:0/3579384812 >> v1:172.21.15.152:6790/0 conn(0x7f96bc0966a0 legacy=0x7f96bc096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96c0fc7700 1 -- 172.21.15.152:0/3579384812 >> v1:172.21.15.152:6789/0 conn(0x7f96bc068410 legacy=0x7f96bc133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053081889 0 0) 0x7f96bc062660 con 0x7f96bc068410 2021-02-24T15:29:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a8003230 con 0x7f96bc068410 2021-02-24T15:29:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627414364 0 0) 0x7f96bc063d90 con 0x7f96bc0966a0 2021-02-24T15:29:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96bc062660 con 0x7f96bc0966a0 2021-02-24T15:29:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96bb7fe700 1 -- 172.21.15.152:0/3579384812 >> v1:172.21.15.181:6789/0 conn(0x7f96bc095bb0 legacy=0x7f96bc130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2788291305 0 0) 0x7f96a8003230 con 0x7f96bc068410 2021-02-24T15:29:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 >> v1:172.21.15.152:6790/0 conn(0x7f96bc0966a0 legacy=0x7f96bc096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 >> v1:172.21.15.181:6789/0 conn(0x7f96bc095bb0 legacy=0x7f96bc130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc064030 con 0x7f96bc068410 2021-02-24T15:29:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.725+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f96b4001cb0 con 0x7f96bc068410 2021-02-24T15:29:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.726+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f96b4001fc0 con 0x7f96bc068410 2021-02-24T15:29:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.726+0000 7f96baffd700 1 -- 172.21.15.152:0/3579384812 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f96b4004a10 con 0x7f96bc068410 2021-02-24T15:29:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.726+0000 7f96c2a2a700 1 -- 172.21.15.152:0/3579384812 >> v1:172.21.15.152:6789/0 conn(0x7f96bc068410 legacy=0x7f96bc133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.726+0000 7f96c2a2a700 1 -- 172.21.15.152:0/3579384812 shutdown_connections 2021-02-24T15:29:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.726+0000 7f96c2a2a700 1 -- 172.21.15.152:0/3579384812 >> 172.21.15.152:0/3579384812 conn(0x7f96bc09ba40 msgr2=0x7f96bc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.726+0000 7f96c2a2a700 1 -- 172.21.15.152:0/3579384812 shutdown_connections 2021-02-24T15:29:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.726+0000 7f96c2a2a700 1 -- 172.21.15.152:0/3579384812 wait complete. 2021-02-24T15:29:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.727+0000 7f96c2a2a700 1 librados: starting msgr at 2021-02-24T15:29:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.727+0000 7f96c2a2a700 1 librados: starting objecter 2021-02-24T15:29:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.727+0000 7f96c2a2a700 1 Processor -- start 2021-02-24T15:29:49.736 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.727+0000 7f96c2a2a700 1 -- start start 2021-02-24T15:29:49.736 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.727+0000 7f96c2a2a700 1 librados: setting wanted keys 2021-02-24T15:29:49.736 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.727+0000 7f96c2a2a700 1 librados: calling monclient init 2021-02-24T15:29:49.740 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.728+0000 7f96c2a2a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc063010 con 0x7f96bc095bb0 2021-02-24T15:29:49.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.728+0000 7f96c2a2a700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0674d0 con 0x7f96bc068410 2021-02-24T15:29:49.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.728+0000 7f96c2a2a700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc134470 con 0x7f96bc0966a0 2021-02-24T15:29:49.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.728+0000 7f96c0fc7700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f96bc0966a0 0x7f96bc142170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37746/0 (socket says 172.21.15.152:37746) 2021-02-24T15:29:49.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.728+0000 7f96bb7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f96bc095bb0 0x7f96bc13a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49268/0 (socket says 172.21.15.152:49268) 2021-02-24T15:29:49.742 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.728+0000 7f96c0fc7700 1 -- 172.21.15.152:0/1283414617 learned_addr learned my addr 172.21.15.152:0/1283414617 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:49.742 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96c0fc7700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6790/0 conn(0x7f96bc0966a0 legacy=0x7f96bc142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96bb7fe700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6789/0 conn(0x7f96bc095bb0 legacy=0x7f96bc13a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 10 client.?.objecter ms_handle_connect 0x7f96bc0966a0 2021-02-24T15:29:49.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:49.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 10 client.?.objecter ms_handle_connect 0x7f96bc095bb0 2021-02-24T15:29:49.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:49.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 10 client.?.objecter ms_handle_connect 0x7f96bc068410 2021-02-24T15:29:49.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:49.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96bbfff700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.181:6789/0 conn(0x7f96bc068410 legacy=0x7f96bc133d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924417486 0 0) 0x7f96bc134470 con 0x7f96bc0966a0 2021-02-24T15:29:49.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f969c004bd0 con 0x7f96bc0966a0 2021-02-24T15:29:49.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066460466 0 0) 0x7f96bc063010 con 0x7f96bc095bb0 2021-02-24T15:29:49.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96bc134470 con 0x7f96bc095bb0 2021-02-24T15:29:49.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085699508 0 0) 0x7f96bc0674d0 con 0x7f96bc068410 2021-02-24T15:29:49.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96bc063010 con 0x7f96bc068410 2021-02-24T15:29:49.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 750236478 0 0) 0x7f96bc134470 con 0x7f96bc095bb0 2021-02-24T15:29:49.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f96bc0674d0 con 0x7f96bc095bb0 2021-02-24T15:29:49.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1609957182 0 0) 0x7f969c004bd0 con 0x7f96bc0966a0 2021-02-24T15:29:49.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f96bc134470 con 0x7f96bc0966a0 2021-02-24T15:29:49.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f96b0001b60 con 0x7f96bc095bb0 2021-02-24T15:29:49.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f96b4004a10 con 0x7f96bc0966a0 2021-02-24T15:29:49.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2728914246 0 0) 0x7f96bc063010 con 0x7f96bc068410 2021-02-24T15:29:49.747 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f969c004bd0 con 0x7f96bc068410 2021-02-24T15:29:49.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f96ac001c60 con 0x7f96bc068410 2021-02-24T15:29:49.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3021608062 0 0) 0x7f96bc134470 con 0x7f96bc0966a0 2021-02-24T15:29:49.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.181:6789/0 conn(0x7f96bc068410 legacy=0x7f96bc133d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.730+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6789/0 conn(0x7f96bc095bb0 legacy=0x7f96bc13a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.731+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc11b740 con 0x7f96bc0966a0 2021-02-24T15:29:49.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.731+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc13a830 con 0x7f96bc0966a0 2021-02-24T15:29:49.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.731+0000 7f96c2a2a700 10 client.84419.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.731+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc11a270 con 0x7f96bc0966a0 2021-02-24T15:29:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.731+0000 7f96c2a2a700 1 librados: init done 2021-02-24T15:29:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.731+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f96b4001bd0 con 0x7f96bc0966a0 2021-02-24T15:29:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.731+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f96b40054b0 con 0x7f96bc0966a0 2021-02-24T15:29:49.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.731+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f96b400dfb0 con 0x7f96bc0966a0 2021-02-24T15:29:49.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.732+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(547..547 src has 330..547) v4 ==== 5742+0+0 (unknown 317122179 0 0) 0x7f96b403b6f0 con 0x7f96bc0966a0 2021-02-24T15:29:49.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.732+0000 7f96a3fff700 10 client.84419.objecter ms_dispatch 0x7f96bc001510 osd_map(547..547 src has 330..547) v4 2021-02-24T15:29:49.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.732+0000 7f96a3fff700 3 client.84419.objecter handle_osd_map got epochs [547,547] > 0 2021-02-24T15:29:49.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.732+0000 7f96a3fff700 3 client.84419.objecter handle_osd_map decoding full epoch 547 2021-02-24T15:29:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.732+0000 7f96a3fff700 20 client.84419.objecter dump_active .. 0 homeless 2021-02-24T15:29:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.732+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f96bc11acd0 con 0x7f96bc1140b0 2021-02-24T15:29:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.734+0000 7f96bb7fe700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6789/0 conn(0x7f96bc1140b0 legacy=0x7f96bc114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.734+0000 7f96a3fff700 10 client.84419.objecter ms_handle_connect 0x7f96bc1140b0 2021-02-24T15:29:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.734+0000 7f96a3fff700 10 client.84419.objecter resend_mon_ops 2021-02-24T15:29:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.734+0000 7f96a3fff700 10 client.84419.objecter ms_handle_connect 0x7f969c0316c0 2021-02-24T15:29:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120171168 0 0) 0x7f96bc063af0 con 0x7f96bc1140b0 2021-02-24T15:29:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96bc134470 con 0x7f96bc1140b0 2021-02-24T15:29:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2898269600 0 0) 0x7f96bc134470 con 0x7f96bc1140b0 2021-02-24T15:29:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f96bc063af0 con 0x7f96bc1140b0 2021-02-24T15:29:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f96b0002450 con 0x7f96bc1140b0 2021-02-24T15:29:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 60108693 0 0) 0x7f96bc063af0 con 0x7f96bc1140b0 2021-02-24T15:29:49.755 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96bc058400 con 0x7f96bc1140b0 2021-02-24T15:29:49.755 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f96b00029a0 con 0x7f96bc1140b0 2021-02-24T15:29:49.755 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6789/0 conn(0x7f96bc1140b0 legacy=0x7f96bc114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.755 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.737+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6789/0 conn(0x7f96bc1140b0 legacy=0x7f96bc114490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.745+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f96bc11acd0 con 0x7f96bc027010 2021-02-24T15:29:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.747+0000 7f96bb7fe700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6789/0 conn(0x7f96bc027010 legacy=0x7f96bc1478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.747+0000 7f96a3fff700 10 client.84419.objecter ms_handle_connect 0x7f96bc027010 2021-02-24T15:29:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.747+0000 7f96a3fff700 10 client.84419.objecter resend_mon_ops 2021-02-24T15:29:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223782196 0 0) 0x7f96b0002c30 con 0x7f96bc027010 2021-02-24T15:29:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96bc063af0 con 0x7f96bc027010 2021-02-24T15:29:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 495472557 0 0) 0x7f96bc063af0 con 0x7f96bc027010 2021-02-24T15:29:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f96b0002c30 con 0x7f96bc027010 2021-02-24T15:29:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f96b0005770 con 0x7f96bc027010 2021-02-24T15:29:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3295474179 0 0) 0x7f96b0002c30 con 0x7f96bc027010 2021-02-24T15:29:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 --> v1:172.21.15.152:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f96bc097190 con 0x7f96bc027010 2021-02-24T15:29:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 <== mon.0 v1:172.21.15.152:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4112 (unknown 0 0 2810634830) 0x7f96b0007990 con 0x7f96bc027010 2021-02-24T15:29:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6789/0 conn(0x7f96bc027010 legacy=0x7f96bc1478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.761 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96a3fff700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6789/0 conn(0x7f96bc027010 legacy=0x7f96bc1478b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:49.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c2a2a700 10 librados: watch_flush enter 2021-02-24T15:29:49.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c2a2a700 10 librados: watch_flush exit 2021-02-24T15:29:49.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c2a2a700 20 client.84419.objecter shutdown clearing up homeless session... 2021-02-24T15:29:49.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c2a2a700 10 client.84419.objecter successfully canceled tick 2021-02-24T15:29:49.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.181:6812/33484 conn(0x7f969c0316c0 legacy=0x7f969c033b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 >> v1:172.21.15.152:6790/0 conn(0x7f96bc0966a0 legacy=0x7f96bc142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c0fc7700 1 -- 172.21.15.152:0/1283414617 reap_dead start 2021-02-24T15:29:49.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c0fc7700 1 -- 172.21.15.152:0/1283414617 reap_dead start 2021-02-24T15:29:49.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 shutdown_connections 2021-02-24T15:29:49.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.748+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 >> 172.21.15.152:0/1283414617 conn(0x7f96bc09ba40 msgr2=0x7f96bc09a140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:49.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.749+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 shutdown_connections 2021-02-24T15:29:49.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.749+0000 7f96c2a2a700 1 -- 172.21.15.152:0/1283414617 wait complete. 2021-02-24T15:29:49.765 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.749+0000 7f96c2a2a700 1 librados: shutdown 2021-02-24T15:29:49.765 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:29:49.765 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:29:49.766 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:29:49.766 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:29:49.766 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 66, 2021-02-24T15:29:49.766 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:29:49.766 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:29:49.767 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:29:49.767 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:29:49.767 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.767 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 2, 2021-02-24T15:29:49.767 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:49.768 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:29:49.768 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:29:49.768 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:49.768 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:49.768 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:49.769 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:49.769 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:49.769 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:49.769 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:49.769 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:49.770 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:49.770 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.770 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:29:49.770 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:29:49.770 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:49.771 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:49.771 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:49.771 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:49.771 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:49.772 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:49.772 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:49.772 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:49.772 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:49.773 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.773 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:29:49.773 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:29:49.773 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:29:49.774 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:29:49.774 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:29:49.775 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:29:49.775 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:49.775 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:49.775 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:29:49.775 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:29:49.776 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:29:49.776 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:29:49.776 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:29:49.776 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:49.776 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:29:49.777 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:49.777 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:49.777 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:49.777 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:49.777 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:49.778 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:49.778 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:49.778 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:49.778 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:49.778 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.779 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:29:49.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.779 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:29:49.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.779 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:29:49.780 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:29:49.780 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:49.780 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:49.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.780 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:49.781 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:29:49.781 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:49.781 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.781 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.782 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:29:49.782 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:29:49.782 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:49.782 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:49.783 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:49.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.783 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:29:49.783 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:29:49.784 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:49.784 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:49.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.785 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:49.785 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:29:49.785 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:49.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.786 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.786 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:29:49.786 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:29:49.787 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:49.787 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:49.787 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:49.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.788 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:29:49.788 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:29:49.788 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:49.788 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:49.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.789 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:49.789 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:29:49.790 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:49.791 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.791 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.791 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:29:49.792 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:29:49.792 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:49.792 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:49.792 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:49.792 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.793 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.798 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:29:49.798 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:29:49.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.799 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:49.799 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:49.799 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:49.799 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.800 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.800 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:29:49.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.800 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:49.801 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:49.801 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:29:49.801 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.801 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.801 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:29:49.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.802 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:49.802 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:49.802 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:29:49.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.803 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.803 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:29:49.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.803 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:49.803 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:49.804 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:49.804 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.804 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.804 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:29:49.805 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:29:49.806 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:29:49.932 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.932+0000 7f4ef60f2700 1 Processor -- start 2021-02-24T15:29:49.933 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.932+0000 7f4ef60f2700 1 -- start start 2021-02-24T15:29:49.934 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.933+0000 7f4ef60f2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef0062660 con 0x7f4ef0068410 2021-02-24T15:29:49.934 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.933+0000 7f4ef60f2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef0063af0 con 0x7f4ef00966a0 2021-02-24T15:29:49.934 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.933+0000 7f4ef60f2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef0063d90 con 0x7f4ef0095bb0 2021-02-24T15:29:49.934 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.933+0000 7f4eeffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4ef0068410 0x7f4ef0133990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49280/0 (socket says 172.21.15.152:49280) 2021-02-24T15:29:49.935 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.933+0000 7f4eeeffd700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f4ef0095bb0 0x7f4ef0130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37758/0 (socket says 172.21.15.152:37758) 2021-02-24T15:29:49.935 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.933+0000 7f4eeffff700 1 -- 172.21.15.152:0/2259448033 learned_addr learned my addr 172.21.15.152:0/2259448033 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:49.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.935+0000 7f4eeffff700 1 -- 172.21.15.152:0/2259448033 >> v1:172.21.15.152:6789/0 conn(0x7f4ef0068410 legacy=0x7f4ef0133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.935+0000 7f4eeeffd700 1 -- 172.21.15.152:0/2259448033 >> v1:172.21.15.152:6790/0 conn(0x7f4ef0095bb0 legacy=0x7f4ef0130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.935+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460497190 0 0) 0x7f4ef0062660 con 0x7f4ef0068410 2021-02-24T15:29:49.937 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.935+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4edc003230 con 0x7f4ef0068410 2021-02-24T15:29:49.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.935+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310016983 0 0) 0x7f4ef0063d90 con 0x7f4ef0095bb0 2021-02-24T15:29:49.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef0062660 con 0x7f4ef0095bb0 2021-02-24T15:29:49.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4eef7fe700 1 -- 172.21.15.152:0/2259448033 >> v1:172.21.15.181:6789/0 conn(0x7f4ef00966a0 legacy=0x7f4ef0096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3605300433 0 0) 0x7f4ef0062660 con 0x7f4ef0095bb0 2021-02-24T15:29:49.938 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 >> v1:172.21.15.181:6789/0 conn(0x7f4ef00966a0 legacy=0x7f4ef0096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 >> v1:172.21.15.152:6789/0 conn(0x7f4ef0068410 legacy=0x7f4ef0133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0064030 con 0x7f4ef0095bb0 2021-02-24T15:29:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4ee40019f0 con 0x7f4ef0095bb0 2021-02-24T15:29:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4ee4001c50 con 0x7f4ef0095bb0 2021-02-24T15:29:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4eee7fc700 1 -- 172.21.15.152:0/2259448033 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4ee4004690 con 0x7f4ef0095bb0 2021-02-24T15:29:49.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4ef60f2700 1 -- 172.21.15.152:0/2259448033 >> v1:172.21.15.152:6790/0 conn(0x7f4ef0095bb0 legacy=0x7f4ef0130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4ef60f2700 1 -- 172.21.15.152:0/2259448033 shutdown_connections 2021-02-24T15:29:49.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4ef60f2700 1 -- 172.21.15.152:0/2259448033 >> 172.21.15.152:0/2259448033 conn(0x7f4ef009ba40 msgr2=0x7f4ef009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:49.940 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4ef60f2700 1 -- 172.21.15.152:0/2259448033 shutdown_connections 2021-02-24T15:29:49.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.936+0000 7f4ef60f2700 1 -- 172.21.15.152:0/2259448033 wait complete. 2021-02-24T15:29:49.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.937+0000 7f4ef60f2700 1 librados: starting msgr at 2021-02-24T15:29:49.941 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.937+0000 7f4ef60f2700 1 librados: starting objecter 2021-02-24T15:29:49.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.937+0000 7f4ef60f2700 1 Processor -- start 2021-02-24T15:29:49.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.937+0000 7f4ef60f2700 1 -- start start 2021-02-24T15:29:49.946 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.937+0000 7f4ef60f2700 1 librados: setting wanted keys 2021-02-24T15:29:49.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.937+0000 7f4ef60f2700 1 librados: calling monclient init 2021-02-24T15:29:49.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.938+0000 7f4ef60f2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef0063010 con 0x7f4ef0068410 2021-02-24T15:29:49.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.938+0000 7f4ef60f2700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef011ad60 con 0x7f4ef0095bb0 2021-02-24T15:29:49.947 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.938+0000 7f4ef60f2700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef00674d0 con 0x7f4ef00966a0 2021-02-24T15:29:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.938+0000 7f4eef7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4ef0068410 0x7f4ef013a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49284/0 (socket says 172.21.15.152:49284) 2021-02-24T15:29:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.938+0000 7f4eef7fe700 1 -- 172.21.15.152:0/862957397 learned_addr learned my addr 172.21.15.152:0/862957397 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4eef7fe700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6789/0 conn(0x7f4ef0068410 legacy=0x7f4ef013a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 10 client.?.objecter ms_handle_connect 0x7f4ef0068410 2021-02-24T15:29:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4eeffff700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6790/0 conn(0x7f4ef00966a0 legacy=0x7f4ef0142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 10 client.?.objecter ms_handle_connect 0x7f4ef00966a0 2021-02-24T15:29:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906601815 0 0) 0x7f4ef0063010 con 0x7f4ef0068410 2021-02-24T15:29:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed0004bd0 con 0x7f4ef0068410 2021-02-24T15:29:49.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4eeeffd700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.181:6789/0 conn(0x7f4ef0095bb0 legacy=0x7f4ef0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 10 client.?.objecter ms_handle_connect 0x7f4ef0095bb0 2021-02-24T15:29:49.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:49.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278596973 0 0) 0x7f4ef00674d0 con 0x7f4ef00966a0 2021-02-24T15:29:49.950 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef0063010 con 0x7f4ef00966a0 2021-02-24T15:29:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.940+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2611995651 0 0) 0x7f4ed0004bd0 con 0x7f4ef0068410 2021-02-24T15:29:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ef00674d0 con 0x7f4ef0068410 2021-02-24T15:29:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4ee0001bc0 con 0x7f4ef0068410 2021-02-24T15:29:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603166783 0 0) 0x7f4ef011ad60 con 0x7f4ef0095bb0 2021-02-24T15:29:49.951 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed0004bd0 con 0x7f4ef0095bb0 2021-02-24T15:29:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 305489276 0 0) 0x7f4ef0063010 con 0x7f4ef00966a0 2021-02-24T15:29:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ef011ad60 con 0x7f4ef00966a0 2021-02-24T15:29:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4ee8002060 con 0x7f4ef00966a0 2021-02-24T15:29:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.0 v1:172.21.15.152:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4008007329 0 0) 0x7f4ef00674d0 con 0x7f4ef0068410 2021-02-24T15:29:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6790/0 conn(0x7f4ef00966a0 legacy=0x7f4ef0142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.181:6789/0 conn(0x7f4ef0095bb0 legacy=0x7f4ef0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0134560 con 0x7f4ef0068410 2021-02-24T15:29:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef011a360 con 0x7f4ef0068410 2021-02-24T15:29:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ef60f2700 10 client.28500.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:49.953 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef0118d20 con 0x7f4ef0068410 2021-02-24T15:29:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ef60f2700 1 librados: init done 2021-02-24T15:29:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.0 v1:172.21.15.152:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4ee00022f0 con 0x7f4ef0068410 2021-02-24T15:29:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.941+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.0 v1:172.21.15.152:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4ee0002600 con 0x7f4ef0068410 2021-02-24T15:29:49.954 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.942+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.0 v1:172.21.15.152:6789/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f4ee00027e0 con 0x7f4ef0068410 2021-02-24T15:29:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.942+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4ec8006550 con 0x7f4ec80027f0 2021-02-24T15:29:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.942+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.0 v1:172.21.15.152:6789/0 8 ==== osd_map(547..547 src has 330..547) v4 ==== 5742+0+0 (unknown 317122179 0 0) 0x7f4ee003b1f0 con 0x7f4ef0068410 2021-02-24T15:29:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.942+0000 7f4ed77fe700 10 client.28500.objecter ms_dispatch 0x7f4ef0001510 osd_map(547..547 src has 330..547) v4 2021-02-24T15:29:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.942+0000 7f4ed77fe700 3 client.28500.objecter handle_osd_map got epochs [547,547] > 0 2021-02-24T15:29:49.955 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.942+0000 7f4ed77fe700 3 client.28500.objecter handle_osd_map decoding full epoch 547 2021-02-24T15:29:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.942+0000 7f4ed77fe700 20 client.28500.objecter dump_active .. 0 homeless 2021-02-24T15:29:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.944+0000 7f4eeeffd700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6790/0 conn(0x7f4ec80027f0 legacy=0x7f4ec8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.944+0000 7f4ed77fe700 10 client.28500.objecter ms_handle_connect 0x7f4ec80027f0 2021-02-24T15:29:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.944+0000 7f4ed77fe700 10 client.28500.objecter resend_mon_ops 2021-02-24T15:29:49.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.944+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937706534 0 0) 0x7f4ec8006550 con 0x7f4ec80027f0 2021-02-24T15:29:49.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.944+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef00674d0 con 0x7f4ec80027f0 2021-02-24T15:29:49.957 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.944+0000 7f4ed77fe700 10 client.28500.objecter ms_handle_connect 0x7f4ed0031670 2021-02-24T15:29:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.944+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2184799537 0 0) 0x7f4ef00674d0 con 0x7f4ec80027f0 2021-02-24T15:29:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.944+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ec8006550 con 0x7f4ec80027f0 2021-02-24T15:29:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.944+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4ee40012e0 con 0x7f4ec80027f0 2021-02-24T15:29:49.958 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.945+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 404734121 0 0) 0x7f4ec8006550 con 0x7f4ec80027f0 2021-02-24T15:29:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.945+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ec8009df0 con 0x7f4ec80027f0 2021-02-24T15:29:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.945+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f4ee4001960 con 0x7f4ec80027f0 2021-02-24T15:29:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.945+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6790/0 conn(0x7f4ec80027f0 legacy=0x7f4ec8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.959 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.945+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6790/0 conn(0x7f4ec80027f0 legacy=0x7f4ec8004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:49.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.953+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f4ec8007520 con 0x7f4ec80068c0 2021-02-24T15:29:49.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.955+0000 7f4eeeffd700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6790/0 conn(0x7f4ec80068c0 legacy=0x7f4ec8006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:49.962 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.955+0000 7f4ed77fe700 10 client.28500.objecter ms_handle_connect 0x7f4ec80068c0 2021-02-24T15:29:49.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.955+0000 7f4ed77fe700 10 client.28500.objecter resend_mon_ops 2021-02-24T15:29:49.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.955+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461803711 0 0) 0x7f4ec8007520 con 0x7f4ec80068c0 2021-02-24T15:29:49.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.955+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec8006550 con 0x7f4ec80068c0 2021-02-24T15:29:49.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.956+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 869132447 0 0) 0x7f4ec8006550 con 0x7f4ec80068c0 2021-02-24T15:29:49.963 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.956+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ec8007520 con 0x7f4ec80068c0 2021-02-24T15:29:49.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.956+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f4ee4004f20 con 0x7f4ec80068c0 2021-02-24T15:29:49.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.956+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 354367980 0 0) 0x7f4ec8007520 con 0x7f4ec80068c0 2021-02-24T15:29:49.964 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.956+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4ec8008720 con 0x7f4ec80068c0 2021-02-24T15:29:49.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.956+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3940 (unknown 0 0 1378395262) 0x7f4ee4007270 con 0x7f4ec80068c0 2021-02-24T15:29:49.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.956+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6790/0 conn(0x7f4ec80068c0 legacy=0x7f4ec8006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.956+0000 7f4ed77fe700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6790/0 conn(0x7f4ec80068c0 legacy=0x7f4ec8006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:49.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 10 librados: watch_flush enter 2021-02-24T15:29:49.965 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 10 librados: watch_flush exit 2021-02-24T15:29:49.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 20 client.28500.objecter shutdown clearing up homeless session... 2021-02-24T15:29:49.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 10 client.28500.objecter successfully canceled tick 2021-02-24T15:29:49.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.181:6812/33484 conn(0x7f4ed0031670 legacy=0x7f4ed0033b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 >> v1:172.21.15.152:6789/0 conn(0x7f4ef0068410 legacy=0x7f4ef013a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:49.966 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4eeffff700 1 -- 172.21.15.152:0/862957397 reap_dead start 2021-02-24T15:29:49.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4eeffff700 1 -- 172.21.15.152:0/862957397 reap_dead start 2021-02-24T15:29:49.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 shutdown_connections 2021-02-24T15:29:49.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 >> 172.21.15.152:0/862957397 conn(0x7f4ef009ba40 msgr2=0x7f4ef01120a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:49.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 shutdown_connections 2021-02-24T15:29:49.967 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 1 -- 172.21.15.152:0/862957397 wait complete. 2021-02-24T15:29:49.968 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:49.957+0000 7f4ef60f2700 1 librados: shutdown 2021-02-24T15:29:49.968 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:29:49.968 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:29:49.968 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:29:49.969 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:29:49.969 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 66, 2021-02-24T15:29:49.969 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:29:49.969 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:29:49.969 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:29:49.970 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:29:49.970 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.970 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:29:49.970 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:49.970 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:29:49.971 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:29:49.971 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:49.971 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:49.971 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:49.971 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:49.972 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:49.972 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:49.972 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:49.972 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:49.973 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:49.973 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.973 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:29:49.973 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:29:49.973 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:49.974 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:49.974 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:49.974 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:49.974 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:49.975 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:49.975 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:49.975 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:49.975 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:49.976 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.976 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:29:49.976 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:29:49.976 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:29:49.977 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:29:49.977 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:29:49.977 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:29:49.977 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:49.977 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:49.978 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:29:49.978 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:29:49.978 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:29:49.978 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:29:49.979 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:29:49.979 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:49.979 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:29:49.979 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:49.979 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:49.980 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:49.980 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:49.980 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:49.980 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:49.980 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:49.981 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:49.981 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:49.981 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.981 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:29:49.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.982 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:29:49.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.982 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:29:49.982 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:29:49.982 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:49.983 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:49.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.983 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:49.983 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:29:49.983 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:49.984 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.984 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.984 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:29:49.984 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:29:49.985 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:49.985 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:49.985 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:49.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.986 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:29:49.986 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:29:49.986 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:49.986 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:49.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.987 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:49.987 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:29:49.987 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:49.987 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.987 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.988 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:29:49.988 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:29:49.988 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:49.988 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:49.989 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:49.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.989 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:29:49.990 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:29:49.990 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:49.990 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:49.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.991 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:49.991 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:29:49.991 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:49.992 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.992 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.992 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:29:49.992 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:29:49.993 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:49.993 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:49.993 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:49.993 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.993 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.994 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:29:49.994 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:29:49.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.994 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:49.995 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:49.995 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:49.995 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.995 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.996 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:29:49.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.996 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:49.996 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:49.996 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:29:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:49.998 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:49.998 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:49.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:49.998 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:49.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:49.999 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:29:49.999 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:29:50.000 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:29:50.120 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.120+0000 7f92454de700 1 Processor -- start 2021-02-24T15:29:50.121 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.120+0000 7f92454de700 1 -- start start 2021-02-24T15:29:50.121 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.121+0000 7f92454de700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9240096c70 con 0x7f924012e2b0 2021-02-24T15:29:50.122 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.121+0000 7f92454de700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9240064fe0 con 0x7f9240127800 2021-02-24T15:29:50.122 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.121+0000 7f92454de700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9240065a80 con 0x7f9240128200 2021-02-24T15:29:50.122 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.121+0000 7f923e7fc700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f9240128200 0x7f924012cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37772/0 (socket says 172.21.15.152:37772) 2021-02-24T15:29:50.122 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.121+0000 7f923e7fc700 1 -- 172.21.15.152:0/4210618771 learned_addr learned my addr 172.21.15.152:0/4210618771 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:50.124 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.123+0000 7f923f7fe700 1 -- 172.21.15.152:0/4210618771 >> v1:172.21.15.152:6789/0 conn(0x7f924012e2b0 legacy=0x7f92401306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.124 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.123+0000 7f923e7fc700 1 -- 172.21.15.152:0/4210618771 >> v1:172.21.15.152:6790/0 conn(0x7f9240128200 legacy=0x7f924012cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.124 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.123+0000 7f923effd700 1 -- 172.21.15.152:0/4210618771 >> v1:172.21.15.181:6789/0 conn(0x7f9240127800 legacy=0x7f9240067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.123+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85312076 0 0) 0x7f9240096c70 con 0x7f924012e2b0 2021-02-24T15:29:50.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.123+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f922c003230 con 0x7f924012e2b0 2021-02-24T15:29:50.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109433450 0 0) 0x7f9240064fe0 con 0x7f9240127800 2021-02-24T15:29:50.125 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9240096c70 con 0x7f9240127800 2021-02-24T15:29:50.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701059682 0 0) 0x7f9240065a80 con 0x7f9240128200 2021-02-24T15:29:50.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9240064fe0 con 0x7f9240128200 2021-02-24T15:29:50.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1156882791 0 0) 0x7f922c003230 con 0x7f924012e2b0 2021-02-24T15:29:50.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 >> v1:172.21.15.152:6790/0 conn(0x7f9240128200 legacy=0x7f924012cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.126 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 >> v1:172.21.15.181:6789/0 conn(0x7f9240127800 legacy=0x7f9240067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400645c0 con 0x7f924012e2b0 2021-02-24T15:29:50.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9238001d00 con 0x7f924012e2b0 2021-02-24T15:29:50.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 <== mon.0 v1:172.21.15.152:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9238002010 con 0x7f924012e2b0 2021-02-24T15:29:50.127 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.124+0000 7f923dffb700 1 -- 172.21.15.152:0/4210618771 <== mon.0 v1:172.21.15.152:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f92380023e0 con 0x7f924012e2b0 2021-02-24T15:29:50.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.125+0000 7f92454de700 1 -- 172.21.15.152:0/4210618771 >> v1:172.21.15.152:6789/0 conn(0x7f924012e2b0 legacy=0x7f92401306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.125+0000 7f92454de700 1 -- 172.21.15.152:0/4210618771 shutdown_connections 2021-02-24T15:29:50.132 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.125+0000 7f92454de700 1 -- 172.21.15.152:0/4210618771 >> 172.21.15.152:0/4210618771 conn(0x7f924009aa30 msgr2=0x7f924009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:50.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.125+0000 7f92454de700 1 -- 172.21.15.152:0/4210618771 shutdown_connections 2021-02-24T15:29:50.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.125+0000 7f92454de700 1 -- 172.21.15.152:0/4210618771 wait complete. 2021-02-24T15:29:50.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.126+0000 7f92454de700 1 librados: starting msgr at 2021-02-24T15:29:50.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.126+0000 7f92454de700 1 librados: starting objecter 2021-02-24T15:29:50.133 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.126+0000 7f92454de700 1 Processor -- start 2021-02-24T15:29:50.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.126+0000 7f92454de700 1 -- start start 2021-02-24T15:29:50.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.126+0000 7f92454de700 1 librados: setting wanted keys 2021-02-24T15:29:50.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.126+0000 7f92454de700 1 librados: calling monclient init 2021-02-24T15:29:50.134 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.127+0000 7f92454de700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9240064890 con 0x7f9240128200 2021-02-24T15:29:50.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.127+0000 7f92454de700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924012dd10 con 0x7f924012e2b0 2021-02-24T15:29:50.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.127+0000 7f92454de700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924012a0a0 con 0x7f9240127800 2021-02-24T15:29:50.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.127+0000 7f923e7fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9240128200 0x7f924013b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:49304/0 (socket says 172.21.15.152:49304) 2021-02-24T15:29:50.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.127+0000 7f923e7fc700 1 -- 172.21.15.152:0/1745201064 learned_addr learned my addr 172.21.15.152:0/1745201064 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:50.135 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f923e7fc700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.152:6789/0 conn(0x7f9240128200 legacy=0x7f924013b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f923effd700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.152:6790/0 conn(0x7f9240127800 legacy=0x7f924012d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 10 client.?.objecter ms_handle_connect 0x7f9240128200 2021-02-24T15:29:50.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:50.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 10 client.?.objecter ms_handle_connect 0x7f9240127800 2021-02-24T15:29:50.136 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:50.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 10 client.?.objecter ms_handle_connect 0x7f924012e2b0 2021-02-24T15:29:50.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:50.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f923f7fe700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.181:6789/0 conn(0x7f924012e2b0 legacy=0x7f924013e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90642758 0 0) 0x7f924012a0a0 con 0x7f9240127800 2021-02-24T15:29:50.137 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9220004bd0 con 0x7f9240127800 2021-02-24T15:29:50.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607565857 0 0) 0x7f9240064890 con 0x7f9240128200 2021-02-24T15:29:50.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f924012a0a0 con 0x7f9240128200 2021-02-24T15:29:50.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417070626 0 0) 0x7f924012dd10 con 0x7f924012e2b0 2021-02-24T15:29:50.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.129+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9240064890 con 0x7f924012e2b0 2021-02-24T15:29:50.138 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2819296357 0 0) 0x7f9220004bd0 con 0x7f9240127800 2021-02-24T15:29:50.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f924012dd10 con 0x7f9240127800 2021-02-24T15:29:50.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 959322045 0 0) 0x7f924012a0a0 con 0x7f9240128200 2021-02-24T15:29:50.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.152:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9220004bd0 con 0x7f9240128200 2021-02-24T15:29:50.139 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9230001b80 con 0x7f9240127800 2021-02-24T15:29:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9234001bd0 con 0x7f9240128200 2021-02-24T15:29:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2129470324 0 0) 0x7f9240064890 con 0x7f924012e2b0 2021-02-24T15:29:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f924012a0a0 con 0x7f924012e2b0 2021-02-24T15:29:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9238001cc0 con 0x7f924012e2b0 2021-02-24T15:29:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4160332523 0 0) 0x7f924012dd10 con 0x7f9240127800 2021-02-24T15:29:50.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.181:6789/0 conn(0x7f924012e2b0 legacy=0x7f924013e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.152:6789/0 conn(0x7f9240128200 legacy=0x7f924013b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924012d730 con 0x7f9240127800 2021-02-24T15:29:50.141 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92401295b0 con 0x7f9240127800 2021-02-24T15:29:50.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f92454de700 10 client.84437.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:50.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9240132970 con 0x7f9240127800 2021-02-24T15:29:50.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f92454de700 1 librados: init done 2021-02-24T15:29:50.142 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f92300021f0 con 0x7f9240127800 2021-02-24T15:29:50.143 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.130+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9230002500 con 0x7f9240127800 2021-02-24T15:29:50.143 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.131+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f9218006550 con 0x7f92180027f0 2021-02-24T15:29:50.143 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.131+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f9230002660 con 0x7f9240127800 2021-02-24T15:29:50.143 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.131+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(548..548 src has 330..548) v4 ==== 5742+0+0 (unknown 913019496 0 0) 0x7f923003b1d0 con 0x7f9240127800 2021-02-24T15:29:50.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.131+0000 7f9226ffd700 10 client.84437.objecter ms_dispatch 0x7f9240001510 osd_map(548..548 src has 330..548) v4 2021-02-24T15:29:50.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.131+0000 7f9226ffd700 3 client.84437.objecter handle_osd_map got epochs [548,548] > 0 2021-02-24T15:29:50.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.131+0000 7f9226ffd700 3 client.84437.objecter handle_osd_map decoding full epoch 548 2021-02-24T15:29:50.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.131+0000 7f9226ffd700 20 client.84437.objecter dump_active .. 0 homeless 2021-02-24T15:29:50.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.133+0000 7f9226ffd700 10 client.84437.objecter ms_handle_connect 0x7f92180027f0 2021-02-24T15:29:50.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.133+0000 7f923e7fc700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.181:6789/0 conn(0x7f92180027f0 legacy=0x7f9218004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.148 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.133+0000 7f9226ffd700 10 client.84437.objecter resend_mon_ops 2021-02-24T15:29:50.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.133+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731409131 0 0) 0x7f9218006550 con 0x7f92180027f0 2021-02-24T15:29:50.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.133+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f924012dd10 con 0x7f92180027f0 2021-02-24T15:29:50.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.133+0000 7f9226ffd700 10 client.84437.objecter ms_handle_connect 0x7f9220031860 2021-02-24T15:29:50.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.134+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 64192174 0 0) 0x7f924012dd10 con 0x7f92180027f0 2021-02-24T15:29:50.149 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.134+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9218006550 con 0x7f92180027f0 2021-02-24T15:29:50.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.134+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f9234004930 con 0x7f92180027f0 2021-02-24T15:29:50.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.134+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 2734262286 0 0) 0x7f9218006550 con 0x7f92180027f0 2021-02-24T15:29:50.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.134+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9218009df0 con 0x7f92180027f0 2021-02-24T15:29:50.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.134+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f9234004b90 con 0x7f92180027f0 2021-02-24T15:29:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.134+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.181:6789/0 conn(0x7f92180027f0 legacy=0x7f9218004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.134+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.181:6789/0 conn(0x7f92180027f0 legacy=0x7f9218004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.142+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f9218007500 con 0x7f92180068a0 2021-02-24T15:29:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.144+0000 7f923e7fc700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.181:6789/0 conn(0x7f92180068a0 legacy=0x7f9218006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.145+0000 7f9226ffd700 10 client.84437.objecter ms_handle_connect 0x7f92180068a0 2021-02-24T15:29:50.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.145+0000 7f9226ffd700 10 client.84437.objecter resend_mon_ops 2021-02-24T15:29:50.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.145+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077819402 0 0) 0x7f9218007500 con 0x7f92180068a0 2021-02-24T15:29:50.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.145+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9218006550 con 0x7f92180068a0 2021-02-24T15:29:50.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.145+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 4145532900 0 0) 0x7f9218006550 con 0x7f92180068a0 2021-02-24T15:29:50.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.145+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9218007500 con 0x7f92180068a0 2021-02-24T15:29:50.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.145+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f92340052a0 con 0x7f92180068a0 2021-02-24T15:29:50.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.145+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1582345940 0 0) 0x7f9218007500 con 0x7f92180068a0 2021-02-24T15:29:50.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.145+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9218008720 con 0x7f92180068a0 2021-02-24T15:29:50.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3770 (unknown 0 0 983449952) 0x7f9234006ed0 con 0x7f92180068a0 2021-02-24T15:29:50.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.181:6789/0 conn(0x7f92180068a0 legacy=0x7f9218006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f9226ffd700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.181:6789/0 conn(0x7f92180068a0 legacy=0x7f9218006d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:29:50.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 10 librados: watch_flush enter 2021-02-24T15:29:50.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 10 librados: watch_flush exit 2021-02-24T15:29:50.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 20 client.84437.objecter shutdown clearing up homeless session... 2021-02-24T15:29:50.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 10 client.84437.objecter successfully canceled tick 2021-02-24T15:29:50.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.181:6812/33484 conn(0x7f9220031860 legacy=0x7f9220033d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 >> v1:172.21.15.152:6790/0 conn(0x7f9240127800 legacy=0x7f924012d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f923f7fe700 1 -- 172.21.15.152:0/1745201064 reap_dead start 2021-02-24T15:29:50.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f923f7fe700 1 -- 172.21.15.152:0/1745201064 reap_dead start 2021-02-24T15:29:50.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 shutdown_connections 2021-02-24T15:29:50.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 >> 172.21.15.152:0/1745201064 conn(0x7f924009aa30 msgr2=0x7f92400676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:50.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 shutdown_connections 2021-02-24T15:29:50.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 1 -- 172.21.15.152:0/1745201064 wait complete. 2021-02-24T15:29:50.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.146+0000 7f92454de700 1 librados: shutdown 2021-02-24T15:29:50.157 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:29:50.157 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:29:50.157 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:29:50.158 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:29:50.158 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 66, 2021-02-24T15:29:50.158 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:29:50.158 INFO:teuthology.orchestra.run.smithi152.stdout: 0, 2021-02-24T15:29:50.158 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:29:50.159 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:29:50.159 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:50.159 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 3, 2021-02-24T15:29:50.159 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:50.159 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:29:50.160 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:29:50.160 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:50.160 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:50.160 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:50.160 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:50.161 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:50.161 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:50.161 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:50.161 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:50.161 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:50.162 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:50.162 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:29:50.162 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:29:50.162 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:50.162 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:50.163 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:50.163 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:50.163 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:50.163 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:50.164 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:50.164 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:50.164 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:50.164 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:50.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:50.165 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:29:50.165 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:29:50.165 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:29:50.165 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:29:50.165 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:29:50.166 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:29:50.166 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:50.166 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:29:50.166 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:29:50.166 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:29:50.167 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:29:50.167 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:29:50.167 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:29:50.168 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:29:50.168 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:29:50.169 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:29:50.169 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:29:50.169 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:29:50.171 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:29:50.171 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:29:50.171 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:29:50.171 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:29:50.172 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:29:50.172 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:29:50.173 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:50.173 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:29:50.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:50.174 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:29:50.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:50.174 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:29:50.174 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:29:50.175 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:50.175 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:50.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:50.175 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:50.175 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:29:50.176 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:50.176 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:50.176 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:50.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:50.176 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:29:50.177 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:29:50.177 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:50.178 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:50.178 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:50.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:50.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:50.179 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:29:50.180 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:29:50.180 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:50.180 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:50.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:50.181 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:50.181 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:29:50.181 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:50.181 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:50.181 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:50.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:50.182 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:29:50.182 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:29:50.182 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:50.183 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:50.183 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:50.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:50.183 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:50.183 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:29:50.184 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:29:50.184 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:29:50.184 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:29:50.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:50.184 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:29:50.185 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:29:50.185 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:29:50.185 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:50.185 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:50.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:50.186 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:29:50.186 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:29:50.186 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:29:50.186 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:29:50.187 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:29:50.187 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:50.187 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:50.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:50.188 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:29:50.188 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:29:50.188 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:50.188 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:50.188 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:50.189 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:50.189 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:50.189 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:29:50.189 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:29:50.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:29:50.190 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:29:50.190 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:29:50.190 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:29:50.190 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:29:50.190 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:29:50.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:29:50.191 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:29:50.191 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:29:50.192 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2021-02-24T15:29:50.193 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2021-02-24T15:29:50.193 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2021-02-24T15:29:50.193 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2021-02-24T15:29:50.194 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-02-24T15:29:50.194 INFO:teuthology.orchestra.run:waiting for 300 2021-02-24T15:29:50.212 INFO:tasks.ceph.mon.a:Stopped 2021-02-24T15:29:50.218 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2021-02-24T15:29:50.219 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:29:50.369 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.368+0000 7ff41a74f700 1 Processor -- start 2021-02-24T15:29:50.369 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.368+0000 7ff41a74f700 1 -- start start 2021-02-24T15:29:50.370 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.369+0000 7ff41a74f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff414097d40 con 0x7ff414063220 2021-02-24T15:29:50.370 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.369+0000 7ff41a74f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff414063d00 con 0x7ff414099340 2021-02-24T15:29:50.371 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.369+0000 7ff41a74f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff414097980 con 0x7ff414062da0 2021-02-24T15:29:50.371 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.369+0000 7ff418cec700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7ff414063220 legacy=0x7ff414133440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:29:50.371 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.369+0000 7ff4137fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff414062da0 0x7ff41412fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37808/0 (socket says 172.21.15.152:37808) 2021-02-24T15:29:50.372 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.369+0000 7ff4137fe700 1 -- 172.21.15.152:0/3833473834 learned_addr learned my addr 172.21.15.152:0/3833473834 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:50.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.371+0000 7ff4137fe700 1 -- 172.21.15.152:0/3833473834 >> v1:172.21.15.152:6790/0 conn(0x7ff414062da0 legacy=0x7ff41412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.371+0000 7ff413fff700 1 -- 172.21.15.152:0/3833473834 >> v1:172.21.15.181:6789/0 conn(0x7ff414099340 legacy=0x7ff414097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.379 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.371+0000 7ff412ffd700 1 -- 172.21.15.152:0/3833473834 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919961639 0 0) 0x7ff414097980 con 0x7ff414062da0 2021-02-24T15:29:50.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.371+0000 7ff412ffd700 1 -- 172.21.15.152:0/3833473834 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff400003230 con 0x7ff414062da0 2021-02-24T15:29:50.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff412ffd700 1 -- 172.21.15.152:0/3833473834 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3431478547 0 0) 0x7ff400003230 con 0x7ff414062da0 2021-02-24T15:29:50.380 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff412ffd700 1 -- 172.21.15.152:0/3833473834 >> v1:172.21.15.181:6789/0 conn(0x7ff414099340 legacy=0x7ff414097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff412ffd700 1 -- 172.21.15.152:0/3833473834 >> v1:172.21.15.152:6789/0 conn(0x7ff414063220 legacy=0x7ff414133440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:29:50.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff412ffd700 1 -- 172.21.15.152:0/3833473834 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41408fac0 con 0x7ff414062da0 2021-02-24T15:29:50.381 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff412ffd700 1 -- 172.21.15.152:0/3833473834 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff408001930 con 0x7ff414062da0 2021-02-24T15:29:50.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff412ffd700 1 -- 172.21.15.152:0/3833473834 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff408001c40 con 0x7ff414062da0 2021-02-24T15:29:50.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff412ffd700 1 -- 172.21.15.152:0/3833473834 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff408004750 con 0x7ff414062da0 2021-02-24T15:29:50.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff41a74f700 1 -- 172.21.15.152:0/3833473834 >> v1:172.21.15.152:6790/0 conn(0x7ff414062da0 legacy=0x7ff41412fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.382 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff41a74f700 1 -- 172.21.15.152:0/3833473834 shutdown_connections 2021-02-24T15:29:50.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff41a74f700 1 -- 172.21.15.152:0/3833473834 >> 172.21.15.152:0/3833473834 conn(0x7ff41409dcc0 msgr2=0x7ff41409e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:50.383 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff41a74f700 1 -- 172.21.15.152:0/3833473834 shutdown_connections 2021-02-24T15:29:50.389 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.372+0000 7ff41a74f700 1 -- 172.21.15.152:0/3833473834 wait complete. 2021-02-24T15:29:50.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.373+0000 7ff41a74f700 1 librados: starting msgr at 2021-02-24T15:29:50.390 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.373+0000 7ff41a74f700 1 librados: starting objecter 2021-02-24T15:29:50.391 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.373+0000 7ff41a74f700 1 Processor -- start 2021-02-24T15:29:50.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.373+0000 7ff41a74f700 1 -- start start 2021-02-24T15:29:50.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.373+0000 7ff41a74f700 1 librados: setting wanted keys 2021-02-24T15:29:50.392 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.373+0000 7ff41a74f700 1 librados: calling monclient init 2021-02-24T15:29:50.393 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.374+0000 7ff41a74f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff414095510 con 0x7ff414062da0 2021-02-24T15:29:50.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.374+0000 7ff41a74f700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4140957b0 con 0x7ff414063220 2021-02-24T15:29:50.395 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.374+0000 7ff41a74f700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff414095a50 con 0x7ff414099340 2021-02-24T15:29:50.396 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.374+0000 7ff413fff700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7ff414062da0 legacy=0x7ff414139df0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:29:50.399 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.374+0000 7ff418cec700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7ff414099340 0x7ff414142160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37812/0 (socket says 172.21.15.152:37812) 2021-02-24T15:29:50.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.374+0000 7ff418cec700 1 -- 172.21.15.152:0/379164150 learned_addr learned my addr 172.21.15.152:0/379164150 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:50.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff418cec700 1 -- 172.21.15.152:0/379164150 >> v1:172.21.15.152:6790/0 conn(0x7ff414099340 legacy=0x7ff414142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 10 client.?.objecter ms_handle_connect 0x7ff414099340 2021-02-24T15:29:50.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:50.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520795268 0 0) 0x7ff414095a50 con 0x7ff414099340 2021-02-24T15:29:50.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f4004bd0 con 0x7ff414099340 2021-02-24T15:29:50.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff4137fe700 1 -- 172.21.15.152:0/379164150 >> v1:172.21.15.181:6789/0 conn(0x7ff414063220 legacy=0x7ff414096f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:50.401 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 10 client.?.objecter ms_handle_connect 0x7ff414063220 2021-02-24T15:29:50.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:50.402 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154846390 0 0) 0x7ff4140957b0 con 0x7ff414063220 2021-02-24T15:29:50.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff414095a50 con 0x7ff414063220 2021-02-24T15:29:50.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3410454908 0 0) 0x7ff3f4004bd0 con 0x7ff414099340 2021-02-24T15:29:50.403 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff4140957b0 con 0x7ff414099340 2021-02-24T15:29:50.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.376+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff40c004530 con 0x7ff414099340 2021-02-24T15:29:50.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2782973809 0 0) 0x7ff4140957b0 con 0x7ff414099340 2021-02-24T15:29:50.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 >> v1:172.21.15.181:6789/0 conn(0x7ff414063220 legacy=0x7ff414096f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 >> v1:172.21.15.152:6789/0 conn(0x7ff414062da0 legacy=0x7ff414139df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:29:50.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414093870 con 0x7ff414099340 2021-02-24T15:29:50.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41413a500 con 0x7ff414099340 2021-02-24T15:29:50.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff41a74f700 10 client.84443.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:50.407 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4140977d0 con 0x7ff414099340 2021-02-24T15:29:50.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff41a74f700 1 librados: init done 2021-02-24T15:29:50.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff40c004850 con 0x7ff414099340 2021-02-24T15:29:50.408 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7ff40c004b60 con 0x7ff414099340 2021-02-24T15:29:50.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7ff40c004d70 con 0x7ff414099340 2021-02-24T15:29:50.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(548..548 src has 330..548) v4 ==== 5742+0+0 (unknown 913019496 0 0) 0x7ff40c03b570 con 0x7ff414099340 2021-02-24T15:29:50.409 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 10 client.84443.objecter ms_dispatch 0x7ff414001510 osd_map(548..548 src has 330..548) v4 2021-02-24T15:29:50.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 3 client.84443.objecter handle_osd_map got epochs [548,548] > 0 2021-02-24T15:29:50.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.377+0000 7ff3fbfff700 3 client.84443.objecter handle_osd_map decoding full epoch 548 2021-02-24T15:29:50.410 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.378+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ec004d60 con 0x7ff414099340 2021-02-24T15:29:50.411 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.378+0000 7ff3fbfff700 20 client.84443.objecter dump_active .. 0 homeless 2021-02-24T15:29:50.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.380+0000 7ff3fbfff700 10 client.84443.objecter ms_handle_connect 0x7ff3f4031120 2021-02-24T15:29:50.412 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.382+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7ff40c012b20 con 0x7ff414099340 2021-02-24T15:29:50.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.616+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff3ec005590 con 0x7ff414099340 2021-02-24T15:29:50.616 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.616+0000 7ff3fbfff700 1 -- 172.21.15.152:0/379164150 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 2450071412) 0x7ff40c0128f0 con 0x7ff414099340 2021-02-24T15:29:50.617 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:29:50.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.617+0000 7ff41a74f700 10 librados: watch_flush enter 2021-02-24T15:29:50.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.617+0000 7ff41a74f700 10 librados: watch_flush exit 2021-02-24T15:29:50.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.617+0000 7ff41a74f700 20 client.84443.objecter shutdown clearing up homeless session... 2021-02-24T15:29:50.619 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.617+0000 7ff41a74f700 10 client.84443.objecter successfully canceled tick 2021-02-24T15:29:50.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.618+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 >> v1:172.21.15.181:6812/33484 conn(0x7ff3f4031120 legacy=0x7ff3f40335e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.618+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 >> v1:172.21.15.152:6790/0 conn(0x7ff414099340 legacy=0x7ff414142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:50.620 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.618+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 shutdown_connections 2021-02-24T15:29:50.621 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.618+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 >> 172.21.15.152:0/379164150 conn(0x7ff41409dcc0 msgr2=0x7ff41409c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:50.622 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.618+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 shutdown_connections 2021-02-24T15:29:50.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.618+0000 7ff41a74f700 1 -- 172.21.15.152:0/379164150 wait complete. 2021-02-24T15:29:50.623 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:50.618+0000 7ff41a74f700 1 librados: shutdown 2021-02-24T15:29:53.633 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:29:53.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.761+0000 7f54e1f14700 1 Processor -- start 2021-02-24T15:29:53.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.761+0000 7f54e1f14700 1 -- start start 2021-02-24T15:29:53.762 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.761+0000 7f54e1f14700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc063aa0 con 0x7f54dc130c60 2021-02-24T15:29:53.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.761+0000 7f54e1f14700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc093e50 con 0x7f54dc12d150 2021-02-24T15:29:53.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.761+0000 7f54e1f14700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc063cf0 con 0x7f54dc0681d0 2021-02-24T15:29:53.763 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.762+0000 7f54e1713700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7f54dc130c60 legacy=0x7f54dc133050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:29:53.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.762+0000 7f54e0f12700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f54dc0681d0 0x7f54dc063070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37826/0 (socket says 172.21.15.152:37826) 2021-02-24T15:29:53.764 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.762+0000 7f54e0f12700 1 -- 172.21.15.152:0/3957652719 learned_addr learned my addr 172.21.15.152:0/3957652719 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:53.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54e0f12700 1 -- 172.21.15.152:0/3957652719 >> v1:172.21.15.152:6790/0 conn(0x7f54dc0681d0 legacy=0x7f54dc063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:53.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54dbfff700 1 -- 172.21.15.152:0/3957652719 >> v1:172.21.15.181:6789/0 conn(0x7f54dc12d150 legacy=0x7f54dc12f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:53.771 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850106741 0 0) 0x7f54dc063cf0 con 0x7f54dc0681d0 2021-02-24T15:29:53.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54c0003230 con 0x7f54dc0681d0 2021-02-24T15:29:53.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421994870 0 0) 0x7f54c8001460 con 0x7f54dc12d150 2021-02-24T15:29:53.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54dc063cf0 con 0x7f54dc12d150 2021-02-24T15:29:53.772 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 479353718 0 0) 0x7f54c0003230 con 0x7f54dc0681d0 2021-02-24T15:29:53.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 >> v1:172.21.15.181:6789/0 conn(0x7f54dc12d150 legacy=0x7f54dc12f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:53.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 >> v1:172.21.15.152:6789/0 conn(0x7f54dc130c60 legacy=0x7f54dc133050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:29:53.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc063fb0 con 0x7f54dc0681d0 2021-02-24T15:29:53.773 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f54d0001930 con 0x7f54dc0681d0 2021-02-24T15:29:53.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54d0001c40 con 0x7f54dc0681d0 2021-02-24T15:29:53.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.764+0000 7f54db7fe700 1 -- 172.21.15.152:0/3957652719 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f54d0004750 con 0x7f54dc0681d0 2021-02-24T15:29:53.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.765+0000 7f54e1f14700 1 -- 172.21.15.152:0/3957652719 >> v1:172.21.15.152:6790/0 conn(0x7f54dc0681d0 legacy=0x7f54dc063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:53.774 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.765+0000 7f54e1f14700 1 -- 172.21.15.152:0/3957652719 shutdown_connections 2021-02-24T15:29:53.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.765+0000 7f54e1f14700 1 -- 172.21.15.152:0/3957652719 >> 172.21.15.152:0/3957652719 conn(0x7f54dc09b950 msgr2=0x7f54dc09bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:53.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.765+0000 7f54e1f14700 1 -- 172.21.15.152:0/3957652719 shutdown_connections 2021-02-24T15:29:53.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.765+0000 7f54e1f14700 1 -- 172.21.15.152:0/3957652719 wait complete. 2021-02-24T15:29:53.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1f14700 1 librados: starting msgr at 2021-02-24T15:29:53.775 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1f14700 1 librados: starting objecter 2021-02-24T15:29:53.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1f14700 1 Processor -- start 2021-02-24T15:29:53.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1f14700 1 -- start start 2021-02-24T15:29:53.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1f14700 1 librados: setting wanted keys 2021-02-24T15:29:53.776 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1f14700 1 librados: calling monclient init 2021-02-24T15:29:53.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1f14700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc113fc0 con 0x7f54dc12d150 2021-02-24T15:29:53.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1f14700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc13a410 con 0x7f54dc0681d0 2021-02-24T15:29:53.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1f14700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc13ad40 con 0x7f54dc130c60 2021-02-24T15:29:53.777 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54dbfff700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7f54dc12d150 legacy=0x7f54dc12c810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:29:53.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1713700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f54dc130c60 0x7f54dc142460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37834/0 (socket says 172.21.15.152:37834) 2021-02-24T15:29:53.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.766+0000 7f54e1713700 1 -- 172.21.15.152:0/3407642194 learned_addr learned my addr 172.21.15.152:0/3407642194 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:53.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54e1713700 1 -- 172.21.15.152:0/3407642194 >> v1:172.21.15.152:6790/0 conn(0x7f54dc130c60 legacy=0x7f54dc142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:53.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 10 client.?.objecter ms_handle_connect 0x7f54dc130c60 2021-02-24T15:29:53.778 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:53.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765628727 0 0) 0x7f54dc13ad40 con 0x7f54dc130c60 2021-02-24T15:29:53.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54e0f12700 1 -- 172.21.15.152:0/3407642194 >> v1:172.21.15.181:6789/0 conn(0x7f54dc0681d0 legacy=0x7f54dc13a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:53.779 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54bc004bd0 con 0x7f54dc130c60 2021-02-24T15:29:53.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 10 client.?.objecter ms_handle_connect 0x7f54dc0681d0 2021-02-24T15:29:53.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 10 client.?.objecter resend_mon_ops 2021-02-24T15:29:53.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1610843030 0 0) 0x7f54bc004bd0 con 0x7f54dc130c60 2021-02-24T15:29:53.780 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54dc13ad40 con 0x7f54dc130c60 2021-02-24T15:29:53.781 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f54d40044b0 con 0x7f54dc130c60 2021-02-24T15:29:53.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740560058 0 0) 0x7f54dc13a410 con 0x7f54dc0681d0 2021-02-24T15:29:53.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54bc004bd0 con 0x7f54dc0681d0 2021-02-24T15:29:53.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4092051674 0 0) 0x7f54dc13ad40 con 0x7f54dc130c60 2021-02-24T15:29:53.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 >> v1:172.21.15.181:6789/0 conn(0x7f54dc0681d0 legacy=0x7f54dc13a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:53.795 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 >> v1:172.21.15.152:6789/0 conn(0x7f54dc12d150 legacy=0x7f54dc12c810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:29:53.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc12cf20 con 0x7f54dc130c60 2021-02-24T15:29:53.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc1141f0 con 0x7f54dc130c60 2021-02-24T15:29:53.796 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54e1f14700 10 client.84449.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:29:53.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc112b60 con 0x7f54dc130c60 2021-02-24T15:29:53.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54e1f14700 1 librados: init done 2021-02-24T15:29:53.797 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54d40047a0 con 0x7f54dc130c60 2021-02-24T15:29:53.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.769+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f54d4004ab0 con 0x7f54dc130c60 2021-02-24T15:29:53.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.770+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f54d4004c40 con 0x7f54dc130c60 2021-02-24T15:29:53.798 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.770+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(548..548 src has 330..548) v4 ==== 5742+0+0 (unknown 913019496 0 0) 0x7f54d403b530 con 0x7f54dc130c60 2021-02-24T15:29:53.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.770+0000 7f54d8ff9700 10 client.84449.objecter ms_dispatch 0x7f54dc001510 osd_map(548..548 src has 330..548) v4 2021-02-24T15:29:53.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.770+0000 7f54d8ff9700 3 client.84449.objecter handle_osd_map got epochs [548,548] > 0 2021-02-24T15:29:53.799 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.770+0000 7f54d8ff9700 3 client.84449.objecter handle_osd_map decoding full epoch 548 2021-02-24T15:29:53.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.770+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4004d60 con 0x7f54dc130c60 2021-02-24T15:29:53.800 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.770+0000 7f54d8ff9700 20 client.84449.objecter dump_active .. 0 homeless 2021-02-24T15:29:53.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.773+0000 7f54d8ff9700 10 client.84449.objecter ms_handle_connect 0x7f54bc0313e0 2021-02-24T15:29:53.801 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:53.774+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f54d4012a80 con 0x7f54dc130c60 2021-02-24T15:29:54.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.009+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f54b4005010 con 0x7f54dc130c60 2021-02-24T15:29:54.009 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.009+0000 7f54d8ff9700 1 -- 172.21.15.152:0/3407642194 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1342 (unknown 254746657 0 4274394693) 0x7f54d4012670 con 0x7f54dc130c60 2021-02-24T15:29:54.010 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:29:54.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.010+0000 7f54e1f14700 10 librados: watch_flush enter 2021-02-24T15:29:54.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.010+0000 7f54e1f14700 10 librados: watch_flush exit 2021-02-24T15:29:54.014 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.010+0000 7f54e1f14700 20 client.84449.objecter shutdown clearing up homeless session... 2021-02-24T15:29:54.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.010+0000 7f54e1f14700 10 client.84449.objecter successfully canceled tick 2021-02-24T15:29:54.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.011+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 >> v1:172.21.15.181:6812/33484 conn(0x7f54bc0313e0 legacy=0x7f54bc0338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:54.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.011+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 >> v1:172.21.15.152:6790/0 conn(0x7f54dc130c60 legacy=0x7f54dc142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:29:54.015 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.011+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 shutdown_connections 2021-02-24T15:29:54.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.011+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 >> 172.21.15.152:0/3407642194 conn(0x7f54dc09b950 msgr2=0x7f54dc12fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:29:54.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.011+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 shutdown_connections 2021-02-24T15:29:54.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.011+0000 7f54e1f14700 1 -- 172.21.15.152:0/3407642194 wait complete. 2021-02-24T15:29:54.016 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:54.011+0000 7f54e1f14700 1 librados: shutdown 2021-02-24T15:29:57.023 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2021-02-24T15:29:57.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.152+0000 7f301ff9e700 1 Processor -- start 2021-02-24T15:29:57.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.152+0000 7f301ff9e700 1 -- start start 2021-02-24T15:29:57.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.153+0000 7f301ff9e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301812b0d0 con 0x7f3018067e70 2021-02-24T15:29:57.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.153+0000 7f301ff9e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018098a60 con 0x7f30180679c0 2021-02-24T15:29:57.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.153+0000 7f301ff9e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301809a0b0 con 0x7f30180613c0 2021-02-24T15:29:57.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.153+0000 7f301e53b700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f3018133410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:29:57.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.153+0000 7f301dd3a700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f30180613c0 0x7f301812a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37844/0 (socket says 172.21.15.152:37844) 2021-02-24T15:29:57.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.153+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 learned_addr learned my addr 172.21.15.152:0/2362373219 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:29:57.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.155+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f30180613c0 legacy=0x7f301812a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:57.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.155+0000 7f301d539700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f30180679c0 legacy=0x7f301812fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:29:57.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.354+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f3018133410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:29:59.416 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:57.755+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f3018133410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:29:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:29:58.556+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f3018133410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:00.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f30180613c0 legacy=0x7f301812a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:00.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f30180679c0 legacy=0x7f301812fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:00.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f3018133410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:30:00.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301809a350 con 0x7f3018067e70 2021-02-24T15:30:00.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301812b0d0 con 0x7f30180679c0 2021-02-24T15:30:00.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff8010140 con 0x7f2ff80034a0 2021-02-24T15:30:00.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.153+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:00.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.155+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f2ff80034a0 legacy=0x7f2ff80058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:00.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.156+0000 7f301d539700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f30180679c0 legacy=0x7f2ff80090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:00.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.354+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:00.755 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:00.755+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:01.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:01.556+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f2ff80034a0 legacy=0x7f2ff80058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:03.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f30180679c0 legacy=0x7f2ff80090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:30:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80113b0 con 0x7f3018067e70 2021-02-24T15:30:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301809a350 con 0x7f2ff800f2c0 2021-02-24T15:30:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.153+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80070d0 con 0x7f2ff80034a0 2021-02-24T15:30:03.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.153+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.156+0000 7f301d539700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f2ff800f2c0 legacy=0x7f2ff800f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:03.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.156+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f2ff80034a0 legacy=0x7f2ff80058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.355+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:03.756 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:03.756+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:04.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:04.557+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:06.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f2ff80034a0 legacy=0x7f2ff80058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:06.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f2ff800f2c0 legacy=0x7f2ff800f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:06.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f3018067e70 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:30:06.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff8008270 con 0x7f2ff80072c0 2021-02-24T15:30:06.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80113b0 con 0x7f2ff800f2c0 2021-02-24T15:30:06.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff8007eb0 con 0x7f2ff80034a0 2021-02-24T15:30:06.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.154+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f2ff80072c0 legacy=0x7f2ff8007700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:06.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.156+0000 7f301d539700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f2ff800f2c0 legacy=0x7f2ff800f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:06.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.156+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f2ff80034a0 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:06.354 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.355+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f2ff80072c0 legacy=0x7f2ff8007700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:06.756 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:06.756+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f2ff80072c0 legacy=0x7f2ff8007700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:07.557 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:07.557+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f2ff80072c0 legacy=0x7f2ff8007700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:09.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f2ff80034a0 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:09.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f2ff800f2c0 legacy=0x7f2ff800f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:09.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f2ff80072c0 legacy=0x7f2ff8007700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:30:09.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff8008090 con 0x7f2ff80072c0 2021-02-24T15:30:09.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff8008270 con 0x7f2ff8008480 2021-02-24T15:30:09.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.154+0000 7f30077fe700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff800fab0 con 0x7f2ff800f6a0 2021-02-24T15:30:09.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.154+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f2ff80072c0 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:09.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.157+0000 7f301d539700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f2ff800f6a0 legacy=0x7f2ff80088c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:09.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.157+0000 7f301dd3a700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f2ff8008480 legacy=0x7f2ff80058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:09.355 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.355+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f2ff80072c0 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:09.755 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:09.756+0000 7f301e53b700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f2ff80072c0 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:10.143 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.141+0000 7f301cd38700 1 -- 172.21.15.152:0/2362373219 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227044409 0 0) 0x7f2ff800fab0 con 0x7f2ff800f6a0 2021-02-24T15:30:10.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.141+0000 7f301cd38700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3000003230 con 0x7f2ff800f6a0 2021-02-24T15:30:10.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.142+0000 7f301cd38700 1 -- 172.21.15.152:0/2362373219 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2698075035 0 0) 0x7f3000003230 con 0x7f2ff800f6a0 2021-02-24T15:30:10.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.142+0000 7f301cd38700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.181:6789/0 conn(0x7f2ff8008480 legacy=0x7f2ff80058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.144 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.142+0000 7f301cd38700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6789/0 conn(0x7f2ff80072c0 legacy=0x7f2ff800c8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:30:10.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.142+0000 7f301cd38700 1 -- 172.21.15.152:0/2362373219 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8008fd0 con 0x7f2ff800f6a0 2021-02-24T15:30:10.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.142+0000 7f301cd38700 1 -- 172.21.15.152:0/2362373219 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3008001910 con 0x7f2ff800f6a0 2021-02-24T15:30:10.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.142+0000 7f301cd38700 1 -- 172.21.15.152:0/2362373219 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3008001bb0 con 0x7f2ff800f6a0 2021-02-24T15:30:10.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.142+0000 7f301cd38700 1 -- 172.21.15.152:0/2362373219 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3008002060 con 0x7f2ff800f6a0 2021-02-24T15:30:10.145 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.143+0000 7f301ff9e700 1 -- 172.21.15.152:0/2362373219 >> v1:172.21.15.152:6790/0 conn(0x7f2ff800f6a0 legacy=0x7f2ff80088c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.143+0000 7f301ff9e700 1 -- 172.21.15.152:0/2362373219 shutdown_connections 2021-02-24T15:30:10.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.143+0000 7f301ff9e700 1 -- 172.21.15.152:0/2362373219 >> 172.21.15.152:0/2362373219 conn(0x7f301809a940 msgr2=0x7f301809ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:30:10.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.143+0000 7f301ff9e700 1 -- 172.21.15.152:0/2362373219 shutdown_connections 2021-02-24T15:30:10.146 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.143+0000 7f301ff9e700 1 -- 172.21.15.152:0/2362373219 wait complete. 2021-02-24T15:30:10.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.144+0000 7f301ff9e700 1 librados: starting msgr at 2021-02-24T15:30:10.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.144+0000 7f301ff9e700 1 librados: starting objecter 2021-02-24T15:30:10.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.144+0000 7f301ff9e700 1 Processor -- start 2021-02-24T15:30:10.150 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.144+0000 7f301ff9e700 1 -- start start 2021-02-24T15:30:10.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.144+0000 7f301ff9e700 1 librados: setting wanted keys 2021-02-24T15:30:10.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.144+0000 7f301ff9e700 1 librados: calling monclient init 2021-02-24T15:30:10.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.145+0000 7f301ff9e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018099480 con 0x7f2ff8008480 2021-02-24T15:30:10.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.145+0000 7f301ff9e700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018127990 con 0x7f2ff80072c0 2021-02-24T15:30:10.151 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.145+0000 7f301ff9e700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018113e80 con 0x7f2ff800f6a0 2021-02-24T15:30:10.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.145+0000 7f301d539700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7f2ff8008480 legacy=0x7f30181236b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:10.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.145+0000 7f301e53b700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2ff800f6a0 0x7f3018142350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37916/0 (socket says 172.21.15.152:37916) 2021-02-24T15:30:10.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.145+0000 7f301e53b700 1 -- 172.21.15.152:0/3063428389 learned_addr learned my addr 172.21.15.152:0/3063428389 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:30:10.152 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f301e53b700 1 -- 172.21.15.152:0/3063428389 >> v1:172.21.15.152:6790/0 conn(0x7f2ff800f6a0 legacy=0x7f3018142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f3005ffb700 10 client.?.objecter ms_handle_connect 0x7f2ff800f6a0 2021-02-24T15:30:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f3005ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:30:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f3005ffb700 10 client.?.objecter ms_handle_connect 0x7f2ff80072c0 2021-02-24T15:30:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f3005ffb700 10 client.?.objecter resend_mon_ops 2021-02-24T15:30:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f301dd3a700 1 -- 172.21.15.152:0/3063428389 >> v1:172.21.15.181:6789/0 conn(0x7f2ff80072c0 legacy=0x7f301813a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445258807 0 0) 0x7f3018113e80 con 0x7f2ff800f6a0 2021-02-24T15:30:10.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff800fa80 con 0x7f2ff800f6a0 2021-02-24T15:30:10.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90322063 0 0) 0x7f3018127990 con 0x7f2ff80072c0 2021-02-24T15:30:10.154 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3018113e80 con 0x7f2ff80072c0 2021-02-24T15:30:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.147+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4286523643 0 0) 0x7f2ff800fa80 con 0x7f2ff800f6a0 2021-02-24T15:30:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3018127990 con 0x7f2ff800f6a0 2021-02-24T15:30:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f30100047c0 con 0x7f2ff800f6a0 2021-02-24T15:30:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2937539829 0 0) 0x7f3018127990 con 0x7f2ff800f6a0 2021-02-24T15:30:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 >> v1:172.21.15.181:6789/0 conn(0x7f2ff80072c0 legacy=0x7f301813a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 >> v1:172.21.15.152:6789/0 conn(0x7f2ff8008480 legacy=0x7f30181236b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:30:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018114120 con 0x7f2ff800f6a0 2021-02-24T15:30:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3018123dc0 con 0x7f2ff800f6a0 2021-02-24T15:30:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3010004cd0 con 0x7f2ff800f6a0 2021-02-24T15:30:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f3010004fe0 con 0x7f2ff800f6a0 2021-02-24T15:30:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f301ff9e700 10 client.84455.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:30:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3018067010 con 0x7f2ff800f6a0 2021-02-24T15:30:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.148+0000 7f301ff9e700 1 librados: init done 2021-02-24T15:30:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.149+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f30100051c0 con 0x7f2ff800f6a0 2021-02-24T15:30:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.149+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(548..548 src has 330..548) v4 ==== 5742+0+0 (unknown 913019496 0 0) 0x7f301003a070 con 0x7f2ff800f6a0 2021-02-24T15:30:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.149+0000 7f3005ffb700 10 client.84455.objecter ms_dispatch 0x7f3018001510 osd_map(548..548 src has 330..548) v4 2021-02-24T15:30:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.149+0000 7f3005ffb700 3 client.84455.objecter handle_osd_map got epochs [548,548] > 0 2021-02-24T15:30:10.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.149+0000 7f3005ffb700 3 client.84455.objecter handle_osd_map decoding full epoch 548 2021-02-24T15:30:10.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.149+0000 7f3005ffb700 20 client.84455.objecter dump_active .. 0 homeless 2021-02-24T15:30:10.159 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.149+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3018112ab0 con 0x7f2ff800f6a0 2021-02-24T15:30:10.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.152+0000 7f3005ffb700 10 client.84455.objecter ms_handle_connect 0x7f2ff80338d0 2021-02-24T15:30:10.160 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.154+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (unknown 1092875540 0 4057190877) 0x7f3010012b90 con 0x7f2ff800f6a0 2021-02-24T15:30:10.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.399+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 --> v1:172.21.15.152:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3018058400 con 0x7f2ff800f6a0 2021-02-24T15:30:10.400 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.400+0000 7f3005ffb700 1 -- 172.21.15.152:0/3063428389 <== mon.2 v1:172.21.15.152:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1336 (unknown 254746657 0 3284491453) 0x7f3010012780 con 0x7f2ff800f6a0 2021-02-24T15:30:10.400 INFO:teuthology.orchestra.run.smithi152.stdout:{"election_epoch":70,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138303579357183","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"]},"monmap":{"epoch":1,"fsid":"d54e238b-89a2-4d0f-9dd4-1a64625c33b0","modified":"2021-02-24T15:15:32.587177Z","created":"2021-02-24T15:15:32.587177Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.152:6790","nonce":0}]},"addr":"172.21.15.152:6790/0","public_addr":"172.21.15.152:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2021-02-24T15:30:10.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.401+0000 7f301ff9e700 10 librados: watch_flush enter 2021-02-24T15:30:10.404 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.401+0000 7f301ff9e700 10 librados: watch_flush exit 2021-02-24T15:30:10.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.401+0000 7f301ff9e700 20 client.84455.objecter shutdown clearing up homeless session... 2021-02-24T15:30:10.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.401+0000 7f301ff9e700 10 client.84455.objecter successfully canceled tick 2021-02-24T15:30:10.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.402+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 >> v1:172.21.15.181:6812/33484 conn(0x7f2ff80338d0 legacy=0x7f2ff8035d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.402+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 >> v1:172.21.15.152:6790/0 conn(0x7f2ff800f6a0 legacy=0x7f3018142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.405 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.402+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 shutdown_connections 2021-02-24T15:30:10.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.402+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 >> 172.21.15.152:0/3063428389 conn(0x7f301809a940 msgr2=0x7f3018127c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:30:10.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.402+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 shutdown_connections 2021-02-24T15:30:10.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.402+0000 7f301ff9e700 1 -- 172.21.15.152:0/3063428389 wait complete. 2021-02-24T15:30:10.406 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.402+0000 7f301ff9e700 1 librados: shutdown 2021-02-24T15:30:10.413 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2021-02-24T15:30:10.413 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2021-02-24T15:30:10.532 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.531+0000 7f2fee57d700 1 Processor -- start 2021-02-24T15:30:10.532 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.531+0000 7f2fee57d700 1 -- start start 2021-02-24T15:30:10.532 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.532+0000 7f2fee57d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe8099570 con 0x7f2fe81313a0 2021-02-24T15:30:10.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.532+0000 7f2fee57d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe809a3c0 con 0x7f2fe8127410 2021-02-24T15:30:10.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.532+0000 7f2fee57d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe80951c0 con 0x7f2fe8127d50 2021-02-24T15:30:10.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.532+0000 7f2fecb1a700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7f2fe81313a0 legacy=0x7f2fe8133790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:10.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.532+0000 7f2fe77fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2fe8127d50 0x7f2fe812fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37922/0 (socket says 172.21.15.152:37922) 2021-02-24T15:30:10.533 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.532+0000 7f2fe77fe700 1 -- 172.21.15.152:0/103325030 learned_addr learned my addr 172.21.15.152:0/103325030 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:30:10.535 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.534+0000 7f2fe77fe700 1 -- 172.21.15.152:0/103325030 >> v1:172.21.15.152:6790/0 conn(0x7f2fe8127d50 legacy=0x7f2fe812fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.535 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.534+0000 7f2fe6ffd700 1 -- 172.21.15.152:0/103325030 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222297638 0 0) 0x7f2fe80951c0 con 0x7f2fe8127d50 2021-02-24T15:30:10.536 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.534+0000 7f2fe6ffd700 1 -- 172.21.15.152:0/103325030 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd4003230 con 0x7f2fe8127d50 2021-02-24T15:30:10.536 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.534+0000 7f2fe7fff700 1 -- 172.21.15.152:0/103325030 >> v1:172.21.15.181:6789/0 conn(0x7f2fe8127410 legacy=0x7f2fe8097920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.536 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.534+0000 7f2fe6ffd700 1 -- 172.21.15.152:0/103325030 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 199976953 0 0) 0x7f2fd4003230 con 0x7f2fe8127d50 2021-02-24T15:30:10.536 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.534+0000 7f2fe6ffd700 1 -- 172.21.15.152:0/103325030 >> v1:172.21.15.181:6789/0 conn(0x7f2fe8127410 legacy=0x7f2fe8097920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.536 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.534+0000 7f2fe6ffd700 1 -- 172.21.15.152:0/103325030 >> v1:172.21.15.152:6789/0 conn(0x7f2fe81313a0 legacy=0x7f2fe8133790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:30:10.537 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.534+0000 7f2fe6ffd700 1 -- 172.21.15.152:0/103325030 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8095460 con 0x7f2fe8127d50 2021-02-24T15:30:10.537 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.534+0000 7f2fe6ffd700 1 -- 172.21.15.152:0/103325030 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2fdc001930 con 0x7f2fe8127d50 2021-02-24T15:30:10.537 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.535+0000 7f2fe6ffd700 1 -- 172.21.15.152:0/103325030 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2fdc001c40 con 0x7f2fe8127d50 2021-02-24T15:30:10.537 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.535+0000 7f2fe6ffd700 1 -- 172.21.15.152:0/103325030 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2fdc004750 con 0x7f2fe8127d50 2021-02-24T15:30:10.537 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.535+0000 7f2fee57d700 1 -- 172.21.15.152:0/103325030 >> v1:172.21.15.152:6790/0 conn(0x7f2fe8127d50 legacy=0x7f2fe812fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.538 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.535+0000 7f2fee57d700 1 -- 172.21.15.152:0/103325030 shutdown_connections 2021-02-24T15:30:10.538 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.535+0000 7f2fee57d700 1 -- 172.21.15.152:0/103325030 >> 172.21.15.152:0/103325030 conn(0x7f2fe806a670 msgr2=0x7f2fe809dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:30:10.538 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.535+0000 7f2fee57d700 1 -- 172.21.15.152:0/103325030 shutdown_connections 2021-02-24T15:30:10.538 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.535+0000 7f2fee57d700 1 -- 172.21.15.152:0/103325030 wait complete. 2021-02-24T15:30:10.543 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fee57d700 1 librados: starting msgr at 2021-02-24T15:30:10.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fee57d700 1 librados: starting objecter 2021-02-24T15:30:10.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fee57d700 1 Processor -- start 2021-02-24T15:30:10.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fee57d700 1 -- start start 2021-02-24T15:30:10.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fee57d700 1 librados: setting wanted keys 2021-02-24T15:30:10.544 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fee57d700 1 librados: calling monclient init 2021-02-24T15:30:10.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fee57d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe8099810 con 0x7f2fe81313a0 2021-02-24T15:30:10.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fee57d700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe8130910 con 0x7f2fe8127410 2021-02-24T15:30:10.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fee57d700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe812d000 con 0x7f2fe8127d50 2021-02-24T15:30:10.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.536+0000 7f2fecb1a700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7f2fe81313a0 legacy=0x7f2fe81428b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:10.545 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.537+0000 7f2fe77fe700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7f2fe8127d50 0x7f2fe813f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37930/0 (socket says 172.21.15.152:37930) 2021-02-24T15:30:10.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.537+0000 7f2fe77fe700 1 -- 172.21.15.152:0/1778881301 learned_addr learned my addr 172.21.15.152:0/1778881301 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:30:10.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fe77fe700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.152:6790/0 conn(0x7f2fe8127d50 legacy=0x7f2fe813f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 10 client.?.objecter ms_handle_connect 0x7f2fe8127d50 2021-02-24T15:30:10.546 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:30:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 10 client.?.objecter ms_handle_connect 0x7f2fe8127410 2021-02-24T15:30:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:30:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fe7fff700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.181:6789/0 conn(0x7f2fe8127410 legacy=0x7f2fe812ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271790314 0 0) 0x7f2fe812d000 con 0x7f2fe8127d50 2021-02-24T15:30:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc8004bd0 con 0x7f2fe8127d50 2021-02-24T15:30:10.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025239756 0 0) 0x7f2fe8130910 con 0x7f2fe8127410 2021-02-24T15:30:10.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe812d000 con 0x7f2fe8127410 2021-02-24T15:30:10.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1115508598 0 0) 0x7f2fc8004bd0 con 0x7f2fe8127d50 2021-02-24T15:30:10.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2fe8130910 con 0x7f2fe8127d50 2021-02-24T15:30:10.548 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2fdc0018f0 con 0x7f2fe8127d50 2021-02-24T15:30:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 213798792 0 0) 0x7f2fe812d000 con 0x7f2fe8127410 2021-02-24T15:30:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2fc8004bd0 con 0x7f2fe8127410 2021-02-24T15:30:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2fd8001b60 con 0x7f2fe8127410 2021-02-24T15:30:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2864204824 0 0) 0x7f2fe8130910 con 0x7f2fe8127d50 2021-02-24T15:30:10.549 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.181:6789/0 conn(0x7f2fe8127410 legacy=0x7f2fe812ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.152:6789/0 conn(0x7f2fe81313a0 legacy=0x7f2fe81428b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:30:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8130690 con 0x7f2fe8127d50 2021-02-24T15:30:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe812c510 con 0x7f2fe8127d50 2021-02-24T15:30:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fee57d700 10 client.84461.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:30:10.550 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe8139fb0 con 0x7f2fe8127d50 2021-02-24T15:30:10.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fee57d700 1 librados: init done 2021-02-24T15:30:10.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2fdc004dc0 con 0x7f2fe8127d50 2021-02-24T15:30:10.551 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.539+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2fdc004f30 con 0x7f2fe8127d50 2021-02-24T15:30:10.552 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.540+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7f2fdc005150 con 0x7f2fe8127d50 2021-02-24T15:30:10.552 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.540+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2fc0006550 con 0x7f2fc00027f0 2021-02-24T15:30:10.552 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.540+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(549..549 src has 330..549) v4 ==== 5742+0+0 (unknown 1443926710 0 0) 0x7f2fdc03b550 con 0x7f2fe8127d50 2021-02-24T15:30:10.552 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.540+0000 7f2fcffff700 10 client.84461.objecter ms_dispatch 0x7f2fe8001510 osd_map(549..549 src has 330..549) v4 2021-02-24T15:30:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.540+0000 7f2fcffff700 3 client.84461.objecter handle_osd_map got epochs [549,549] > 0 2021-02-24T15:30:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.540+0000 7f2fcffff700 3 client.84461.objecter handle_osd_map decoding full epoch 549 2021-02-24T15:30:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.540+0000 7f2fcffff700 20 client.84461.objecter dump_active .. 0 homeless 2021-02-24T15:30:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.542+0000 7f2fcffff700 10 client.84461.objecter ms_handle_connect 0x7f2fc00027f0 2021-02-24T15:30:10.553 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.542+0000 7f2fcffff700 10 client.84461.objecter resend_mon_ops 2021-02-24T15:30:10.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.542+0000 7f2fe7fff700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.152:6790/0 conn(0x7f2fc00027f0 legacy=0x7f2fc0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.542+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227312455 0 0) 0x7f2fc0006550 con 0x7f2fc00027f0 2021-02-24T15:30:10.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.542+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe8130910 con 0x7f2fc00027f0 2021-02-24T15:30:10.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.543+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 1663852264 0 0) 0x7f2fe8130910 con 0x7f2fc00027f0 2021-02-24T15:30:10.554 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.543+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2fc0006550 con 0x7f2fc00027f0 2021-02-24T15:30:10.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.543+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2fd8002300 con 0x7f2fc00027f0 2021-02-24T15:30:10.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.543+0000 7f2fcffff700 10 client.84461.objecter ms_handle_connect 0x7f2fc80313f0 2021-02-24T15:30:10.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.543+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 322669407 0 0) 0x7f2fc0006550 con 0x7f2fc00027f0 2021-02-24T15:30:10.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.543+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fc0009df0 con 0x7f2fc00027f0 2021-02-24T15:30:10.555 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.543+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7f2fd8002650 con 0x7f2fc00027f0 2021-02-24T15:30:10.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.543+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.152:6790/0 conn(0x7f2fc00027f0 legacy=0x7f2fc0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.556 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.543+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.152:6790/0 conn(0x7f2fc00027f0 legacy=0x7f2fc0004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:30:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.551+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f2fc0007520 con 0x7f2fc00068c0 2021-02-24T15:30:10.558 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.553+0000 7f2fcffff700 10 client.84461.objecter ms_handle_connect 0x7f2fc00068c0 2021-02-24T15:30:10.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.553+0000 7f2fe7fff700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.152:6790/0 conn(0x7f2fc00068c0 legacy=0x7f2fc0006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.553+0000 7f2fcffff700 10 client.84461.objecter resend_mon_ops 2021-02-24T15:30:10.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.553+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737993380 0 0) 0x7f2fc0007520 con 0x7f2fc00068c0 2021-02-24T15:30:10.559 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.553+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc0006550 con 0x7f2fc00068c0 2021-02-24T15:30:10.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2901392189 0 0) 0x7f2fc0006550 con 0x7f2fc00068c0 2021-02-24T15:30:10.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2fc0007520 con 0x7f2fc00068c0 2021-02-24T15:30:10.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7f2fd8002d40 con 0x7f2fc00068c0 2021-02-24T15:30:10.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 476723741 0 0) 0x7f2fc0007520 con 0x7f2fc00068c0 2021-02-24T15:30:10.560 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 --> v1:172.21.15.152:6790/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2fc0008720 con 0x7f2fc00068c0 2021-02-24T15:30:10.561 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 <== mon.2 v1:172.21.15.152:6790/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4099 (unknown 0 0 1025422834) 0x7f2fd80076f0 con 0x7f2fc00068c0 2021-02-24T15:30:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.152:6790/0 conn(0x7f2fc00068c0 legacy=0x7f2fc0006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fcffff700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.152:6790/0 conn(0x7f2fc00068c0 legacy=0x7f2fc0006d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:30:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 10 librados: watch_flush enter 2021-02-24T15:30:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 10 librados: watch_flush exit 2021-02-24T15:30:10.563 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 20 client.84461.objecter shutdown clearing up homeless session... 2021-02-24T15:30:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 10 client.84461.objecter successfully canceled tick 2021-02-24T15:30:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.181:6812/33484 conn(0x7f2fc80313f0 legacy=0x7f2fc80338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 >> v1:172.21.15.152:6790/0 conn(0x7f2fe8127d50 legacy=0x7f2fe813f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.564 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fecb1a700 1 -- 172.21.15.152:0/1778881301 reap_dead start 2021-02-24T15:30:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fecb1a700 1 -- 172.21.15.152:0/1778881301 reap_dead start 2021-02-24T15:30:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 shutdown_connections 2021-02-24T15:30:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 >> 172.21.15.152:0/1778881301 conn(0x7f2fe806a670 msgr2=0x7f2fe8097810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:30:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 shutdown_connections 2021-02-24T15:30:10.565 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 1 -- 172.21.15.152:0/1778881301 wait complete. 2021-02-24T15:30:10.566 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.554+0000 7f2fee57d700 1 librados: shutdown 2021-02-24T15:30:10.566 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:30:10.566 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:30:10.566 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:30:10.567 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "peon", 2021-02-24T15:30:10.567 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 70, 2021-02-24T15:30:10.567 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:30:10.567 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:30:10.567 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:30:10.568 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.568 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:30:10.568 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:30:10.568 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:30:10.568 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:30:10.569 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:30:10.569 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:30:10.569 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:30:10.569 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:30:10.569 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:30:10.570 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:30:10.570 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:30:10.570 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:30:10.570 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:30:10.571 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.571 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:30:10.571 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:30:10.571 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:30:10.572 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:30:10.572 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:30:10.572 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:30:10.573 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:30:10.573 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:30:10.573 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:30:10.573 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:30:10.574 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:30:10.574 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.574 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:30:10.574 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:30:10.575 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:30:10.575 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:30:10.575 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:30:10.575 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:30:10.576 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:30:10.576 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:30:10.576 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:30:10.576 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:30:10.577 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:30:10.577 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:30:10.578 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:30:10.578 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:30:10.578 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:30:10.579 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:30:10.579 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:30:10.579 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:30:10.579 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:30:10.579 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:30:10.580 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:30:10.580 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:30:10.580 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:30:10.580 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:30:10.580 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.581 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:30:10.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.581 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:30:10.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.582 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:30:10.583 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:30:10.583 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:30:10.583 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:30:10.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.584 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:30:10.584 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:30:10.584 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:30:10.584 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.585 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.585 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:30:10.586 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:30:10.586 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:30:10.586 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:30:10.586 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:30:10.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.587 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:30:10.587 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:30:10.587 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:30:10.587 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:30:10.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.588 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:30:10.588 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:30:10.588 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:30:10.588 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.589 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.589 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:30:10.589 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:30:10.590 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:30:10.590 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:30:10.590 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:30:10.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.591 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:30:10.591 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:30:10.591 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:30:10.591 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:30:10.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.592 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:30:10.593 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:30:10.593 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:30:10.593 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.593 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.594 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:30:10.594 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:30:10.595 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:30:10.595 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:30:10.595 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:30:10.595 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.595 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.596 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:30:10.596 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:30:10.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.596 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:30:10.597 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:30:10.597 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:30:10.597 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.597 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.598 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:30:10.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.598 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:30:10.598 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:30:10.598 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4 2021-02-24T15:30:10.599 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.599 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.599 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:30:10.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.599 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:30:10.600 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:30:10.600 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5 2021-02-24T15:30:10.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.600 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.600 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": [ 2021-02-24T15:30:10.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.601 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:30:10.601 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:30:10.601 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:30:10.601 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.602 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.602 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:30:10.602 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:30:10.604 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2021-02-24T15:30:10.721 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.721+0000 7fc7aa671700 1 Processor -- start 2021-02-24T15:30:10.722 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.721+0000 7fc7aa671700 1 -- start start 2021-02-24T15:30:10.722 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.722+0000 7fc7aa671700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a4097d40 con 0x7fc7a4062da0 2021-02-24T15:30:10.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.722+0000 7fc7aa671700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a4063d00 con 0x7fc7a4099340 2021-02-24T15:30:10.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.722+0000 7fc7aa671700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a4097980 con 0x7fc7a4063220 2021-02-24T15:30:10.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.722+0000 7fc7a37fe700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc7a4062da0 legacy=0x7fc7a412fd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:10.723 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.722+0000 7fc7a8c0e700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc7a4063220 0x7fc7a4133440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37940/0 (socket says 172.21.15.152:37940) 2021-02-24T15:30:10.724 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.722+0000 7fc7a8c0e700 1 -- 172.21.15.152:0/1332277301 learned_addr learned my addr 172.21.15.152:0/1332277301 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:30:10.725 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.724+0000 7fc7a8c0e700 1 -- 172.21.15.152:0/1332277301 >> v1:172.21.15.152:6790/0 conn(0x7fc7a4063220 legacy=0x7fc7a4133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.724+0000 7fc7a2ffd700 1 -- 172.21.15.152:0/1332277301 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402133226 0 0) 0x7fc7a4097980 con 0x7fc7a4063220 2021-02-24T15:30:10.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.724+0000 7fc7a2ffd700 1 -- 172.21.15.152:0/1332277301 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc790003230 con 0x7fc7a4063220 2021-02-24T15:30:10.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.724+0000 7fc7a3fff700 1 -- 172.21.15.152:0/1332277301 >> v1:172.21.15.181:6789/0 conn(0x7fc7a4099340 legacy=0x7fc7a4097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.724+0000 7fc7a2ffd700 1 -- 172.21.15.152:0/1332277301 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1810638075 0 0) 0x7fc790003230 con 0x7fc7a4063220 2021-02-24T15:30:10.726 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.724+0000 7fc7a2ffd700 1 -- 172.21.15.152:0/1332277301 >> v1:172.21.15.181:6789/0 conn(0x7fc7a4099340 legacy=0x7fc7a4097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.724+0000 7fc7a2ffd700 1 -- 172.21.15.152:0/1332277301 >> v1:172.21.15.152:6789/0 conn(0x7fc7a4062da0 legacy=0x7fc7a412fd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-24T15:30:10.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.724+0000 7fc7a2ffd700 1 -- 172.21.15.152:0/1332277301 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a408fac0 con 0x7fc7a4063220 2021-02-24T15:30:10.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.724+0000 7fc7a2ffd700 1 -- 172.21.15.152:0/1332277301 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc79c001d70 con 0x7fc7a4063220 2021-02-24T15:30:10.727 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.725+0000 7fc7a2ffd700 1 -- 172.21.15.152:0/1332277301 <== mon.2 v1:172.21.15.152:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc79c002060 con 0x7fc7a4063220 2021-02-24T15:30:10.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.725+0000 7fc7a2ffd700 1 -- 172.21.15.152:0/1332277301 <== mon.2 v1:172.21.15.152:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc79c004ad0 con 0x7fc7a4063220 2021-02-24T15:30:10.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.725+0000 7fc7aa671700 1 -- 172.21.15.152:0/1332277301 >> v1:172.21.15.152:6790/0 conn(0x7fc7a4063220 legacy=0x7fc7a4133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.725+0000 7fc7aa671700 1 -- 172.21.15.152:0/1332277301 shutdown_connections 2021-02-24T15:30:10.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.725+0000 7fc7aa671700 1 -- 172.21.15.152:0/1332277301 >> 172.21.15.152:0/1332277301 conn(0x7fc7a409dcc0 msgr2=0x7fc7a409e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:30:10.728 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.725+0000 7fc7aa671700 1 -- 172.21.15.152:0/1332277301 shutdown_connections 2021-02-24T15:30:10.729 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.725+0000 7fc7aa671700 1 -- 172.21.15.152:0/1332277301 wait complete. 2021-02-24T15:30:10.729 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7aa671700 1 librados: starting msgr at 2021-02-24T15:30:10.729 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7aa671700 1 librados: starting objecter 2021-02-24T15:30:10.735 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7aa671700 1 Processor -- start 2021-02-24T15:30:10.735 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7aa671700 1 -- start start 2021-02-24T15:30:10.735 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7aa671700 1 librados: setting wanted keys 2021-02-24T15:30:10.735 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7aa671700 1 librados: calling monclient init 2021-02-24T15:30:10.736 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7aa671700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a4095750 con 0x7fc7a4062da0 2021-02-24T15:30:10.736 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7aa671700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a4095980 con 0x7fc7a4063220 2021-02-24T15:30:10.736 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7aa671700 1 -- --> v1:172.21.15.152:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a4095c20 con 0x7fc7a4099340 2021-02-24T15:30:10.736 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.726+0000 7fc7a3fff700 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc7a4062da0 legacy=0x7fc7a4133870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.152:6789/0 2021-02-24T15:30:10.736 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.727+0000 7fc7a8c0e700 1 --1- >> v1:172.21.15.152:6790/0 conn(0x7fc7a4099340 0x7fc7a4142420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.152:6790/0 says I am v1:172.21.15.152:37950/0 (socket says 172.21.15.152:37950) 2021-02-24T15:30:10.737 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.727+0000 7fc7a8c0e700 1 -- 172.21.15.152:0/3569052780 learned_addr learned my addr 172.21.15.152:0/3569052780 (peer_addr_for_me v1:172.21.15.152:0/0) 2021-02-24T15:30:10.737 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc7a8c0e700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.152:6790/0 conn(0x7fc7a4099340 legacy=0x7fc7a4142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.737 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 10 client.?.objecter ms_handle_connect 0x7fc7a4099340 2021-02-24T15:30:10.737 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:30:10.738 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.2 v1:172.21.15.152:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292332125 0 0) 0x7fc7a4095c20 con 0x7fc7a4099340 2021-02-24T15:30:10.738 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.152:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc784004bd0 con 0x7fc7a4099340 2021-02-24T15:30:10.738 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc7a37fe700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.181:6789/0 conn(0x7fc7a4063220 legacy=0x7fc7a4133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.738 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 10 client.?.objecter ms_handle_connect 0x7fc7a4063220 2021-02-24T15:30:10.738 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 10 client.?.objecter resend_mon_ops 2021-02-24T15:30:10.739 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.2 v1:172.21.15.152:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3576716136 0 0) 0x7fc784004bd0 con 0x7fc7a4099340 2021-02-24T15:30:10.739 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.152:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc7a4095c20 con 0x7fc7a4099340 2021-02-24T15:30:10.739 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.2 v1:172.21.15.152:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc79c001d30 con 0x7fc7a4099340 2021-02-24T15:30:10.739 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194888173 0 0) 0x7fc7a4095980 con 0x7fc7a4063220 2021-02-24T15:30:10.739 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc784004bd0 con 0x7fc7a4063220 2021-02-24T15:30:10.740 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.2 v1:172.21.15.152:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 502719288 0 0) 0x7fc7a4095c20 con 0x7fc7a4099340 2021-02-24T15:30:10.740 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.181:6789/0 conn(0x7fc7a4063220 legacy=0x7fc7a4133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.740 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.152:6789/0 conn(0x7fc7a4062da0 legacy=0x7fc7a4133870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-24T15:30:10.740 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.152:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40998b0 con 0x7fc7a4099340 2021-02-24T15:30:10.740 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.152:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a4093b10 con 0x7fc7a4099340 2021-02-24T15:30:10.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc7aa671700 10 client.84473.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-24T15:30:10.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.152:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a4096850 con 0x7fc7a4099340 2021-02-24T15:30:10.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc7aa671700 1 librados: init done 2021-02-24T15:30:10.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.2 v1:172.21.15.152:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc79c005260 con 0x7fc7a4099340 2021-02-24T15:30:10.741 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.729+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.2 v1:172.21.15.152:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc79c005570 con 0x7fc7a4099340 2021-02-24T15:30:10.742 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.730+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.2 v1:172.21.15.152:6790/0 7 ==== mgrmap(e 4) v1 ==== 35216+0+0 (unknown 1756666445 0 0) 0x7fc79c0056d0 con 0x7fc7a4099340 2021-02-24T15:30:10.742 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.730+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fc77c006550 con 0x7fc77c0027f0 2021-02-24T15:30:10.742 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.730+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.2 v1:172.21.15.152:6790/0 8 ==== osd_map(549..549 src has 330..549) v4 ==== 5742+0+0 (unknown 1443926710 0 0) 0x7fc79c03b880 con 0x7fc7a4099340 2021-02-24T15:30:10.742 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.730+0000 7fc78bfff700 10 client.84473.objecter ms_dispatch 0x7fc7a4001510 osd_map(549..549 src has 330..549) v4 2021-02-24T15:30:10.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.730+0000 7fc78bfff700 3 client.84473.objecter handle_osd_map got epochs [549,549] > 0 2021-02-24T15:30:10.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.730+0000 7fc78bfff700 3 client.84473.objecter handle_osd_map decoding full epoch 549 2021-02-24T15:30:10.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.730+0000 7fc78bfff700 20 client.84473.objecter dump_active .. 0 homeless 2021-02-24T15:30:10.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 10 client.84473.objecter ms_handle_connect 0x7fc77c0027f0 2021-02-24T15:30:10.743 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 10 client.84473.objecter resend_mon_ops 2021-02-24T15:30:10.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc7a3fff700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.181:6789/0 conn(0x7fc77c0027f0 legacy=0x7fc77c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274484551 0 0) 0x7fc77c006550 con 0x7fc77c0027f0 2021-02-24T15:30:10.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7a4095c20 con 0x7fc77c0027f0 2021-02-24T15:30:10.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 10 client.84473.objecter ms_handle_connect 0x7fc7840313e0 2021-02-24T15:30:10.744 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 2971844475 0 0) 0x7fc7a4095c20 con 0x7fc77c0027f0 2021-02-24T15:30:10.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc77c006550 con 0x7fc77c0027f0 2021-02-24T15:30:10.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc794001ac0 con 0x7fc77c0027f0 2021-02-24T15:30:10.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 3699703478 0 0) 0x7fc77c006550 con 0x7fc77c0027f0 2021-02-24T15:30:10.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc77c009df0 con 0x7fc77c0027f0 2021-02-24T15:30:10.745 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8042 (unknown 0 0 2801740443) 0x7fc7940054d0 con 0x7fc77c0027f0 2021-02-24T15:30:10.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.181:6789/0 conn(0x7fc77c0027f0 legacy=0x7fc77c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.746 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.733+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.181:6789/0 conn(0x7fc77c0027f0 legacy=0x7fc77c004c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:30:10.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.741+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fc77c007500 con 0x7fc77c0068a0 2021-02-24T15:30:10.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.744+0000 7fc7a3fff700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.181:6789/0 conn(0x7fc77c0068a0 legacy=0x7fc77c006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-24T15:30:10.748 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.744+0000 7fc78bfff700 10 client.84473.objecter ms_handle_connect 0x7fc77c0068a0 2021-02-24T15:30:10.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.744+0000 7fc78bfff700 10 client.84473.objecter resend_mon_ops 2021-02-24T15:30:10.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.744+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754894333 0 0) 0x7fc77c007500 con 0x7fc77c0068a0 2021-02-24T15:30:10.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.744+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc77c006550 con 0x7fc77c0068a0 2021-02-24T15:30:10.749 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.744+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 561+0+0 (unknown 815028420 0 0) 0x7fc77c006550 con 0x7fc77c0068a0 2021-02-24T15:30:10.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc77c007500 con 0x7fc77c0068a0 2021-02-24T15:30:10.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 392633875 0 0) 0x7fc7940024c0 con 0x7fc77c0068a0 2021-02-24T15:30:10.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 280890767 0 0) 0x7fc77c007500 con 0x7fc77c0068a0 2021-02-24T15:30:10.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc77c008720 con 0x7fc77c0068a0 2021-02-24T15:30:10.750 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 <== mon.1 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+3931 (unknown 0 0 2685560367) 0x7fc794002720 con 0x7fc77c0068a0 2021-02-24T15:30:10.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.181:6789/0 conn(0x7fc77c0068a0 legacy=0x7fc77c006d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc78bfff700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.181:6789/0 conn(0x7fc77c0068a0 legacy=0x7fc77c006d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-24T15:30:10.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc7aa671700 10 librados: watch_flush enter 2021-02-24T15:30:10.751 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc7aa671700 10 librados: watch_flush exit 2021-02-24T15:30:10.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc7aa671700 20 client.84473.objecter shutdown clearing up homeless session... 2021-02-24T15:30:10.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.745+0000 7fc7aa671700 10 client.84473.objecter successfully canceled tick 2021-02-24T15:30:10.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.746+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.181:6812/33484 conn(0x7fc7840313e0 legacy=0x7fc7840338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.746+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 >> v1:172.21.15.152:6790/0 conn(0x7fc7a4099340 legacy=0x7fc7a4142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-24T15:30:10.752 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.746+0000 7fc7a8c0e700 1 -- 172.21.15.152:0/3569052780 reap_dead start 2021-02-24T15:30:10.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.746+0000 7fc7a8c0e700 1 -- 172.21.15.152:0/3569052780 reap_dead start 2021-02-24T15:30:10.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.746+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 shutdown_connections 2021-02-24T15:30:10.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.746+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 >> 172.21.15.152:0/3569052780 conn(0x7fc7a409dcc0 msgr2=0x7fc7a409c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-24T15:30:10.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.746+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 shutdown_connections 2021-02-24T15:30:10.753 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.746+0000 7fc7aa671700 1 -- 172.21.15.152:0/3569052780 wait complete. 2021-02-24T15:30:10.754 INFO:teuthology.orchestra.run.smithi152.stderr:2021-02-24T15:30:10.746+0000 7fc7aa671700 1 librados: shutdown 2021-02-24T15:30:10.754 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2021-02-24T15:30:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:30:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:30:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "leader", 2021-02-24T15:30:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "election_epoch": 70, 2021-02-24T15:30:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum": [ 2021-02-24T15:30:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: 1, 2021-02-24T15:30:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: 2 2021-02-24T15:30:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_age": 0, 2021-02-24T15:30:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:30:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "required_con": "2449958755906961412", 2021-02-24T15:30:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "required_mon": [ 2021-02-24T15:30:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:30:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:30:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:30:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:30:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:30:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:30:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:30:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:30:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:30:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_con": "4540138303579357183", 2021-02-24T15:30:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "quorum_mon": [ 2021-02-24T15:30:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:30:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:30:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:30:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:30:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:30:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:30:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:30:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:30:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:30:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "outside_quorum": [], 2021-02-24T15:30:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "extra_probe_peers": [], 2021-02-24T15:30:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "sync_provider": [], 2021-02-24T15:30:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "monmap": { 2021-02-24T15:30:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "epoch": 1, 2021-02-24T15:30:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "fsid": "d54e238b-89a2-4d0f-9dd4-1a64625c33b0", 2021-02-24T15:30:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "modified": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:30:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "created": "2021-02-24T15:15:32.587177Z", 2021-02-24T15:30:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release": 17, 2021-02-24T15:30:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "min_mon_release_name": "quincy", 2021-02-24T15:30:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "election_strategy": 1, 2021-02-24T15:30:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "disallowed_leaders: ": "", 2021-02-24T15:30:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false, 2021-02-24T15:30:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "features": { 2021-02-24T15:30:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "persistent": [ 2021-02-24T15:30:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "kraken", 2021-02-24T15:30:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: "luminous", 2021-02-24T15:30:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: "mimic", 2021-02-24T15:30:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap-prune", 2021-02-24T15:30:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "nautilus", 2021-02-24T15:30:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "octopus", 2021-02-24T15:30:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "pacific", 2021-02-24T15:30:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "elector-pinging", 2021-02-24T15:30:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "quincy" 2021-02-24T15:30:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "optional": [] 2021-02-24T15:30:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "mons": [ 2021-02-24T15:30:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 0, 2021-02-24T15:30:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "a", 2021-02-24T15:30:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:30:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:30:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:30:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789", 2021-02-24T15:30:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:30:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6789/0", 2021-02-24T15:30:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6789/0", 2021-02-24T15:30:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:30:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:30:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:30:10.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.777 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 1, 2021-02-24T15:30:10.778 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "b", 2021-02-24T15:30:10.778 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:30:10.779 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:30:10.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.779 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:30:10.779 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789", 2021-02-24T15:30:10.780 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:30:10.780 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.780 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.781 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.181:6789/0", 2021-02-24T15:30:10.781 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.181:6789/0", 2021-02-24T15:30:10.781 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:30:10.781 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:30:10.781 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:30:10.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.783 INFO:teuthology.orchestra.run.smithi152.stdout: "rank": 2, 2021-02-24T15:30:10.783 INFO:teuthology.orchestra.run.smithi152.stdout: "name": "c", 2021-02-24T15:30:10.784 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addrs": { 2021-02-24T15:30:10.784 INFO:teuthology.orchestra.run.smithi152.stdout: "addrvec": [ 2021-02-24T15:30:10.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.786 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2021-02-24T15:30:10.786 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790", 2021-02-24T15:30:10.787 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 0 2021-02-24T15:30:10.787 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.787 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.787 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:6790/0", 2021-02-24T15:30:10.788 INFO:teuthology.orchestra.run.smithi152.stdout: "public_addr": "172.21.15.152:6790/0", 2021-02-24T15:30:10.788 INFO:teuthology.orchestra.run.smithi152.stdout: "priority": 0, 2021-02-24T15:30:10.788 INFO:teuthology.orchestra.run.smithi152.stdout: "weight": 0, 2021-02-24T15:30:10.788 INFO:teuthology.orchestra.run.smithi152.stdout: "crush_location": "{}" 2021-02-24T15:30:10.788 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.789 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.789 INFO:teuthology.orchestra.run.smithi152.stdout: "feature_map": { 2021-02-24T15:30:10.789 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": [ 2021-02-24T15:30:10.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.790 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:30:10.790 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:30:10.790 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:30:10.790 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.791 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.791 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": [ 2021-02-24T15:30:10.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.794 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:30:10.795 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:30:10.795 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 2 2021-02-24T15:30:10.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.795 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2021-02-24T15:30:10.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client": [ 2021-02-24T15:30:10.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2021-02-24T15:30:10.796 INFO:teuthology.orchestra.run.smithi152.stdout: "features": "0x3f01cfbb7ffdffff", 2021-02-24T15:30:10.796 INFO:teuthology.orchestra.run.smithi152.stdout: "release": "luminous", 2021-02-24T15:30:10.796 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 1 2021-02-24T15:30:10.797 INFO:teuthology.orchestra.run.smithi152.stdout: } 2021-02-24T15:30:10.797 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2021-02-24T15:30:10.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2021-02-24T15:30:10.797 INFO:teuthology.orchestra.run.smithi152.stdout: "stretch_mode": false 2021-02-24T15:30:10.798 INFO:teuthology.orchestra.run.smithi152.stdout:} 2021-02-24T15:30:10.799 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2021-02-24T15:31:20.800 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2021-02-24T15:31:20.801 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12045 ms) 2021-02-24T15:31:20.801 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2021-02-24T15:31:20.801 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2021-02-24T15:31:20.802 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: 00000010 69 73 |is| 2021-02-24T15:31:20.802 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: 00000012 2021-02-24T15:31:20.802 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (11975 ms) 2021-02-24T15:31:20.802 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [----------] 42 tests from LibRadosTwoPoolsPP (585906 ms total) 2021-02-24T15:31:20.803 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: 2021-02-24T15:31:20.803 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2021-02-24T15:31:20.803 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2021-02-24T15:31:20.803 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1289 ms) 2021-02-24T15:31:20.803 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2021-02-24T15:31:20.804 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (10664 ms) 2021-02-24T15:31:20.804 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2021-02-24T15:31:20.804 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (33012 ms) 2021-02-24T15:31:20.804 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2021-02-24T15:31:20.804 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (2 ms) 2021-02-24T15:31:20.805 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (44967 ms total) 2021-02-24T15:31:20.805 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: 2021-02-24T15:31:20.805 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2021-02-24T15:31:20.805 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2021-02-24T15:31:20.806 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7263 ms) 2021-02-24T15:31:20.806 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2021-02-24T15:31:20.807 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (7721 ms) 2021-02-24T15:31:20.807 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2021-02-24T15:31:20.807 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: waiting for scrub... 2021-02-24T15:31:20.807 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: done waiting 2021-02-24T15:31:20.808 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (25033 ms) 2021-02-24T15:31:20.808 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2021-02-24T15:31:20.808 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9976 ms) 2021-02-24T15:31:20.808 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2021-02-24T15:31:20.808 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8007 ms) 2021-02-24T15:31:20.809 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2021-02-24T15:31:20.809 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (7988 ms) 2021-02-24T15:31:20.809 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2021-02-24T15:31:20.809 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10003 ms) 2021-02-24T15:31:20.809 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2021-02-24T15:31:20.810 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (26802 ms) 2021-02-24T15:31:20.810 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2021-02-24T15:31:20.810 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (13684 ms) 2021-02-24T15:31:20.810 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2021-02-24T15:31:20.811 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (7330 ms) 2021-02-24T15:31:20.811 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2021-02-24T15:31:20.811 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (14019 ms) 2021-02-24T15:31:20.811 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2021-02-24T15:31:20.811 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (8046 ms) 2021-02-24T15:31:20.812 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2021-02-24T15:31:20.812 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (7940 ms) 2021-02-24T15:31:20.812 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2021-02-24T15:31:20.812 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: hmm, no HitSet yet 2021-02-24T15:31:20.812 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: ok, hit_set contains 236:602f83fe:::foo:head 2021-02-24T15:31:20.813 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (10066 ms) 2021-02-24T15:31:20.813 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2021-02-24T15:31:20.813 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: got ls 1614180680,0 2021-02-24T15:31:20.813 INFO:tasks.workunit.client.0.smithi181.stdout: api_tier_pp: first is 1614180680 2021-02-24T15:31:27.349 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-02-24T15:31:27.350 DEBUG:teuthology.task.console_log:Killing console logger for smithi152 2021-02-24T15:31:27.351 DEBUG:teuthology.task.console_log:Killing console logger for smithi181 2021-02-24T15:31:27.351 DEBUG:teuthology.exit:Finished running handlers